Skip to content

Instantly share code, notes, and snippets.

View hilmiazizi's full-sized avatar

Hilmi Azizi hilmiazizi

  • Semarang, Indonesia
View GitHub Profile
@ngcrawford
ngcrawford / multiprocessing_template.py
Created March 29, 2012 12:49
Template for multiprocessing large files line by line
#!/usr/bin/env python
# encoding: utf-8
import multiprocessing
from textwrap import dedent
from itertools import izip_longest
def process_chunk(d):
"""Replace this with your own function
that processes data one line at a