Skip to content

Instantly share code, notes, and snippets.

@battmatt
battmatt / ForkJoinAPI.py
Last active March 21, 2024 20:50
Example Parallel Task API based on Celery
# (c) Copyright 2018 Zymergen, Inc.
# All Rights Reserved
"""
The following is example code used for a technology blog post: https://medium.com/@ZymergenTechBlog/building-a-parallel-task-api-with-celery-dbae5ced4e28
The ForkJoin class can be used to generate a ZWork task that contains a single
distributed processing step. Your job should have 3 parts. An initial setup step
responsible for splitting of inputs into workable chunks. A process step that can
process each chunk in a forked execution process and a join step that puts it all
2014-12-01 11:59:00 -0800
./configure
--enable-layout=Homebrew
--enable-mods-shared=all
--enable-unique-id
--enable-ssl
--enable-dav
--enable-cache
--enable-proxy