Skip to content

Instantly share code, notes, and snippets.

@kszucs
Created April 4, 2018 20:15
Show Gist options
  • Save kszucs/e21ac361bc634c67cc0682ba880bab99 to your computer and use it in GitHub Desktop.
Save kszucs/e21ac361bc634c67cc0682ba880bab99 to your computer and use it in GitHub Desktop.
from dask import delayed
@delayed
def install_minicodna_env(...):
pass
@delayed
def install_deps(...):
pass
# etc.
repo = clone_repo('https://github.com/apache/arrow')
conda = install_miniconda()
artifacts = []
for pyver in python_versions:
env = install_miniconda_env(conda, pyver)
art = run_cmake(repo, env)
# run test for example
artifacts.append(art)
done = deploy(artifacts)
done.compute()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment