Skip to content

Instantly share code, notes, and snippets.

View GregHilston's full-sized avatar

Greg Hilston GregHilston

View GitHub Profile
@GregHilston
GregHilston / metaflow_conda_environment_error_local_execution_local_datastore.txt
Last active December 11, 2020 15:12
The following is my Metaflow conda environment error when running locally, on OSX, using a local datastore. I do not get any environment issues when running remotely on AWS Batch and get a different set of Conda issues when running locally with a S3 datastore.
CONDA_CHANNELS=anaconda,conda-forge,maciejkula python3 flows/my_flow.py --environment=conda --no-pylint run 130 ?
Metaflow 2.2.5 executing MyFlow for user:ghilston
Validating your flow...
The graph looks good!
cli.py about to create a MetaflowPackage
MetaflowPackage about to init_environment for flow {flow} in environment {environment}
2020-12-11 09:47:30.165 Bootstrapping conda environment...(this could take a few minutes)!
step <bound method MyFlow.start of <__main__.MyFlow object at 0x7fbfb89cff98>> of type <class 'method'>
deco conda<decorated libraries={} python=None disabled=True> of type <class 'metaflow.plugins.conda.conda_step_decorator.CondaStepDecorator'>
step <bound method MyFlow.get_data of <__main__.MyFlow object at 0x
@GregHilston
GregHilston / metaflow_conda_environment_error_local_execution_s3_datastore.txt
Created December 11, 2020 15:12
The following is my Metaflow conda environment error when running locally, on OSX, using a S3 datastore. I do not get any environment issues when running remotely on AWS Batch and get a different set of Conda issues when running locally with a local datastore.
CONDA_CHANNELS=anaconda,conda-forge,maciejkula python3 flows/my_flow.py --environment=conda --datastore=s3 --no-pylint run 130 ?
Metaflow 2.2.5 executing MyFlow for user:ghilston
Validating your flow...
The graph looks good!
cli.py about to create a MetaflowPackage
MetaflowPackage about to init_environment for flow {flow} in environment {environment}
2020-12-11 09:47:33.212 Bootstrapping conda environment...(this could take a few minutes)!
step <bound method MyFlow.start of <__main__.MyFlow object at 0x7fb8c833ff98>> of type <class 'method'>
deco conda<decorated libraries={} python=None disabled=True> of type <class 'metaflow.plugins.conda.conda_step_decorator.CondaStepDecorator'>
step <bound method MyFlow.get_data of <__main__.MyFlow object at 0x