Skip to content

Instantly share code, notes, and snippets.

@antonymilne
Created January 10, 2022 16:17
Show Gist options
  • Save antonymilne/afd017ed85d1110951de681258720de2 to your computer and use it in GitHub Desktop.
Save antonymilne/afd017ed85d1110951de681258720de2 to your computer and use it in GitHub Desktop.
def register_config_loader(self, conf_paths: Iterable[str]) -> ConfigLoader:
return TemplatedConfigLoader(
conf_paths,
globals_pattern="*globals.yml",
globals_dict={"num_workers": os.environ["num_workers"]},
)
num_workers: ${num_workers}
def f(num_workers):
print(num_workers)
# in pipeline definition include a node like this:
node(f, "params:num_workers", None)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment