Created
January 10, 2022 16:17
-
-
Save antonymilne/afd017ed85d1110951de681258720de2 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
def register_config_loader(self, conf_paths: Iterable[str]) -> ConfigLoader: | |
return TemplatedConfigLoader( | |
conf_paths, | |
globals_pattern="*globals.yml", | |
globals_dict={"num_workers": os.environ["num_workers"]}, | |
) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
num_workers: ${num_workers} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
def f(num_workers): | |
print(num_workers) | |
# in pipeline definition include a node like this: | |
node(f, "params:num_workers", None) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment