Skip to content

Instantly share code, notes, and snippets.

@kvnkho
Created July 31, 2022 04:40
Show Gist options
  • Save kvnkho/1e0332f0647e087cde878b0a2762c6eb to your computer and use it in GitHub Desktop.
Save kvnkho/1e0332f0647e087cde878b0a2762c6eb to your computer and use it in GitHub Desktop.
Ploomber pipeline with parameters
# Content of pipeline.yaml
tasks:
- source: extract.py
product:
# scripts generate executed notebooks as outputs
nb: output/extract.html
# you can define as many outputs as you want
data: 'data/{{raw_filename}}'
params:
engine: '{{engine}}'
- source: transform.py
product:
nb: output/transform.html
data: 'data/{{transformed_filename}}'
params:
engine: '{{engine}}'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment