Skip to content

Instantly share code, notes, and snippets.

@kvnkho
Last active August 2, 2022 19:07
Show Gist options
  • Save kvnkho/ca7b5150e44c545f62f7b3a935cdbc57 to your computer and use it in GitHub Desktop.
Save kvnkho/ca7b5150e44c545f62f7b3a935cdbc57 to your computer and use it in GitHub Desktop.
Ploomber Pipeline
# Content of pipeline.yaml
tasks:
- source: extract.py
product:
# scripts generate executed notebooks as outputs
nb: output/extract.html
# you can define as many outputs as you want
data: data/raw.parquet
- source: transform.py
product:
nb: output/transform.html
data: data/transformed.parquet
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment