Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save saumalya75/052f1c9920fabea6893015db937ccfcc to your computer and use it in GitHub Desktop.
Save saumalya75/052f1c9920fabea6893015db937ccfcc to your computer and use it in GitHub Desktop.
DAG Configuration Json
{
"dag": {
"dag_id": "configurable_data_pipeline_demo",
"schedule_interval_unit": "days",
"schedule_interval_val": 1,
"default_args": {
"owner": "saumalya75",
"depends_on_past": false,
"start_date": {
"year": 2020,
"month": 5,
"day": 8
},
"email": ["digi.hogwarts.2020@gmail.com"],
"email_on_failure": false,
"email_on_retry": false,
"retries": 2,
"retry_delay_unit": "seconds",
"retry_delay_val": 25
}
},
"task_details": {
"accounts": [
{
"account_id": "A1",
"files": [
{
"file_id": "A1F1",
"trigger_prefix": "trigger",
"trigger_identifier": "a1f1_trigger_",
"runable": true
},
{
"file_id": "A1F2",
"trigger_prefix": "trigger",
"trigger_identifier": "a1f2_trigger_",
"runable": false
}
],
"runable": true
},
{
"comment": "Add some more configuration, check out 'https://bitbucket.org/saumalya75/airflowoncontainer/src/master/airflow_home/dags/dag_configuration_demo.json'"
}
]
}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment