Skip to content

Instantly share code, notes, and snippets.

@ishritam

ishritam/extraction.py

Created June 20, 2021 11:10
Show Gist options
  • Save ishritam/13a79501a548ebfbca0618ecb9d4ded9 to your computer and use it in GitHub Desktop.
Save ishritam/13a79501a548ebfbca0618ecb9d4ded9 to your computer and use it in GitHub Desktop.
Download ZIP
Airflow Zalando Extraction
Raw
extraction.py
def extract_data(url: str, headers: str, ti) -> None:
res = requests.get(url, headers=headers)
json_data = json.loads(res.content)['articles']
ti.xcom_push(key='extracted_data', value=json_data)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment