Skip to content

Instantly share code, notes, and snippets.

@audhiaprilliant

audhiaprilliant/apache_airflow_covid19_import_modules.py

Last active December 13, 2020 08:48
Show Gist options
  • Save audhiaprilliant/a6132aa68a1c1feab2699adb651bb3ec to your computer and use it in GitHub Desktop.
Save audhiaprilliant/a6132aa68a1c1feab2699adb651bb3ec to your computer and use it in GitHub Desktop.
Download ZIP
Apache Airflow as Job Orchestration
Raw
apache_airflow_covid19_import_modules.py
# Modules for web scraping
import requests
from bs4 import BeautifulSoup
# Module for data manipulation
import pandas as pd
# Module for regular expression
import re
# Module for file management
import os
# Module for timing
from datetime import datetime
# Module for reading JSON file
import json
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment