Skip to content

Instantly share code, notes, and snippets.

@audhiaprilliant

audhiaprilliant/apache_airflow_covid19_get_url.py

Created December 13, 2020 08:56
Show Gist options
  • Save audhiaprilliant/c41aeea2424708f9e1626007cf60a20b to your computer and use it in GitHub Desktop.
Save audhiaprilliant/c41aeea2424708f9e1626007cf60a20b to your computer and use it in GitHub Desktop.
Download ZIP
Apache Airflow as Job Orchestration
Raw
apache_airflow_covid19_get_url.py
def get_url():
# URL
url = 'https://www.kompas.com/covid-19'
page = requests.get(url)
# Wrangling HTML with BeautifulSoup
soup = BeautifulSoup(page.content,'html.parser')
return(soup)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment