Skip to content

Instantly share code, notes, and snippets.

@Frichetten

Frichetten/parse_mwa.py

Created June 8, 2019 20:49
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Frichetten/84ac05d44e447c725c2da828381c4c36 to your computer and use it in GitHub Desktop.
Save Frichetten/84ac05d44e447c725c2da828381c4c36 to your computer and use it in GitHub Desktop.
Download ZIP
A quick python script to dump the list of websites from https://www.madewithangular.com/
Raw
parse_mwa.py
#!/usr/bin/env python3
from urllib.request import urlopen
from bs4 import BeautifulSoup
html = urlopen('https://www.madewithangular.com/categories/angular/')
soup = BeautifulSoup(html, features="html5lib")
for link in soup.find_all('a', href=True):
if "/categories/" in link['href']:
None
elif "made.w.angular" in link['href']:
None
elif link['href'] == "/":
None
elif "/about/" in link['href']:
None
elif "madewithangular" in link['href']:
None
else:
print(link['href'])
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment