Skip to content

Instantly share code, notes, and snippets.

@veltman

veltman/gist:7029964

Created October 17, 2013 18:35
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save veltman/7029964 to your computer and use it in GitHub Desktop.
Save veltman/7029964 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.py
from bs4 import BeautifulSoup
import requests
url = "http://www.google.com/"
text = requests.get(url).text
page = BeautifulSoup(text)
for link in page.find_all("a"):
print link["href"]
#"html.parser",lxml
#import json
#import re
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment