Skip to content

Instantly share code, notes, and snippets.

@rebornix

rebornix/CrawlerPathAPI.sh

Created January 11, 2014 13:02
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save rebornix/8370715 to your computer and use it in GitHub Desktop.
Save rebornix/8370715 to your computer and use it in GitHub Desktop.
Download ZIP
Crawler4PathAPI
Raw
CrawlerPathAPI.sh
from bs4 import BeautifulSoup
import urllib2
url = 'https://path.com/developers/docs'
data = urllib2.urlopen(url).read()
soup = BeautifulSoup(data)
for node in soup.findAll(attrs={'class': 'curl'}):
print node.contents[0]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment