Skip to content

Instantly share code, notes, and snippets.

@marcelcaraciolo

marcelcaraciolo/reddit_crawler.py

Created November 30, 2013 06:23
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save marcelcaraciolo/7716004 to your computer and use it in GitHub Desktop.
Save marcelcaraciolo/7716004 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
reddit_crawler.py
import urllib.request
import json
url = 'http://www.reddit.com/r/Python/.json'
resp = urllib.request.urlopen(url).read()
parsed = json.loads(resp.decode('utf-8'))
for item in parsed['data']['children']:
doc = item['data']
print (doc['title'])
print ('#comments: %d' %doc['num_comments'])
print (doc['url'])
print ()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment