Skip to content

Instantly share code, notes, and snippets.

@petitviolet

petitviolet/urlopener.py

Created October 8, 2013 09:29
Show Gist options
  • Save petitviolet/6882089 to your computer and use it in GitHub Desktop.
Save petitviolet/6882089 to your computer and use it in GitHub Desktop.
Download ZIP
urlopener
Raw
urlopener.py
# -*- encoding:utf-8 -*-
import urllib2
opener = urllib2.build_opener()
opener2 = urllib2.build_opener()
opener.addheaders = [\
('Use-Agent', 'Mozilla/5.0 (compatible; googlebot/2.1; \
+ http://www.google.com/bot.html)')]
opener2.addheaders = [\
('User-Agent', 'Mozilla/5.0 (Macintosh; U; PPC Mac OS X; ja-jp) \
AppleWebKit/417.9(KHTML, like Gecko) Safari/125.9')]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment