Skip to content

Instantly share code, notes, and snippets.

@javib51
Last active October 19, 2016 17:19
Show Gist options
  • Save javib51/c8cf0c5bfb974b3457c4beb15444227c to your computer and use it in GitHub Desktop.
Save javib51/c8cf0c5bfb974b3457c4beb15444227c to your computer and use it in GitHub Desktop.
'''
Example using headers. The fields were filled with generic values
'''
import requests
url = 'http://www.example.com/page'
#Create headers
header = {}
header['Host'] = 'www.example.com'
header['User-Agent'] = 'Mozilla/5.0 (X11; Linux x86_64; rv:50.0) Gecko/20100101 Firefox/50.0'
header['Accept'] = 'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8'
header['Accept-Language'] = 'en-US,en;q=0.5'
header['Accept-Encoding'] = 'gzip, deflate'
header['Connection'] = 'keep-alive'
header['Upgrade-Insecure-Requests'] = '1'
#Get from url
response = requests.get(url, headers=header)
#Get cookies
cookies = requests.utils.dict_from_cookiejar(response.cookies)
#page's html
print(response.content)
#Get with cookies
#response = requests.get(url, headers=header, cookies=cookies)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment