Skip to content

Instantly share code, notes, and snippets.

@wasi0013
Created October 4, 2019 13:59
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save wasi0013/ad6312ada22e5eff3576eacffe090b14 to your computer and use it in GitHub Desktop.
Save wasi0013/ad6312ada22e5eff3576eacffe090b14 to your computer and use it in GitHub Desktop.
How to download a file that requires custom headers and cookies
import requests
chunk_size = 4096
filename = "logo.png"
document_url = "https://wasi0013.files.wordpress.com/2018/11/my_website_logo_half_circle_green-e1546027650125.png"
headers = {
"User-Agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/77.0.3865.90 Safari/537.36",
"Connection": "keep-alive",
}
s = requests.Session()
cookie = requests.cookies.create_cookie('COOKIE_NAME','COOKIE_VALUE')
s.cookies.set_cookie(cookie)
with s.get(document_url, stream=True, headers=headers) as r:
with open(filename, 'wb') as f:
for chunk in r.iter_content(chunk_size):
if chunk:
f.write(chunk)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment