Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save SurendraTamang/498ed9e2f14c68425ff5107eee2eab5c to your computer and use it in GitHub Desktop.
Save SurendraTamang/498ed9e2f14c68425ff5107eee2eab5c to your computer and use it in GitHub Desktop.
For getting response in request
LIST_OF_USER_AGENTS = ['Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.89 Safari/537.36',
'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.124 Safari/537.36',
'Mozilla/5.0 (Windows NT 4.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2049.0 Safari/537.36',
'Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.67 Safari/537.36',
'Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.3319.102 Safari/537.36',
'Mozilla/5.0 (Windows NT 6.2; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/32.0.1667.0 Safari/537.36',
]
def get_response(url):
headers = {'User-Agent': random.choice(LIST_OF_USER_AGENTS)}
try:
response = requests.get(url=url, headers=headers)
except:
print("Some error is raised!")
response = None
if response is not None:
return response
else:
return None
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment