Skip to content

Instantly share code, notes, and snippets.

@vinayakkulkarni
Forked from Lukasa/example.py
Created January 23, 2019 13:32
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save vinayakkulkarni/7adbcb69bb9ce84c08285e0dc802ddba to your computer and use it in GitHub Desktop.
Save vinayakkulkarni/7adbcb69bb9ce84c08285e0dc802ddba to your computer and use it in GitHub Desktop.
Requests and Beautiful Soup example, following the form of http://bpaste.net/show/kMetvCdrfnzh5RgiUKU4/
from BeautifulSoup import BeautifulSoup
import requests
import urlparse
URL = 'example.com'
s = requests.Session()
def fetch(url, data=None):
if data is None:
return s.get(url).content
else:
return s.post(url, data=data).content
soup = BeautifulSoup(fetch(URL))
form = soup.find('form')
fields = form.findAll('input')
formdata = dict( (field.get('name'), field.get('value')) for field in fields)
formdata['username'] = u'username'
formdata['password'] = u'password'
print formdata
posturl = urlparse.urljoin(URL, form['action'])
print posturl
r = s.post(posturl, data=formdata)
print r.text
print s.get(URL).text
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment