requests_login.py

import requests
from bs4 import BeautifulSoup

headers = {
    'user-agent': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.99 Safari/537.36'
}

login_data = {
    'name': '<username>',
    'pass': '<password>',
    'form_id': 'new_login_form',
    'op': 'Login'
}

with requests.Session() as s:
    url = 'https://www.codechef.com/'
    r = s.get(url, headers=headers)
    soup = BeautifulSoup(r.content, 'html5lib')
    login_data['form_build_id'] = soup.find('input', attrs={'name': 'form_build_id'})['value']
    r = s.post(url, data=login_data, headers=headers)
    print(r.content)

Try to replace "lxml" by "html5lib" Le mer. 8 janv. 2020 à 13:10, elunesarrow54 <notifications@github.com> a écrit :

…

hi, thanks for your post but i have some problem... https://bionluk.com/login i cant enter the website.. always "[ ]" is coming from this site.. how can i solve this ? adres = "www.bionluk.com/login" headers = { 'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36', } url = str("http://" + adres) #Alınan adresin verilerini topla (request modulü ile) response = requests.get(url, headers = headers) icerik = response.content soup = BeautifulSoup(icerik, "lxml") print(soup.find_all("div")) — You are receiving this because you commented. Reply to this email directly, view it on GitHub <https://gist.github.com/c354874a36c9d85f45fd14309e0afeff?email_source=notifications&email_token=AMPUSH77VE3K2HFDT4L3TB3Q4W7EVA5CNFSM4H432GRKYY3PNVWWK3TUL52HS4DFVNDWS43UINXW23LFNZ2KUY3PNVWWK3TUL5UWJTQAF7DKW#gistcomment-3131051>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AMPUSH6JXVNCTS2PEE5UT7LQ4W7EVANCNFSM4H432GRA> .

i tried but not work... i cant reach the HTML codes... pls some one help me.

url: www.bionluk.com/login

hi i tried the same code (just inputed by username ad password) but i am not able to login to the website

b'\n\n\n\n

could you help me out

You can try to use a webdriver, so you will be able to login to a website and automate the connection. Le sam. 29 févr. 2020 à 17:04, vigkan <notifications@github.com> a écrit :

…

hi i tried the same code (just inputed by username ad password) but i am not able to login to the website b'\n\n\n\n — You are receiving this because you commented. Reply to this email directly, view it on GitHub <https://gist.github.com/c354874a36c9d85f45fd14309e0afeff?email_source=notifications&email_token=AMPUSH5GZEGZ3Z2Y4M373HLRFEYXDA5CNFSM4H432GRKYY3PNVWWK3TUL52HS4DFVNDWS43UINXW23LFNZ2KUY3PNVWWK3TUL5UWJTQAGC6W6#gistcomment-3194223>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AMPUSHYTT4ZVUWRGICP7YFDRFEYXDANCNFSM4H432GRA> .

Hi Nickhil, thank you for this video , I've tried it with my own parameters and website but the only response was :
Users\Sami\AppData\Local\Programs\Python\Python37-32\python.exe: can't find 'main' module in ''
Could you please tell me what is the matter .
best regards
Sami

Hi Nikhil, This Code is Excellent and works perfect.
Can we check the status_code of the post request to know if login is successful or not ( for multiple accounts login)
I don't want content of the login page, just need to know if login is successful (maybe using .status_code)
This beautiful soup find function might not work for all websites.
Please help.

I'm getting an error in line 18,
Couldn't find a tree builder with the features you requested: html5lib. Do you need to install a parser library?
can you help me out??

Try this command in terminal: pip install html5ib

@uddeshyy You better make use of cookies in the response . You can use status codes but Status codes are completely dependent on how the website responds. If the website giving 200 response code for both valid and invalid login then you can’t use. If Incase giving 400 for invalid and 200 for valid then there is change to use it as a key for success login.

@uminostech1089 you need to send the request the same way, the browser sending to the server. Use fidler or any http network debugging tools to read how the website is sending the requests to the server