Skip to content

Instantly share code, notes, and snippets.

@salman0ansari

salman0ansari/Imdb250.py

Created August 12, 2020 16:33
Show Gist options
  • Save salman0ansari/9eafb6775ea438a872981d6ecfd53071 to your computer and use it in GitHub Desktop.
Save salman0ansari/9eafb6775ea438a872981d6ecfd53071 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
Imdb250.py
from bs4 import BeautifulSoup
import requests
url = ["https://www.imdb.com/search/title/?groups=top_250&sort=user_rating,desc&view=simple",'https://www.imdb.com/search/title/?groups=top_250&view=simple&sort=user_rating,desc&start=51&ref_=adv_nxt','https://www.imdb.com/search/title/?groups=top_250&view=simple&sort=user_rating,desc&start=101&ref_=adv_nxt','https://www.imdb.com/search/title/?groups=top_250&view=simple&sort=user_rating,desc&start=151&ref_=adv_nxt','https://www.imdb.com/search/title/?groups=top_250&view=simple&sort=user_rating,desc&start=201&ref_=adv_nxt']
for urls in url:
source = requests.get(urls).text
soup = BeautifulSoup(source, 'lxml')
for get_list in soup.find_all('div', class_='lister-item mode-simple'):
col_title = get_list.find('div', class_='col-title')
title = col_title.find("a")
print(title.text)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment