Navigation Menu

Skip to content

Instantly share code, notes, and snippets.

View k0mmsussert0d's full-sized avatar

Maksymilian Babarowski k0mmsussert0d

View GitHub Profile
* amazonaws.com * allow
* cloudflare.net * allow
* cloudfront.net * allow
* google.com * allow
* google.com frame allow
* googleapis.com * allow
* googlevideo.com * allow
* gstatic.com * allow
* youtube.com * allow
* youtube.com frame allow
@k0mmsussert0d
k0mmsussert0d / scrapugaya.py
Created September 4, 2019 21:52
Scraping suru product IDs
"""
This script will print the IDs of all the products returned by a given search query.
Substitue url (line 17) string with any jewgaya query. The script will stop after reaching the last page.
The URL must be properly encoded according to RFC 3986.
"""
from bs4 import BeautifulSoup
import requests