Skip to content

Instantly share code, notes, and snippets.

@xxbinxx
Created April 23, 2019 08:01
Show Gist options
  • Save xxbinxx/f921ea9f7c401ddb5540a795766a1538 to your computer and use it in GitHub Desktop.
Save xxbinxx/f921ea9f7c401ddb5540a795766a1538 to your computer and use it in GitHub Desktop.
Scrape proxy data from https://www.sslproxies.org/ with python
import requests
from bs4 import BeautifulSoup
link = "https://www.sslproxies.org/"
response = requests.get(link)
soup = BeautifulSoup(response.text,"lxml")
https_proxies = filter(lambda item: "yes" in item.text,
soup.select("table.table tr"))
for item in https_proxies:
print("{}:{}".format(item.select_one("td").text,
item.select_one("td:nth-of-type(2)").text))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment