Skip to content

Instantly share code, notes, and snippets.

@AnderRV

AnderRV/headless_firefox.py Secret

Created August 20, 2021 10:20
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save AnderRV/deb0b6231eed6cc8133159bf841ef4f0 to your computer and use it in GitHub Desktop.
Save AnderRV/deb0b6231eed6cc8133159bf841ef4f0 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
headless_firefox.py
from playwright.sync_api import sync_playwright
def get_html(url, headers=None, proxy=None, timeout=10000):
html = ''
with sync_playwright() as p:
browser_type = p.firefox
browser = browser_type.launch(proxy=proxy)
page = browser.new_page()
page.set_extra_http_headers(headers)
page.goto(url)
page.wait_for_timeout(timeout)
html = page.content()
browser.close()
return html
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment