wvengen

"""
Download handler for HTTP/2 supporting proxy CONNECT over HTTP/1.

You can use this by configuring it in the spider settings:

    DOWNLOAD_HANDLERS = {
        'https': 'scrapy_h2_proxy.H2DownloadHandler',
    }

Tested with Scrapy 2.5.0.

wvengen

#!/usr/bin/env ruby
#
# Example of parsing a remote XML stream.
#
# Fetches data from an HTTP endpoint, and processes it bit by bit, without
# loading the whole file into memory.
#
# This example shows recent articles from the W3C blog feed.
#
require 'nokogiri'