Skip to content

Instantly share code, notes, and snippets.

What would you like to do?
Scrapy + Splash example
import scrapy
# this example needs the scrapyjs package: pip install scrapyjs
# it also needs a splash instance running in your env or on Scrapy Cloud (
class SplashSpider(scrapy.Spider):
name = 'splash-spider'
download_delay = 3
def start_requests(self):
yield scrapy.Request(
'', self.parse,
'splash': {
'endpoint': 'render.html',
def parse(self, response):
print response.body
for quote in response.css('.quote'):
yield {
'text': quote.css('span::text').extract_first(),
'author': quote.css('small::text').extract_first(),
'tags': quote.css('.tags a::text').extract(),
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.