Skip to content

Instantly share code, notes, and snippets.

@njordr
Last active October 8, 2015 12:39
Show Gist options
  • Save njordr/68014f23d0fb625b79dd to your computer and use it in GitHub Desktop.
Save njordr/68014f23d0fb625b79dd to your computer and use it in GitHub Desktop.
# -*- coding: utf-8 -*-
import scrapy
class TestsplashSpider(scrapy.Spider):
name = "testsplash"
allowed_domains = ["google.it"]
start_urls = (
'http://www.google.it/',
)
def start_requests(self):
for url in self.start_urls:
yield scrapy.Request(url, self.parse, meta={
'splash': {
'endpoint': 'render.html',
'args': {'wait': 0.5}
}
})
def parse(self, response):
pass
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment