Skip to content

Instantly share code, notes, and snippets.

@nramirezuy
Created August 21, 2014 17:32
Show Gist options
  • Save nramirezuy/e25524e9f84e3e8875bd to your computer and use it in GitHub Desktop.
Save nramirezuy/e25524e9f84e3e8875bd to your computer and use it in GitHub Desktop.
from scrapy.spider import Spider
from scrapy.http import Request
class StateSpider(Spider):
name = 'state'
def start_requests(self):
print 'State:', getattr(self, 'state', None)
yield Request('http://example.com')
def parse(self, response):
self.state['items_count'] = self.state.get('items_count', 0) + 1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment