Skip to content

Instantly share code, notes, and snippets.

@nramirezuy
Created March 18, 2015 20:42
Show Gist options
  • Save nramirezuy/67820d76430ffe65bb40 to your computer and use it in GitHub Desktop.
Save nramirezuy/67820d76430ffe65bb40 to your computer and use it in GitHub Desktop.
>>> fetch('http://example.com')
2015-03-18 17:41:40-0300 [default] DEBUG: Crawled (200) <GET http://example.com> (referer: None)
[s] Available Scrapy objects:
[s] crawler <scrapy.crawler.Crawler object at 0x18f6910>
[s] item {}
[s] request <GET http://example.com>
[s] response <200 http://example.com>
[s] settings <scrapy.settings.Settings object at 0x18f7f90>
[s] spider <DefaultSpider 'default' at 0x1d98450>
[s] Useful shortcuts:
[s] shelp() Shell help (print this help)
[s] fetch(req_or_url) Fetch request (or URL) and update local objects
[s] view(response) View response in a browser
>>> fetch('http://example.com')
2015-03-18 17:41:45-0300 [default] DEBUG: Crawled (200) <GET http://example.com> (referer: None)
[s] Available Scrapy objects:
[s] crawler <scrapy.crawler.Crawler object at 0x18f6910>
[s] item {}
[s] request <GET http://example.com>
[s] response <200 http://example.com>
[s] settings <scrapy.settings.Settings object at 0x18f7f90>
[s] spider <DefaultSpider 'default' at 0x1d98450>
[s] Useful shortcuts:
[s] shelp() Shell help (print this help)
[s] fetch(req_or_url) Fetch request (or URL) and update local objects
[s] view(response) View response in a browser
>>> fetch('http://example.com')
2015-03-18 17:41:46-0300 [default] DEBUG: Crawled (200) <GET http://example.com> (referer: None)
[s] Available Scrapy objects:
[s] crawler <scrapy.crawler.Crawler object at 0x18f6910>
[s] item {}
[s] request <GET http://example.com>
[s] response <200 http://example.com>
[s] settings <scrapy.settings.Settings object at 0x18f7f90>
[s] spider <DefaultSpider 'default' at 0x1d98450>
[s] Useful shortcuts:
[s] shelp() Shell help (print this help)
[s] fetch(req_or_url) Fetch request (or URL) and update local objects
[s] view(response) View response in a browser
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment