Created
September 4, 2015 03:04
-
-
Save razaulhaq/63f73d379af25192baa4 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
015-09-03 19:43:39 [scrapy] INFO: Scrapy 1.0.3 started (bot: wiki) | |
015-09-03 19:43:39 [scrapy] INFO: Optional features available: ssl, http11 | |
015-09-03 19:43:39 [scrapy] INFO: Overridden settings: {'NEWSPIDER_MODULE': 'wi | |
i.spiders', 'SPIDER_MODULES': ['wiki.spiders'], 'DEPTH_LIMIT': 1, 'DOWNLOAD_DEL | |
Y': 3, 'BOT_NAME': 'wiki'} | |
015-09-03 19:43:40 [scrapy] INFO: Enabled extensions: CloseSpider, TelnetConsol | |
, LogStats, CoreStats, SpiderState | |
015-09-03 19:43:41 [scrapy] INFO: Enabled downloader middlewares: HttpAuthMiddl | |
ware, DownloadTimeoutMiddleware, UserAgentMiddleware, RetryMiddleware, DefaultH | |
adersMiddleware, MetaRefreshMiddleware, HttpCompressionMiddleware, RedirectMidd | |
eware, CookiesMiddleware, ChunkedTransferMiddleware, DownloaderStats | |
015-09-03 19:43:41 [scrapy] INFO: Enabled spider middlewares: HttpErrorMiddlewa | |
e, OffsiteMiddleware, RefererMiddleware, UrlLengthMiddleware, DepthMiddleware | |
015-09-03 19:43:41 [scrapy] INFO: Enabled item pipelines: | |
015-09-03 19:43:41 [scrapy] INFO: Spider opened | |
015-09-03 19:43:41 [scrapy] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 i | |
ems (at 0 items/min) | |
015-09-03 19:43:41 [scrapy] DEBUG: Telnet console listening on 127.0.0.1:6023 | |
015-09-03 19:43:45 [scrapy] DEBUG: Crawled (200) <GET https://en.wikipedia.org/ | |
iki/Mathematics> (referer: None) | |
] | |
015-09-03 19:43:45 [scrapy] INFO: Closing spider (finished) | |
015-09-03 19:43:45 [scrapy] INFO: Dumping Scrapy stats: | |
'downloader/request_bytes': 230, | |
'downloader/request_count': 1, | |
'downloader/request_method_count/GET': 1, | |
'downloader/response_bytes': 59999, | |
'downloader/response_count': 1, | |
'downloader/response_status_count/200': 1, | |
'finish_reason': 'finished', | |
'finish_time': datetime.datetime(2015, 9, 4, 2, 43, 45, 642000), | |
'log_count/DEBUG': 2, | |
'log_count/INFO': 7, | |
'response_received_count': 1, | |
'scheduler/dequeued': 1, | |
'scheduler/dequeued/memory': 1, | |
'scheduler/enqueued': 1, | |
'scheduler/enqueued/memory': 1, | |
'start_time': datetime.datetime(2015, 9, 4, 2, 43, 41, 765000)} | |
015-09-03 19:43:45 [scrapy] INFO: Spider closed (finished) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment