Skip to content

Instantly share code, notes, and snippets.

View wenting-zhao's full-sized avatar

Wenting Zhao wenting-zhao

View GitHub Profile
@wenting-zhao
wenting-zhao / gist:e3ac88519dd09d2f0183b90c9c8778a4
Created August 2, 2016 04:20 — forked from pawelmhm/gist:8917867
Scrapy spider crawling Stack Overflow
from scrapy.spider import Spider
from scrapy.contrib.spiders import CrawlSpider, Rule
from scrapy.contrib.linkextractors.sgml import SgmlLinkExtractor
from scrapy.selector import Selector
from scrapy.item import Item, Field
import urllib
class Question(Item):
tags = Field()
answers = Field()