Skip to content

Instantly share code, notes, and snippets.

Keybase proof

I hereby claim:

To claim this, I am signing this object:

@ianjw11
ianjw11 / newspaper_scrapy.py
Created December 12, 2016 16:17
Newspaper Scrapy adapter
import scrapy
from newspaper import Article, Config, Source
from newspaper.source import Feed
import logging
class ScrapyArticle(Article):
def download(self, html=None):
"""Downloads the link's HTML content, don't use if you are batch async