Skip to content

Instantly share code, notes, and snippets.

@dvdbng
dvdbng / scrapy_spider.py
Created April 20, 2016 07:53
Use scrapy and splash in the same process
import scrapy
from scrapy.crawler import CrawlerRunner
from scrapy.settings import Settings
from scrapy.http import TextResponse
from twisted.internet import defer
from splash.browser_tab import BrowserTab
from splash.render_options import RenderOptions
from splash import defaults
import random
@mickaelandrieu
mickaelandrieu / webservice.js
Created October 11, 2013 20:45
Use casperJs as a Webservice
/* from http://stackoverflow.com/questions/15852987/casperjs-passing-data-back-to-php/16489950#16489950
//define ip and port to web service
var ip_server = '127.0.0.1:8585';
//includes web server modules
var server = require('webserver').create();
//start web server
var service = server.listen(ip_server, function(request, response) {