zwarag

Using CasperJS to scrape an infinite scroll page

This is a short script to scrape an infinite scroll page and write the resulting HTML to a file

You'll need to install CasperJS; on a Mac that will involve brew install casperjs --devel (if you don't have Homebrew, you can read how to do so here)

To run the script, you can use casperjs scrape.js --ssl-protocol=any from the command line.

zwarag

var casper = require('casper').create({
	verbose : true,
	logLevel : 'info'
});
var images = [];
var fs=require("fs")

/**
 * Configuration here
 */