Skip to content

Instantly share code, notes, and snippets.

@harryWonder
Created August 5, 2020 08:01
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save harryWonder/b08407fbf74ef7f3f1f06e28a7c054dc to your computer and use it in GitHub Desktop.
Save harryWonder/b08407fbf74ef7f3f1f06e28a7c054dc to your computer and use it in GitHub Desktop.
Learning Dollars Web Scraping Example
{
"name": "webscarping-with-node-js",
"version": "1.0.0",
"description": "A webscraper built with Nodejs, cheerio, request promise and nightwatchjs",
"main": "index.js",
"scripts": {
"test": "echo \"Error: no test specified\" && exit 1",
"scrapeBasic": "node index.js scrapeBasic",
"scrapeWithHeaders": "node index.js scrapeWithHeaders",
"toJson": "node index.js toJson",
"toPng": "node index.js toPng",
"login": "node index.js login",
"help": "node index.js --help"
},
"keywords": [
"Web",
"scraping",
"scrapper"
],
"author": "Ilori Stephen A",
"license": "ISC",
"dependencies": {
"cheerio": "^1.0.0-rc.3",
"nightwatch": "^1.3.7",
"puppeteer": "^5.2.1",
"request": "^2.88.2",
"request-promise": "^4.2.6",
"yargs": "^15.4.1"
},
"devDependencies": {
"chromedriver": "^84.0.1"
}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment