Skip to content

Instantly share code, notes, and snippets.

@nemo
Last active September 11, 2017 06:22
Show Gist options
  • Save nemo/2dd47b59f00aed4faf72fcc49a5dff83 to your computer and use it in GitHub Desktop.
Save nemo/2dd47b59f00aed4faf72fcc49a5dff83 to your computer and use it in GitHub Desktop.
StdLib Distributed Scraper Example
const lib = require('lib');
lib.username.scraper['@local']({
url: 'https://github.com/search?q=scraping&ref=opensearch',
queries: [
[".repo-list-item h3 a", "text"],
[".repo-list-item h3 a", "attr", ["href"]]
]
})
.then(console.log)
.catch(console.error);
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment