Skip to content

Instantly share code, notes, and snippets.

@aquasmit
Created April 6, 2016 16:30
Show Gist options
  • Save aquasmit/9ec96169290424e97dca718ff8542940 to your computer and use it in GitHub Desktop.
Save aquasmit/9ec96169290424e97dca718ff8542940 to your computer and use it in GitHub Desktop.
Yelp Reviews scraping using X-Ray (Node js)
var Xray = require('x-ray');
var x = Xray();
x('https://www.yelp.com/biz/bottega-louie-los-angeles', 'ul.ylist li .review--with-sidebar', [{
reviewer: '.user-name .user-display-name',
reviewer_location: '.user-location b',
review_rating: '.rating-very-large meta[content]@content',
review_date: '.rating-qualifier [content]@content',
review_content:'.review-content p'
}])
.paginate('.u-decoration-none.next.pagination-links_anchor@href')
//.limit(2)
.write('results2.json')
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment