Skip to content

Instantly share code, notes, and snippets.

What would you like to do?
const puppeteer = require('puppeteer');
// starting Puppeteer
puppeteer.launch().then(async browser => {
// opening a new page and navigating to Reddit
const page = await browser.newPage();
await page.goto('');
await page.waitForSelector('body');
// manipulating the page's content
let grabPosts = await page.evaluate(() => {
let allPosts = document.body.querySelectorAll('.Post');
//storing the post items in an array then selecting for retrieving content
scrapeItems = [];
allPosts.forEach(item => {
let postTitle = item.querySelector('h3');
let postDescription = item.querySelector('p');
postTitle: postTitle ? postTitle.innerText : null,
postDescription: postDescription ? postDescription.innerText : null,
let items = {
"redditPosts": scrapeItems,
return items;
// outputting the scraped data
// closing the browser
await browser.close();
}).catch(function (err) {
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.