Skip to content

Instantly share code, notes, and snippets.

@vinaymavi
Last active October 8, 2018 10:28
Show Gist options
  • Save vinaymavi/292e6cf07f272813e4a0afe8c14463c4 to your computer and use it in GitHub Desktop.
Save vinaymavi/292e6cf07f272813e4a0afe8c14463c4 to your computer and use it in GitHub Desktop.
Google Cloud function gitst
const functions = require("firebase-functions");
const puppeteer = require("puppeteer");
const Crawler = require("./crawler");
const Firestore = require("./firebasestore");
const constraint = require("./crawler/constraint");
const COLLECTION_NAME = 'rows1';
const rowsCol = new Firestore(COLLECTION_NAME);
// Error = "Possible EventEmitter memory leak detected. 11 SIGINT listeners added" solutions
process.setMaxListeners(Infinity);
exports.betaRowListener = functions.firestore
.document(`${COLLECTION_NAME}/{userId}`)
.onCreate(async (snap, context) => {
const browser = await puppeteer.launch({ args: ["--no-sandbox"] });
const page = await browser.newPage();
const data = snap.data();
const crawler = new Crawler(data.stage, page, data.url, 2);
if (!crawler.stage) {
console.log(data);
return 0;
}
});
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment