Skip to content

Instantly share code, notes, and snippets.

View kami4ka's full-sized avatar
🚀
To the Cloud!

Oleg Kulyk kami4ka

🚀
To the Cloud!
View GitHub Profile

Keybase proof

I hereby claim:

  • I am kami4ka on github.
  • I am kami4ka (https://keybase.io/kami4ka) on keybase.
  • I have a public key ASAhRS8-5oxrv8qguejj2f1BAfuzM6wywH60ysF3Mj7Wugo

To claim this, I am signing this object:

@kami4ka
kami4ka / etsy-scraper.js
Last active August 30, 2021 08:21
Scrape Etsy products information using ScrapingAnt web scraping API
/**
* Get data from Etsy search
*
* ScrapingAnt allows you to scrape for free using proxy servers
*
* npm install @scrapingant/scrapingant-client
* npm install cheerio
**/
const ScrapingAntClient = require('@scrapingant/scrapingant-client');
@kami4ka
kami4ka / medium-scraper.js
Created September 13, 2021 08:28
Most popular Medium writers scraper
/**
* Get the most popular Medium writers by tags
*
* ScrapingAnt allows you to scrape for free using proxy servers
*
* npm install @scrapingant/scrapingant-client
* npm install cheerio
**/
const ScrapingAntClient = require('@scrapingant/scrapingant-client');
@kami4ka
kami4ka / detected-immoscout.html
Created September 27, 2021 12:20
Immoscout captcha page sample
<!DOCTYPE html><html><head>
<script type="text/javascript" async="" src="https://www.gstatic.com/recaptcha/releases/tftmXwdbgCvrXiHxr5HGbIaL/recaptcha__de.js" crossorigin="anonymous" integrity="sha384-PT4x0R227mNUgUvxec3X/5F/RwDKEsgBvEzvdset1CNC9n9MFTv2gaqWg5d6b7pc"></script><script>
(function () {
try {
if (typeof sessionStorage !== 'undefined') {
sessionStorage.setItem('distil_referrer', document.referrer);
}
} catch (e) {}
})()
</script>
@kami4ka
kami4ka / doximity-scraper.js
Created November 8, 2021 18:14
Scrape doctors info from Doximity using ScrapingAnt
/**
* Get data from Doximity
*
* ScrapingAnt allows you to scrape for free using proxy servers
* Current setup uses browser-less scraping to save time and API credits
*
* npm install @scrapingant/scrapingant-client
* npm install cheerio
**/
@kami4ka
kami4ka / coinmarketcap-scraper.js
Created November 23, 2021 08:41
Scrape new tokens from CoinMarketCap using ScrapingAnt API
/**
* Get data from new CoinMarketCap token listings
*
* ScrapingAnt allows you to scrape for free using proxy servers
*
* npm install @scrapingant/scrapingant-client
* npm install cheerio
**/
const cheerio = require('cheerio');
@kami4ka
kami4ka / reddit-scraper.js
Created November 23, 2021 17:31
Reddit scraping with ScrapingAnt
/**
* Get data from Reddit
*
* ScrapingAnt allows you to scrape for free using proxy servers
*
* npm install @scrapingant/scrapingant-client
* npm install cheerio
**/
const cheerio = require('cheerio');
@kami4ka
kami4ka / dextools-scraper.js
Created November 23, 2021 21:28
Scrape new tokens from Dextools using ScrapingAnt API
/**
* Get data from new DexTools token listings
*
* ScrapingAnt allows you to scrape for free using proxy servers
*
* npm install @scrapingant/scrapingant-client
* npm install cheerio
**/
const cheerio = require('cheerio');
@kami4ka
kami4ka / dextools-token-price-scraper.js
Created November 24, 2021 20:44
Scrape Dextools token price using ScrapingAnt API
/**
* Get data from MCC DexTools token listing
*
* ScrapingAnt allows you to scrape for free using proxy servers
*
* npm install @scrapingant/scrapingant-client
* npm install cheerio
**/
const cheerio = require('cheerio');
@kami4ka
kami4ka / amazon_batch_scraper.js
Created December 15, 2021 21:53
Scrape Amazon products by a keyword from a file using ScrapingAnt web scraping API
/**
* Amazon Batch Scraper - create file with a list of keywords and all products would be scraped in one CSV file
*
* Installation instructions:
* npm install "@scrapingant/amazon-proxy-scraper"
* npm install json2csv
*
*/
const ProductsScraper = require("@scrapingant/amazon-proxy-scraper");