Skip to content

Instantly share code, notes, and snippets.

View shashank-sharma's full-sized avatar
:shipit:
Tap Tap Tap ?

Shashank Sharma shashank-sharma

:shipit:
Tap Tap Tap ?
View GitHub Profile
print("Testing Gist")
@shashank-sharma
shashank-sharma / job_spider.py
Created November 23, 2021 09:16
Linkedin job scraper using Scrapy
# Small script to scrape job data using linkedin API
# NOTE: It doesn't check for duplicates, it can be improved here or can be cleaned up
# later on by using job_id (unique)
from urllib.parse import urlencode
from scrapy.http import HtmlResponse
import dateutil.relativedelta
import datetime
import scrapy