Skip to content

Instantly share code, notes, and snippets.

@chris-lovejoy

chris-lovejoy/job_scraper.py

Last active October 5, 2020 16:15
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 1 You must be signed in to fork a gist
  • Save chris-lovejoy/4961710f8244d309b0bc5d6319f1a82c to your computer and use it in GitHub Desktop.
Save chris-lovejoy/4961710f8244d309b0bc5d6319f1a82c to your computer and use it in GitHub Desktop.
Download ZIP
loading job soup
Raw
job_scraper.py
def load_indeed_jobs_div(job_title, location):
getVars = {'q' : job_title, 'l' : location, 'fromage' : 'last', 'sort' : 'date'}
url = ('https://www.indeed.co.uk/jobs?' + urllib.parse.urlencode(getVars))
page = requests.get(url)
soup = BeautifulSoup(page.content, "html.parser")
job_soup = soup.find(id="resultsCol")
return job_soup
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment