Skip to content

Instantly share code, notes, and snippets.

@Galina-Blokh

Galina-Blokh/get_all_recipes.py

Last active January 10, 2021 20:18
Show Gist options
  • Save Galina-Blokh/d17b0ec042591821cb34c0cb1e41e554 to your computer and use it in GitHub Desktop.
Save Galina-Blokh/d17b0ec042591821cb34c0cb1e41e554 to your computer and use it in GitHub Desktop.
Download ZIP
Get all recipe responces at one time
Raw
get_all_recipes.py
from collections import defaultdict
json_file = defaultdict(list)
page = (grequests.get(url) for url in set(recipe_links))
response = grequests.map(page, size=batches)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment