Skip to content

Instantly share code, notes, and snippets.

@dogweather

dogweather/spider-setup.py

Last active March 16, 2019 23:14
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save dogweather/4491790defab53c3f267f49ed7ccfe24 to your computer and use it in GitHub Desktop.
Save dogweather/4491790defab53c3f267f49ed7ccfe24 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
spider-setup.py
def __init__(self):
super().__init__()
# A flag, set after post-processing is finished, to
# avoid an infinite loop.
self.data_submitted = False
# The object to return for conversion to a JSON tree.
# All the parse methods add their results to this
# structure.
self.sports = items.SportsInventory(categories=[])
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment