Skip to content

Instantly share code, notes, and snippets.

@evz
Created September 25, 2015 16:30
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save evz/b45ca99144a4a0deb6d2 to your computer and use it in GitHub Desktop.
Save evz/b45ca99144a4a0deb6d2 to your computer and use it in GitHub Desktop.
Another nyc scraper error: ```00:09:55 INFO scrapelib: GET - http://legistar.council.nyc.gov/LegislationDetail.aspx?ID=2460504&GUID=0BE0D55D-995F-4256-B64E-35DD926ACB68
nyc (scrape, import, report)
people: {}
bills: {}
events: {}
Not checking sessions...
http://legistar.council.nyc.gov/DepartmentDetail.aspx?ID=6897&GUID=CDC6E691-8A8C-4F25-97CB-86F31EDAB081
2002-11-05 2013-12-31
2003-03-12 2003-12-31
1998-01-01 2001-12-31
2014-01-01
1998-01-01 2001-12-31
2002-01-01 2013-12-31
2002-01-01 2009-12-31
2014-01-01
2002-01-01 2013-12-31
2002-01-01 2009-01-02
2006-01-01
2002-01-01 2004-12-31
1998-01-01 2001-12-31
2002-01-01 2009-12-31
2002-01-01 2009-12-31
2009-01-01
1998-01-01 2001-12-31
2002-01-01 2013-12-31
1998-01-01 2001-12-31
2014-01-01
2006-01-01
1998-01-01 2001-12-31
2014-01-01
2014-01-01
1998-01-01 2001-12-31
2010-01-01 2013-12-31
2006-01-01
2013-12-06
2001-11-09 2013-12-31
1998-01-01 2001-12-31
2005-02-16
2002-01-01 2009-07-14
1998-01-01 2001-12-31
2002-01-01 2009-12-31
1998-01-01 2001-12-31
2002-01-01 2013-12-31
2006-01-01
2010-01-01
2002-01-01 2009-12-31
2002-01-01 2013-12-31
2012-12-18
2009-11-24
1998-01-01 2001-12-31
2002-01-01 2013-12-31
2002-01-01 2012-07-26
2014-01-01
1998-01-01 2001-12-31
2014-01-01
2002-01-01 2009-12-31
1998-01-01 2001-12-31
1998-01-01 2002-12-31
2010-01-01
1998-01-01 2001-12-31
1998-01-01 2001-12-31
2010-01-01
2004-01-01
1998-01-01 2001-12-31
1998-01-01 2005-12-31
1998-01-01 2002-08-29
2009-03-24
2013-03-05
1998-01-01 2001-12-31
2002-01-01 2005-12-31
2006-01-01 2013-12-31
1998-01-01 2001-12-31
1998-01-01 2001-12-31
1998-01-01 2001-12-31
1998-01-01 2005-12-31
2002-01-01 2008-12-31
2002-01-01 2010-01-31
2002-01-01 2012-12-31
2014-01-01
2006-01-01
1998-01-01 2001-12-31
2010-01-01
1992-01-01 2001-12-31
2002-01-01 2013-12-31
2002-01-01 2007-01-02
1998-01-01 2005-12-31
1992-11-01 2001-12-31
2003-03-26
2002-01-01 2009-12-31
2002-01-01 2003-07-23
1998-01-01 2001-10-13
1998-01-01 2001-12-31
1998-01-01 2001-12-31
1998-01-01 2001-12-31
2009-03-24 2009-12-31
2014-01-01
2002-01-01 2013-12-31
1998-01-01 2001-12-31
2014-01-01
2014-01-01
2010-01-01
1998-01-01 2001-12-31
2010-01-01
1975-03-01 2001-12-01
2002-01-01 2013-12-31
2002-01-01 2009-12-31
1992-01-01 2001-12-31
2010-04-07
1998-01-01 2005-12-31
2014-01-01
2010-01-01 2015-06-14
2002-01-01 2008-04-18
2014-01-01
1998-01-01 2001-12-31
2010-01-01
1998-01-01 2001-12-31
1998-01-01 2001-12-31
1999-02-17 2013-12-31
2010-01-01
2014-01-01
2001-02-27 2013-12-31
1998-01-01 2001-12-31
2006-01-01
1998-01-01 2005-12-31
2002-01-01 2013-09-25
2001-11-13 2006-12-31
2002-01-01 2002-12-31
2002-01-01 2005-12-31
2014-01-01
2014-01-01
1998-02-17 2013-12-31
2014-01-01
2010-11-30
2002-01-01 2009-12-31
2006-01-01 2010-08-27
2003-11-19 2013-12-31
2010-01-01
2002-01-01 2013-12-31
1999-11-23 2005-12-31
1998-01-01 2001-12-31
2002-01-01 2013-12-31
2002-01-01 2009-12-31
2009-03-24
1998-01-01 2005-12-31
2010-01-01
2002-01-01 2008-12-31
2002-01-01 2009-12-31
2007-05-09
1998-01-01 2001-12-31
2007-03-08 2015-07-10
2014-01-01
2008-06-16 2008-12-31
1999-02-17 2013-12-31
1998-01-01 2001-12-31
2014-01-01
2014-01-01
Traceback (most recent call last):
File "/home/datamade/.virtualenvs/opencivicdata/bin/pupa", line 9, in <module>
load_entry_point('pupa==0.4.1', 'console_scripts', 'pupa')()
File "/home/datamade/.virtualenvs/opencivicdata/src/pupa/pupa/cli/__main__.py", line 71, in main
subcommands[args.subcommand].handle(args, other)
File "/home/datamade/.virtualenvs/opencivicdata/src/pupa/pupa/cli/commands/update.py", line 242, in handle
report['scrape'] = self.do_scrape(juris, args, scrapers)
File "/home/datamade/.virtualenvs/opencivicdata/src/pupa/pupa/cli/commands/update.py", line 141, in do_scrape
report[scraper_name] = scraper.do_scrape(**scrape_args)
File "/home/datamade/.virtualenvs/opencivicdata/src/pupa/pupa/scrape/base.py", line 101, in do_scrape
for obj in self.scrape(**kwargs) or []:
File "/home/datamade/scrapers-us-municipal/nyc/bills.py", line 66, in scrape
history = list(history)
File "/home/datamade/.virtualenvs/opencivicdata/src/legistar/legistar/bills.py", line 115, in history
key = lambda action : (self.toDate(action['Date']),
File "/home/datamade/.virtualenvs/opencivicdata/src/legistar/legistar/bills.py", line 116, in <lambda>
action['Action\xa0Details']['url']))
TypeError: string indices must be integers
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment