neilhawkins
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <!DOCTYPE html> | |
| <html lang='en'> | |
| <head> | |
| <meta charset='utf-8'> | |
| <title>dc.js Experiment</title> | |
| <script src='bower_components/d3/d3.js' type='text/javascript'></script> | |
| <script src='bower_components/crossfilter/crossfilter.js' type='text/javascript'></script> | |
| <script src='dc.js' type='text/javascript'></script> |
neilhawkins
/ proms_scraper.py
Created
January 15, 2014 17:02
Scraper collecting all pieces performed at proms from BBC archive
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import scraperwiki, urllib2, re, time | |
| import lxml.html | |
| from pprint import pprint | |
| decades = [x*10 for x in range(189,202)] | |
| for decade in decades: | |
| years = [decade+y for y in range(10)] | |
| for year in years: | |
| url = 'http://www.bbc.co.uk/proms/archive/search/'+str(decade)+'s/'+str(year) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| name | color | entity | |
|---|---|---|---|
| Conservative Party | #0087DC | party | |
| Labour Party | #DC241f | party | |
| Liberal Democrats | #FDBB30 | party | |
| UKIP | #70147A | party | |
| Unite | #aabbcc | donor | |
| Joan Edwards* | #aabbcc | donor | |
| GMB | #aabbcc | donor | |
| UNISON | #aabbcc | donor | |
| USDAW | #aabbcc | donor |
NewerOlder