Skip to content

Instantly share code, notes, and snippets.

Avatar

Waldo Jaquith waldoj

View GitHub Profile
View keybase.md

Keybase proof

I hereby claim:

  • I am waldoj on github.
  • I am waldo (https://keybase.io/waldo) on keybase.
  • I have a public key whose fingerprint is 8CC4 1FF2 95C7 5E3B D30A 2CF2 E148 6A8B FA29 F947

To claim this, I am signing this object:

@waldoj
waldoj / virginia-servers.csv
Created Apr 11, 2014
The HTTP-header-reported server for every subdomain of virginia.gov, every agency website, and every college/university website. Where no "Server" header exists, the string "Unknown" is used.
View virginia-servers.csv
http://abc.virginia.gov Apache
http://agencies.virginia.gov/ Microsoft-HTTPAPI/2.0
http://apa.virginia.gov/ Unknown
http://boa.virginia.gov/ Microsoft-IIS/6.0
http://bos.virginia.gov/ Microsoft-IIS/7.5
http://chr.vipnet.org/ Unknown
http://commonhelp.virginia.gov/ Unknown
http://commonwealth.virginia.gov/ Unknown
http://www.dbhds.virginia.gov/ Microsoft-IIS/5.0
http://dcjs.virginia.gov/ Microsoft-IIS/7.5
@waldoj
waldoj / rates.json
Created Jun 18, 2014
An imagined JSON response from a utility's API, specifying the rate per kWh for power now and over the next 24 hours. This provision of data would allow households to automatically adjust energy use in response to demand-based pricing.
View rates.json
[
{
"provider": "Dominion",
"url": "http://www.dom.com/",
"api_url": "http://api.dom.com/",
"documentation": "http://api.dom.com/docs/",
"state": "Virginia",
"rate": "12.3",
"units": "kWh",
"rate_units": "cents",
View va_scc_lp_address.csv
We can make this file beautiful and searchable if this error is corrected: It looks like row 2 should actually have 6 columns, instead of 5. in line 1.
,street-1,street-2,city,state,zip
Suite 300,11350 Random Hills Road,Fairfax,VA,22030
3625 CORNELL ROAD,,FAIRFAX,VA,22030
3625 CORNELL ROAD,,FAIRFAX,VA,22030
1330 Mercer Lane,,McLean,VA,22101
Suite 225,333 South Glebe Road,Arlington,VA,22204
71 WEST FIRST AVENUE,POST OFFICE BOX 430,ALBERTA,VA,23821
5221 INDIAN RIVER RD,,VIRGINIA BEACH,VA,23464
1045 COFFEE RD,,LYNCHBURG,VA,24503
1919 GABLES LANE,,VIENNA,VA,22182
@waldoj
waldoj / industry_codes.txt
Created Nov 2, 2014
Every possible type of business, according to the Virginia State Corporation Commission.
View industry_codes.txt
GENERAL
ELECTRIC
TELEPHONE
GAS
WATER
WATER-SEWER
SEWER
RADIO COMMON CARRIER
BANKS AND CREDIT UNIONS
FEDERAL BANKS
@waldoj
waldoj / Business Registrations.csv
Created Nov 11, 2014
Every business registered in Charlottesville in 2014.
View Business Registrations.csv
We can make this file beautiful and searchable if this error is corrected: It looks like row 7 should actually have 15 columns, instead of 1. in line 6.
id,name,incorporation_date,street_1,street_2,city,state,zip,agent_name,agent_street_1,agent_street_2,agent_city,agent_state,agent_zip,agent_status
0773356,"WHITE SPOT INCORPORATED",2014-01-14,"1407 UNIVERSITY AVENUE",,CHARLOTTESVILLE,VA,22903,"DIMITRIOS WHITE SP TAVAMPIS","1407 UNIVERSITY AVENUE",,CHARLOTTESVILLE,VA,22903,DIRECTOR
F197333,"Mission Secure, Inc.",2014-08-29,"250 W MAIN ST STE 300",,CHARLOTTESVILLE,VA,22902,"DANIEL PARK","941 GLENWOOD STATION LANE","SUITE 302",ARLINGTON,VA,22901,OFFICER
F195959,"EXPEDITION TRUST COMPANY",2014-04-14,"310 4TH ST NE STE 102",,CHARLOTTESVILLE,VA,22902,"JACOB A LUTZ III","1001 HAXALL POINT 15TH FL","PO BOX 1122",RICHMOND,VA,23219,ATTORNEY
0780498,"NJW Properties, Inc.",2014-07-23,"120 BOLLINGWOOD ROAD",,CHARLOTTESVILLE,VA,22903,"NORMAN JEFFREY WOOLWORTH","120 BOLLINGWOOD ROAD",,CHARLOTTESVILLE,VA,22903,DIRECTOR
0774667,"Nitor, Inc.",2014-02-18,"1111 LOCUST AVENUE",,CHARLOTTESVILLE,VA,22901,"CRAIG W. MOORE","1111 LOCUST AVENUE",,CHARLOTTESVILLE,VA,22901,DIRECTOR
S4850
@waldoj
waldoj / elasticsearch.sh
Last active Aug 29, 2015
A demonstration of the Elasticsearch query that yields the error "Failed to find geo_shape field [location]]." This is a search of a collection of documents—each of which contain a pair of coordinates—against a pre-indexed collection of shapes. For simplicity's sake, I've included just one shape and just one document. This is with Elasticsearch …
View elasticsearch.sh
# Remove old data
curl -XDELETE "http://localhost:9200/shapes"
curl -XDELETE "http://localhost:9200/businesses"
# Create shapes index, with mapping
curl -XPOST "http://localhost:9200/shapes/" -d '
{
"shapes" : {
"mappings" : {
"municipalities" : {
@waldoj
waldoj / scc_data.txt
Last active Aug 29, 2015
A random sample of the Virginia State Corporation Commission's corporate registration bulk data
View scc_data.txt
020369964COLONIAL POINT CIVIC LEAGUE, INC. 00200903200000000019910117VA001420 FLINTFIELD CRESCENT CHESAPEAKE VA23321000000000000CLARINE B. ROBERTS 1420 Flintfield Crescent Chesapeake VA233210000199101171236N00000000000 0 0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
020712928BARGER INC 10201101030000000020090819VA00 00000000000000000BARBARA J IFKO
@waldoj
waldoj / categories.csv
Last active Aug 29, 2015
Every Virginia State Corporation Commission industry category, with the number of businesses that self-report as a member of that industry.
View categories.csv
Industry # of Businesses
Agricultural Cooperatives 137
Animal and Children's Welfare 66
Architects 563
Arts and Sciences 23
Audiologist 4
Bank & Insurance Agent 73
Banks and Credit Unions 474
Bank w/Limited Certificate 32
Benefit Corporations 48
@waldoj
waldoj / va_subdomains.csv
Created Apr 3, 2015
Every subdomain of Virginia.gov, as of April 3, 2015, as FOIAed from the Virginia Information Technology Agency (VITA).
View va_subdomains.csv
name type value
1920160443.gosappsa CNAME domains.live.com
23bn-vdf CNAME 23bn-vdf.vhost.vipnet.org
23bn.vdf CNAME 23bn-vdf.vhost.vipnet.org
abcweb.abc CNAME gin.abc.virginia.gov
admanage-t.dmv CNAME dmv-pwr01-t.dmv.virginia.gov
admanage.dmv CNAME dmv-pwr01-p.dmv.virginia.gov
adms.vdot CNAME www27.vdot.virginia.gov
applyonline.abc CNAME gin.abc.virginia.gov
autodiscover.house CNAME autodiscover.outlook.com