Skip to content

Instantly share code, notes, and snippets.

View PhillyCDO's full-sized avatar

Philadelphia Chief Data Officer PhillyCDO

View GitHub Profile
PhillyCDO / import-locations.sql
Last active December 24, 2015 08:09
Import flu shot locations into an MySQL instance.
USE flushots;
CREATE TABLE locations(
facility_name VARCHAR(80),
facility_id CHAR(10),

See government announcement [here] (




WHEREAS, this Administration is committed to timely and consistent publication of data consistent with the Indiana Access to Public Records Act (APRA) which is essential to open and effective government; and

PhillyCDO / index.js
Created September 14, 2013 13:21 — forked from max-mapper/index.js
// data comes from here
// download 1994.csv.bz2 and unpack by running: cat 1994.csv.bz2 | bzip2 -d > 1994.csv
// 1994.csv should be ~5.2 million lines and 500MB
// importing all rows into leveldb took ~50 seconds on my machine
// there are two main techniques at work here:
// 1: never create JS objects, leave the data as binary the entire time (binary-split does this)
// 2: group lines into 16 MB batches, to take advantage of leveldbs batch API (byte-stream does this)
var level = require('level')
PhillyCDO /
Created August 19, 2013 14:46
Postmortem of Crime Data Service Outage


On Monday, August 5th, 2013, we were notified via Twitter of some suspected issues with our crime incident data service. Upon investigating, we learned that updates to the crime data service and the static download file that accompanies it had not processed correctly over the previous weekend and were continuing to fail at regular update intervals.

Over the following week and 1/2, staff in the Office of Innovation and Technology (OIT) and the Philadelphia Police Department (PPD) worked to identify the cause of the failure and to correct it, to ensure that data consumers could use this data in third-party applications and tools.


As of the morning of August 15th, all issues seem to have been resolved and updates to the data service appear to be working normally.

"d": {
"results": [
"__metadata": {
"uri": "",
"type": "PlanPhillyModel.violationdetails"
"violation_details_id": 2654784,
"violation_code": "CP-700",
PhillyCDO / sample.json
Created March 16, 2013 18:10
Sample fromn L&I API
"attributes": {
"APNO": "348398",
"ADDRKEY": 593867,
"TYPE": "3123",
PhillyCDO /
Last active December 11, 2015 21:59
Proposal for developing a myPhillyRising mobile application for the City of Philadelphia.

##What are we trying to do?

The City of Philadelphia (specifically, the Managing Director’s Office) is looking to engage with a local developer, entrepreneur or software firm to build a mobile application we're calling myPhillyRising.

The purpose of this application is to complement the work being done by the PhillyRising Collaborative in specific neighborhoods in the City of Philadelphia. It is meant to be offered for free use by residents in neighborhoods that are the focus of PhillyRising activities.

##Why are we trying to do this?

PhillyRising, an initiative of the City's Managing Director's office, is built on the idea of collaboration – government collaborating with citizens and community leaders to improve the quality of life in city neighborhoods. PhillyRising targets neighborhoods throughout Philadelphia that are plagued by chronic crime and quality of life concerns, and establishes partnerships with community members to help address these issues.

PhillyCDO /
Created December 11, 2012 19:35
Open Data Working Group - description of activities & responsibilities

Philadelphia Open Data Working Group

Executive Order 1-12, Section 1A, establishes an Open Data Working Group (ODWG) “to focus on transparency, accountability, participation, and collaboration within City government.”

The ODWG will “provide a forum to develop innovative ideas for promoting open government goals, including collaborations with researchers, the private sector, and the public, and for developing resolutions to issues raised through the public feedback mechanisms of the Open Government Portal.”

Among the primary objectives of this group will be the identification of data sets collected and maintained by units of government in Philadelphia to be released to outside consumers, and the development of a standard process for agencies to use in releasing such data.


PhillyCDO /
Created October 5, 2012 14:12
PhillyRising Application IDeas

#Ideas for PhillyRising Applications

A citizen engagement application (or set of applications) that connects people to the City, empowers them to get involved in their community through volunteering and attending City related events including PhillyRising events and meetings, rewards their efforts through technology and socializes their experience.

Applications should be a mobile (web or native) designed to engage citizens in efforts to improve their City. These apps would serve as resources / tools for locating facilities, learning about events occurring throughout the city, encourage participation in civic events, and connect neighbors. The engagement aspect of these applications is critical – they should link neighbors to other neighbors, and also to individuals from outside the community who are interested in engaging across the city.

The first step for any application is to map city facilities and resources, and then use the phone’s GPS to determine which are nearest to the user’s current location. P

PhillyCDO /
Created September 4, 2012 17:08
Open Data Executive Order for the City of Philadelphia


WHEREAS, the City of Philadelphia is committed to creating a high level of openness and transparency in government; and

WHEREAS, the three principles of transparency, participation, and collaboration form the cornerstone of an open government; and

WHEREAS, the City’s participation as a founding and vital partner in the open data consortium has provided a model for transparency on which the City should continue to build; and

WHEREAS, more City data sets should be published and made available via an Open Data Portal which will provide access to information and a mechanism for public feedback and participation; and