Skip to content

Instantly share code, notes, and snippets.

@kjaymiller
Last active June 9, 2021 20:40
Show Gist options
  • Save kjaymiller/75a9e14234c9a59e81f98a50e790c585 to your computer and use it in GitHub Desktop.
Save kjaymiller/75a9e14234c9a59e81f98a50e790c585 to your computer and use it in GitHub Desktop.
PyGotham Proposals

Making Government Useable by anyone with Pandas, Python and Eland

Unreadable data can lead to bad perceptions and positive action being delayed. Some of the most obscure data comes from reporting from local, state and federal governments.

That said the data is there and it has be provided in a consistent (at some level) manner.

Here are some of the ways I made Police Call Records, Police Stop and Search Data, and Department of Education Data Understandable.


Outline

  • How did we get here. George Floyd, Black Lives Matters, and a goal to help others.
  • Introduction of Pandas and Dataframes

Police Call Records

  • Problems with Data (Inconsistent values over time)
  • How I solved those problems (try/except statements)
  • What that data looks like when readable
    • Introduction to Eland
    • Look at Dataset

Department of Education Data School Data

  • Problems with Data (vague with definition dictionaries)
  • How I solved those problems (dictionary translation tables)
  • Wad that data looks like when readable

Conclusions


  • Links and Resources

My goal is to empower folks interested in visualizing civics data for their own personal or professional reasons. To also show them how to take that data and make it persistent so they don't have to feel as if they are repeating the process and can make easy adjustments as needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment