Skip to content

Instantly share code, notes, and snippets.

@dannguyen
Created April 14, 2019 17:14
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save dannguyen/326aec831c4c516fdb1b21393f6f03d4 to your computer and use it in GitHub Desktop.
Save dannguyen/326aec831c4c516fdb1b21393f6f03d4 to your computer and use it in GitHub Desktop.
Compiling all the Medicare payment data

Bulk Census data work

2016 geo summary level code list:

https://factfinder.census.gov/help/en/summary_level_code_list.htm

Landing page for ACS5-2016 Summary File

https://www2.census.gov/programs-surveys/acs/summary_file/2016/data/

https://www2.census.gov/programs-surveys/acs/summary_file/2016/data/2016_5yr_Summary_FileTemplates.zip

Code lists https://www.census.gov/programs-surveys/acs/technical-documentation/code-lists.2016.html

https://www2.census.gov/programs-surveys/acs/tech_docs/code_lists/2016_ACS_Code_Lists.pdf

https://www2.census.gov/programs-surveys/acs/tech_docs/subject_definitions/2016_ACSSubjectDefinitions.pdf

Data files

geo files: https://www2.census.gov/programs-surveys/acs/summary_file/2016/data/5_year_entire_sf/2016_ACS_Geography_Files.zip

mkdir -p datastash/zips

curl -o datastash/zips/2016_5yr_Summary_FileTemplates.zip \
     -A 'Just curl' \
     https://www2.census.gov/programs-surveys/acs/summary_file/2016/data/2016_5yr_Summary_FileTemplates.zip

curl -o datastash/zips/2016_ACS_Geography_Files.zip \
     -A 'Just curling' \
    https://www2.census.gov/programs-surveys/acs/summary_file/2016/data/5_year_entire_sf/2016_ACS_Geography_Files.zip


curl -o datastash/zips/large_geounits.tar.gz \
     -A 'Just curling' \
      https://www2.census.gov/programs-surveys/acs/summary_file/2016/data/5_year_entire_sf/All_Geographies_Not_Tracts_Block_Groups.tar.gz

curl -o datastash/zips/small_geounits.tar.gz \
     -A 'Just curling' \
      https://www2.census.gov/programs-surveys/acs/summary_file/2016/data/5_year_entire_sf/Tracts_Block_Groups_Only.tar.gz
mkdir -p datastash/originals/large

tar xvf datastash/zips/large_geounits.tar.gz \
  --strip 6 --directory datastash/originals/large

mkdir -p datastash/originals/small
tar xvf datastash/zips/small_geounits.tar.gz \
  --strip 6 --directory datastash/originals/small


mkdir -p datastash/originals/summary_templates
unzip -j -d datastash/originals/summary_templates \
    datastash/zips/2016_5yr_Summary_FileTemplates.zip

mkdir -p datastash/originals/geo
unzip -jd datastash/originals/geo \
  datastash/zips/2016_ACS_Geography_Files.zip

The small_geounits contains tracts and block groups per state:

https://www.census.gov/geo/maps-data/data/tallies/tractblock.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment