run95.log

Started Fri Jun 17 11:36:36 2016
Current Commit :  0da6fbdbefa23605305c1e124893b49e95277f01
Current Scenario :  0
Running step 'ual_initialize_residential_units'
Filling column building_type_id with value 1 (0 values)
Filling column residential_units with value 0 (0 values)
Filling column year_built with value 1967.0 (0 values)
Filling column non_residential_sqft with value 0 (0 values)
Time to execute step 'ual_initialize_residential_units': 6.24 s
Running step 'ual_match_households_to_units'
Time to execute step 'ual_match_households_to_units': 26.64 s
Running step 'ual_assign_tenure_to_units'
Initial unit tenure assignment: 58% owner occupied, 6% unfilled
Time to execute step 'ual_assign_tenure_to_units': 1.42 s
Total time to execute iteration 1 with iteration value None: 34.30 s
Total time to execute iteration 1 with iteration value None: 0.00 s
Running iteration 1 with iteration value 2010
Running step 'neighborhood_vars'
Computing accessibility variables
Computing retail_sqft_3000
Filling column shape_area with value 602.839834979 (0 values)
Filling column zone_id with value 1178 (0 values)
Computing sum_income_3000
Removed 4409 rows because they contain missing values
Computing residential_units_500
Computing residential_units_1500
Computing office_1500
Computing retail_1500
Computing industrial_1500
Computing ave_sqft_per_unit
Computing ave_lot_size_per_unit
Computing population
Computing poor
Computing renters
Computing sfdu
Computing ave_hhsize
Computing jobs_500
Computing jobs_1500
Computing ave_income_1500
Computing ave_income_500
       retail_sqft_3000  sum_income_3000  residential_units_500  \
count      2.260600e+05     2.260600e+05          226060.000000   
mean       5.057657e+05     7.351806e+08               3.967628   
std        8.053604e+05     9.472440e+08               1.689954   
min        0.000000e+00     0.000000e+00               0.000000   
25%        5.506830e+04     2.430790e+08               3.391803   
50%        2.694317e+05     5.348411e+08               4.418590   
75%        6.332215e+05     8.936937e+08               5.047662   
max        9.867062e+06     9.260525e+09               8.623758   

       residential_units_1500    office_1500    retail_1500  industrial_1500  \
count           226060.000000  226060.000000  226060.000000    226060.000000   
mean                 5.958881       4.506753       3.718851         2.156672   
std                  1.831334       2.482326       2.599811         2.504654   
min                  0.000000       0.000000       0.000000         0.000000   
25%                  5.516387       3.043275       0.358383         0.000000   
50%                  6.444357       4.915166       4.472563         0.680999   
75%                  7.027264       6.255482       5.831406         4.270631   
max                 10.149472      11.783954       9.392406         8.740268   

       ave_sqft_per_unit  ave_lot_size_per_unit     population           poor  \
count      226060.000000          226060.000000  226060.000000  226060.000000   
mean            7.248667               8.926522       6.825074       5.324646   
std             1.274195               1.932348       1.977952       1.974356   
min             0.000000               0.000000       0.000000       0.000000   
25%             7.279042               8.575155       6.402653       4.470420   
50%             7.435873               8.864663       7.390789       5.743055   
75%             7.608051               9.346504       7.992936       6.627428   
max             8.699681              17.866968      10.524388       9.980847   

             renters           sfdu     ave_hhsize       jobs_500  \
count  226060.000000  226060.000000  226060.000000  226060.000000   
mean        4.066829       5.344162       1.260551       2.722574   
std         1.517325       1.748989       0.255746       2.365888   
min         0.000000       0.000000       0.000000       0.000000   
25%         3.532047       4.961513       1.212801       0.000000   
50%         4.439603       5.906911       1.291382       2.736520   
75%         5.054503       6.438689       1.376037       4.744932   
max         7.266850       8.095656       2.079442      10.483402   

           jobs_1500  ave_income_1500  ave_income_500  
count  226060.000000    226060.000000   226060.000000  
mean        5.394094        11.195674       10.233214  
std         2.218826         2.009126        2.988467  
min         0.000000         0.000000        0.000000  
25%         4.393761        11.314487       10.778977  
50%         5.869059        11.513935       11.066654  
75%         6.872850        11.737676       11.297266  
max        11.769460        13.265079       13.438343  
Time to execute step 'neighborhood_vars': 133.20 s
Running step 'regional_vars'
Computing accessibility variables
Computing residential_units_45
Computing jobs_15
Computing jobs_45
Computing sum_income_40
Removed 4409 rows because they contain missing values
       residential_units_45       jobs_15       jobs_45  sum_income_40  \
count          12016.000000  12016.000000  12016.000000   1.201600e+04   
mean              13.161509     11.384355     13.387324   1.005272e+11   
std                0.764591      1.333359      0.862978   3.968859e+10   
min                0.000000      0.273583      5.051805   0.000000e+00   
25%               13.119405     10.919062     13.333064   8.384193e+10   
50%               13.417335     11.616613     13.702304   1.086236e+11   
75%               13.590098     12.254369     13.878131   1.290579e+11   
max               13.822374     13.084544     14.084508   1.694122e+11   

        embarcadero    pacheights      stanford  
count  12016.000000  12016.000000  12016.000000  
mean      34.742410     69.130263     56.614012  
std       18.559806     16.907736     25.413248  
min        0.000000      0.000000      0.000000  
25%       18.397501     75.000000     25.857000  
50%       34.338501     75.000000     75.000000  
75%       49.097249     75.000000     75.000000  
max       75.000000     75.000000     75.000000  
Time to execute step 'regional_vars': 186.38 s
Running step 'ual_rsh_simulate'
count    2.785868e+06
mean     4.310866e+02
std      2.056796e+02
min     -4.324238e+03
25%      2.841788e+02
50%      3.981102e+02
75%      5.394716e+02
max      1.343866e+03
dtype: float64
Clipped rsh_simulate produces
count    2.785868e+06
mean     4.360627e+02
std      1.960168e+02
min      2.000000e+02
25%      2.841788e+02
50%      3.981102e+02
75%      5.394716e+02
max      1.343866e+03
Name: unit_residential_price, dtype: float64
Time to execute step 'ual_rsh_simulate': 17.59 s
Running step 'ual_rrh_simulate'
count    2.785868e+06
mean     2.205567e+00
std      7.836249e-01
min     -3.777567e+00
25%      1.748814e+00
50%      2.254852e+00
75%      2.700894e+00
max      4.536520e+00
dtype: float64
Clipped rrh_simulate produces
count    2.785868e+06
mean     2.230642e+00
std      7.220149e-01
min      8.333333e-01
25%      1.748814e+00
50%      2.254852e+00
75%      2.700894e+00
max      4.536520e+00
Name: unit_residential_rent, dtype: float64
Time to execute step 'ual_rrh_simulate': 5.56 s
Running step 'ual_households_relocation'
Total agents: 2608019
Total currently unplaced: 4409
Assigning for relocation...
Total currently unplaced: 501653
Time to execute step 'ual_households_relocation': 1.26 s
Running step 'ual_data_diagnostics'

RUNNING ual_data_diagnostics
['taz_geography', 'parcels_zoning_by_scenario', 'household_controls', 'tmnodes', 'taz', 'zones', 'employment_controls', 'zoning_scenario', 'logsums', 'buildings_subset', 'landmarks', 'employment_controls_unstacked', 'households', 'jobs_subset', 'homesales', 'demolish_events', 'household_controls_unstacked', 'nodes', 'zoning_table_city_lookup', 'households_subset', 'buildings', 'jobs', 'parcels_geography', 'zone_forecast_inputs', 'costar', 'zoning_lookup', 'base_year_summary_taz', 'vmt_fee_categories', 'residential_units', 'development_projects', 'parcels_zoning_calculations', 'zoning_baseline', 'parcel_rejections', 'parcels']
['taz', 'serialno', 'puma5', 'income', 'persons', 'hht', 'unittype', 'noc', 'bldgsz', 'tenure', 'vehicl', 'hinccat1', 'hinccat2', 'hhagecat', 'hsizecat', 'hfamily', 'hunittype', 'hnoccat', 'hwrkrcat', 'h0004', 'h0511', 'h1215', 'h1617', 'h1824', 'h2534', 'h3549', 'h5064', 'h6579', 'h80up', 'hworkers', 'hwork_f', 'hwork_p', 'huniv', 'hnwork', 'hretire', 'hpresch', 'hschpred', 'hschdriv', 'htypdwel', 'hownrent', 'hadnwst', 'hadwpst', 'hadkids', 'bucketbin', 'originalpuma', 'hmultiunit', 'building_id', 'base_income_quartile', 'base_income_octile', 'unit_num', 'unit_id', 'income_quartile', 'ones', 'zone_id', 'tmnode_id', 'node_id']
['building_id', 'num_units', 'unit_num', 'unit_residential_price', 'unit_residential_rent', 'hownrent', 'zone_id', 'vacant_units']
            zone_id
count  2.785868e+06
mean   7.550363e+02
std    4.326733e+02
min    1.000000e+00
25%    3.750000e+02
50%    7.690000e+02
75%    1.148000e+03
max    1.454000e+03

Time to execute step 'ual_data_diagnostics': 4.83 s
Running step 'ual_hlcm_owner_simulate'
There are 2785868 total available units
    and 2608019 total choosers
    but there are 0 overfull buildings
    for a total of 679502 temporarily empty units
    in 679502 buildings total in the region
There are 501653 total movers for this LCM
Traceback (most recent call last):
  File "run.py", line 289, in <module>
    run_models(MODE, SCENARIO)
  File "run.py", line 206, in run_models
    ], iter_vars=[2010])
  File "/Users/smmaurer/anaconda/lib/python2.7/site-packages/orca/orca.py", line 1876, in run
    step()
  File "/Users/smmaurer/anaconda/lib/python2.7/site-packages/orca/orca.py", line 780, in __call__
    return self._func(**kwargs)
  File "/Users/smmaurer/Dropbox/Git-rMBP/ual/bayarea_urbansim/baus/ual.py", line 404, in ual_hlcm_owner_simulate
    ual_settings.get('price_equilibration', None))
  File "/Users/smmaurer/Dropbox/Git-rMBP/ual/urbansim_defaults/urbansim_defaults/utils.py", line 404, in lcm_simulate
    **kwargs)
  File "/Users/smmaurer/Dropbox/Git-rMBP/ual/urbansim/urbansim/models/supplydemand.py", line 139, in supply_and_demand
    alt_segmenter = alternatives[alt_segmenter]
  File "/Users/smmaurer/anaconda/lib/python2.7/site-packages/pandas/core/frame.py", line 1997, in __getitem__
    return self._getitem_column(key)
  File "/Users/smmaurer/anaconda/lib/python2.7/site-packages/pandas/core/frame.py", line 2004, in _getitem_column
    return self._get_item_cache(key)
  File "/Users/smmaurer/anaconda/lib/python2.7/site-packages/pandas/core/generic.py", line 1350, in _get_item_cache
    values = self._data.get(item)
  File "/Users/smmaurer/anaconda/lib/python2.7/site-packages/pandas/core/internals.py", line 3290, in get
    loc = self.items.get_loc(item)
  File "/Users/smmaurer/anaconda/lib/python2.7/site-packages/pandas/indexes/base.py", line 1947, in get_loc
    return self._engine.get_loc(self._maybe_cast_indexer(key))
  File "pandas/index.pyx", line 137, in pandas.index.IndexEngine.get_loc (pandas/index.c:4154)
  File "pandas/index.pyx", line 159, in pandas.index.IndexEngine.get_loc (pandas/index.c:4018)
  File "pandas/hashtable.pyx", line 675, in pandas.hashtable.PyObjectHashTable.get_item (pandas/hashtable.c:12368)
  File "pandas/hashtable.pyx", line 683, in pandas.hashtable.PyObjectHashTable.get_item (pandas/hashtable.c:12322)
KeyError: 'zone_id'
None
Traceback (most recent call last):
  File "run.py", line 299, in <module>
    raise e
KeyError: 'zone_id'
Closing remaining open files:./data/2015_09_01_bayarea_v3.h5...done./data/2015_06_01_osm_bayarea4326.h5...done./data/2015_08_03_tmnet.h5...done