Skip to content

Instantly share code, notes, and snippets.

@Chucooleg

Chucooleg/311_PCA.ipynb

Created September 26, 2016 21:54
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Chucooleg/a914dff9b608601295067df65c792242 to your computer and use it in GitHub Desktop.
Save Chucooleg/a914dff9b608601295067df65c792242 to your computer and use it in GitHub Desktop.
Download ZIP
Principal Component Assignment
Display the source blob
Display the rendered blob
Raw
311_PCA.ipynb
{
"cells": [
{
"cell_type": "code",
"execution_count": 14,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
"<script>\n",
"code_show=true; \n",
"function code_toggle() {\n",
" if (code_show){\n",
" $('div.input').hide();\n",
" } else {\n",
" $('div.input').show();\n",
" }\n",
" code_show = !code_show\n",
"} \n",
"$( document ).ready(code_toggle);\n",
"</script>\n",
"<form action=\"javascript:code_toggle()\"><input type=\"submit\" value=\"Click here to toggle on/off the raw code.\"></form>"
],
"text/plain": [
"<IPython.core.display.HTML object>"
]
},
"execution_count": 14,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"from IPython.display import HTML\n",
"\n",
"HTML('''<script>\n",
"code_show=true; \n",
"function code_toggle() {\n",
" if (code_show){\n",
" $('div.input').hide();\n",
" } else {\n",
" $('div.input').show();\n",
" }\n",
" code_show = !code_show\n",
"} \n",
"$( document ).ready(code_toggle);\n",
"</script>\n",
"<form action=\"javascript:code_toggle()\"><input type=\"submit\" value=\"Click here to toggle on/off the raw code.\"></form>''')"
]
},
{
"cell_type": "code",
"execution_count": 1,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
"import pandas as pd\n",
"import numpy as np\n",
"from sklearn.decomposition import PCA"
]
},
{
"cell_type": "code",
"execution_count": 20,
"metadata": {
"collapsed": false,
"scrolled": true
},
"outputs": [],
"source": [
"rf = pd.read_csv('/media/bikethief/FC6F-F5611/000_Datasets_keepme/2010_311_requests/rsquare_dataviz/2010_311_dtfixed_fewercol.csv',index_col=0)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Data set: NYC 311 service requests made to city agencies in 2010. The data has a total of 1665272 rows and 8 columns.\n",
"\n",
"* For each 311 service request case, the following information goes into a unique case recorded in the database:\n",
" - A unique Case ID\n",
" - Created Time & Closed Time\n",
" - Responding Agency\n",
" - Complaint Type\n",
" - Location Type\n",
" - Zipcode\n",
" - Latitude & Longitude\n",
" "
]
},
{
"cell_type": "code",
"execution_count": 24,
"metadata": {
"collapsed": false,
"scrolled": true
},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>Created Date</th>\n",
" <th>Closed Date</th>\n",
" <th>Agency</th>\n",
" <th>Complaint Type</th>\n",
" <th>Location Type</th>\n",
" <th>Incident Zip</th>\n",
" <th>Latitude</th>\n",
" <th>Longitude</th>\n",
" </tr>\n",
" <tr>\n",
" <th>Unique Key</th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>15636519</th>\n",
" <td>2010-01-01 00:00:00</td>\n",
" <td>2010-01-17 00:00:00</td>\n",
" <td>HPD</td>\n",
" <td>PLUMBING</td>\n",
" <td>RESIDENTIAL BUILDING</td>\n",
" <td>10453</td>\n",
" <td>40.846483</td>\n",
" <td>-73.921123</td>\n",
" </tr>\n",
" <tr>\n",
" <th>15636518</th>\n",
" <td>2010-01-01 00:00:00</td>\n",
" <td>2010-01-07 00:00:00</td>\n",
" <td>HPD</td>\n",
" <td>HEATING</td>\n",
" <td>RESIDENTIAL BUILDING</td>\n",
" <td>10002</td>\n",
" <td>40.713600</td>\n",
" <td>-73.978718</td>\n",
" </tr>\n",
" <tr>\n",
" <th>15636517</th>\n",
" <td>2010-01-01 00:00:00</td>\n",
" <td>2010-01-05 00:00:00</td>\n",
" <td>HPD</td>\n",
" <td>HEATING</td>\n",
" <td>RESIDENTIAL BUILDING</td>\n",
" <td>11106</td>\n",
" <td>40.756600</td>\n",
" <td>-73.926442</td>\n",
" </tr>\n",
" <tr>\n",
" <th>15636516</th>\n",
" <td>2010-01-01 00:00:00</td>\n",
" <td>2010-01-05 00:00:00</td>\n",
" <td>HPD</td>\n",
" <td>HEATING</td>\n",
" <td>RESIDENTIAL BUILDING</td>\n",
" <td>10468</td>\n",
" <td>40.860333</td>\n",
" <td>-73.913685</td>\n",
" </tr>\n",
" <tr>\n",
" <th>15636515</th>\n",
" <td>2010-01-01 00:00:00</td>\n",
" <td>2010-01-02 00:00:00</td>\n",
" <td>HPD</td>\n",
" <td>HEATING</td>\n",
" <td>RESIDENTIAL BUILDING</td>\n",
" <td>11225</td>\n",
" <td>40.659221</td>\n",
" <td>-73.960555</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"</div>"
],
"text/plain": [
" Created Date Closed Date Agency Complaint Type \\\n",
"Unique Key \n",
"15636519 2010-01-01 00:00:00 2010-01-17 00:00:00 HPD PLUMBING \n",
"15636518 2010-01-01 00:00:00 2010-01-07 00:00:00 HPD HEATING \n",
"15636517 2010-01-01 00:00:00 2010-01-05 00:00:00 HPD HEATING \n",
"15636516 2010-01-01 00:00:00 2010-01-05 00:00:00 HPD HEATING \n",
"15636515 2010-01-01 00:00:00 2010-01-02 00:00:00 HPD HEATING \n",
"\n",
" Location Type Incident Zip Latitude Longitude \n",
"Unique Key \n",
"15636519 RESIDENTIAL BUILDING 10453 40.846483 -73.921123 \n",
"15636518 RESIDENTIAL BUILDING 10002 40.713600 -73.978718 \n",
"15636517 RESIDENTIAL BUILDING 11106 40.756600 -73.926442 \n",
"15636516 RESIDENTIAL BUILDING 10468 40.860333 -73.913685 \n",
"15636515 RESIDENTIAL BUILDING 11225 40.659221 -73.960555 "
]
},
"execution_count": 24,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"rf.head(5)\n",
"rf[['Created Date','Closed Date','Agency','Complaint Type','Location Type','Incident Zip','Latitude','Longitude']].head(5)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"* From the original data, three variables of continuous numeric values are created for further analysis\n",
" - Response Minutes : how long it takes an agency to respond to a case\n",
" - Minutes from midnight : how far from mid-night did that incident happen\n",
" - Calls_within_60min : number of calls received within the same hour\n",
"\n",
"* Two categorical variables were converted to dummy variables (1/0)\n",
" -Complaint Type\n",
" -Location Type"
]
},
{
"cell_type": "code",
"execution_count": 25,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
"df = pd.read_csv('/media/bikethief/FC6F-F5611/000_Datasets_keepme/2010_311_requests/rsquare_ML_class/311_NYPD_2010.csv',index_col=0)"
]
},
{
"cell_type": "code",
"execution_count": 26,
"metadata": {
"collapsed": false,
"scrolled": true
},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>Response Minutes</th>\n",
" <th>Bike/Roller/Skate Chronic</th>\n",
" <th>Blocked Driveway</th>\n",
" <th>Derelict Vehicle</th>\n",
" <th>Disorderly Youth</th>\n",
" <th>Drinking</th>\n",
" <th>Graffiti</th>\n",
" <th>Homeless Encampment</th>\n",
" <th>Illegal Fireworks</th>\n",
" <th>Illegal Parking</th>\n",
" <th>...</th>\n",
" <th>Parking Lot</th>\n",
" <th>Pier</th>\n",
" <th>Residential Building/House</th>\n",
" <th>Roadway Tunnel</th>\n",
" <th>Store/Commercial</th>\n",
" <th>Street/Sidewalk</th>\n",
" <th>Subway Station</th>\n",
" <th>Vacant Lot</th>\n",
" <th>Calls_within_60min</th>\n",
" <th>Minutes from midnight</th>\n",
" </tr>\n",
" <tr>\n",
" <th>Unique Key</th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" <th></th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>15628796</th>\n",
" <td>69.333333</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>...</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>20.0</td>\n",
" <td>3.766667</td>\n",
" </tr>\n",
" <tr>\n",
" <th>15628757</th>\n",
" <td>225.583333</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>...</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>24.0</td>\n",
" <td>8.033333</td>\n",
" </tr>\n",
" <tr>\n",
" <th>15627442</th>\n",
" <td>19.200000</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>...</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>24.0</td>\n",
" <td>8.483333</td>\n",
" </tr>\n",
" <tr>\n",
" <th>15628494</th>\n",
" <td>32.566667</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>...</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>24.0</td>\n",
" <td>8.500000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>15628820</th>\n",
" <td>66.250000</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>...</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>1.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>0.0</td>\n",
" <td>29.0</td>\n",
" <td>15.133333</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"<p>5 rows × 40 columns</p>\n",
"</div>"
],
"text/plain": [
" Response Minutes Bike/Roller/Skate Chronic Blocked Driveway \\\n",
"Unique Key \n",
"15628796 69.333333 0.0 0.0 \n",
"15628757 225.583333 0.0 0.0 \n",
"15627442 19.200000 0.0 0.0 \n",
"15628494 32.566667 0.0 0.0 \n",
"15628820 66.250000 0.0 0.0 \n",
"\n",
" Derelict Vehicle Disorderly Youth Drinking Graffiti \\\n",
"Unique Key \n",
"15628796 0.0 0.0 0.0 0.0 \n",
"15628757 0.0 0.0 0.0 0.0 \n",
"15627442 0.0 0.0 0.0 0.0 \n",
"15628494 0.0 0.0 0.0 0.0 \n",
"15628820 0.0 0.0 0.0 0.0 \n",
"\n",
" Homeless Encampment Illegal Fireworks Illegal Parking \\\n",
"Unique Key \n",
"15628796 0.0 0.0 0.0 \n",
"15628757 0.0 0.0 0.0 \n",
"15627442 0.0 0.0 0.0 \n",
"15628494 0.0 0.0 0.0 \n",
"15628820 0.0 0.0 0.0 \n",
"\n",
" ... Parking Lot Pier \\\n",
"Unique Key ... \n",
"15628796 ... 0.0 0.0 \n",
"15628757 ... 0.0 0.0 \n",
"15627442 ... 0.0 0.0 \n",
"15628494 ... 0.0 0.0 \n",
"15628820 ... 0.0 0.0 \n",
"\n",
" Residential Building/House Roadway Tunnel Store/Commercial \\\n",
"Unique Key \n",
"15628796 1.0 0.0 0.0 \n",
"15628757 1.0 0.0 0.0 \n",
"15627442 1.0 0.0 0.0 \n",
"15628494 1.0 0.0 0.0 \n",
"15628820 1.0 0.0 0.0 \n",
"\n",
" Street/Sidewalk Subway Station Vacant Lot Calls_within_60min \\\n",
"Unique Key \n",
"15628796 0.0 0.0 0.0 20.0 \n",
"15628757 0.0 0.0 0.0 24.0 \n",
"15627442 0.0 0.0 0.0 24.0 \n",
"15628494 0.0 0.0 0.0 24.0 \n",
"15628820 0.0 0.0 0.0 29.0 \n",
"\n",
" Minutes from midnight \n",
"Unique Key \n",
"15628796 3.766667 \n",
"15628757 8.033333 \n",
"15627442 8.483333 \n",
"15628494 8.500000 \n",
"15628820 15.133333 \n",
"\n",
"[5 rows x 40 columns]"
]
},
"execution_count": 26,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"df.rename(columns={'20':'Calls_within_60min'},inplace=True)\n",
"df.head(5)"
]
},
{
"cell_type": "code",
"execution_count": 31,
"metadata": {
"collapsed": false
},
"outputs": [],
"source": [
"del df['Location Type']"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"A quick overview of the correlation matrix shows that most variables are weakly correlated (between -0.1 & 0.1).\n",
"\n",
"Except for two variables (~ 0.28)\n",
" - Minutes from midnight : how far from mid-night did that incident happen\n",
" - Calls_within_60min : number of calls received within the same hour"
]
},
{
"cell_type": "code",
"execution_count": 35,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>Response Minutes</th>\n",
" <th>Blocked Driveway</th>\n",
" <th>Derelict Vehicle</th>\n",
" <th>Disorderly Youth</th>\n",
" <th>Drinking</th>\n",
" <th>Graffiti</th>\n",
" <th>Homeless Encampment</th>\n",
" <th>Illegal Fireworks</th>\n",
" <th>Illegal Parking</th>\n",
" <th>Noise - Commercial</th>\n",
" <th>...</th>\n",
" <th>Park/Playground</th>\n",
" <th>Pier</th>\n",
" <th>Residential Building/House</th>\n",
" <th>Roadway Tunnel</th>\n",
" <th>Store/Commercial</th>\n",
" <th>Street/Sidewalk</th>\n",
" <th>Subway Station</th>\n",
" <th>Vacant Lot</th>\n",
" <th>Calls_within_60min</th>\n",
" <th>Minutes from midnight</th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>Response Minutes</th>\n",
" <td>1.000000</td>\n",
" <td>0.017669</td>\n",
" <td>0.127927</td>\n",
" <td>-0.003624</td>\n",
" <td>0.000443</td>\n",
" <td>0.003661</td>\n",
" <td>0.002223</td>\n",
" <td>0.000611</td>\n",
" <td>0.008752</td>\n",
" <td>-0.038640</td>\n",
" <td>...</td>\n",
" <td>-0.010858</td>\n",
" <td>-0.001052</td>\n",
" <td>-0.034525</td>\n",
" <td>-0.000271</td>\n",
" <td>-0.011474</td>\n",
" <td>0.056871</td>\n",
" <td>-0.001119</td>\n",
" <td>0.013914</td>\n",
" <td>-0.063448</td>\n",
" <td>-0.020181</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Blocked Driveway</th>\n",
" <td>0.017669</td>\n",
" <td>1.000000</td>\n",
" <td>-0.106157</td>\n",
" <td>-0.030068</td>\n",
" <td>-0.031344</td>\n",
" <td>-0.014628</td>\n",
" <td>-0.036441</td>\n",
" <td>-0.012408</td>\n",
" <td>-0.125174</td>\n",
" <td>-0.128956</td>\n",
" <td>...</td>\n",
" <td>-0.045020</td>\n",
" <td>-0.001216</td>\n",
" <td>-0.387717</td>\n",
" <td>-0.003749</td>\n",
" <td>-0.070963</td>\n",
" <td>0.469488</td>\n",
" <td>-0.002276</td>\n",
" <td>-0.005507</td>\n",
" <td>-0.141139</td>\n",
" <td>0.021892</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Derelict Vehicle</th>\n",
" <td>0.127927</td>\n",
" <td>-0.106157</td>\n",
" <td>1.000000</td>\n",
" <td>-0.015139</td>\n",
" <td>-0.015782</td>\n",
" <td>-0.007365</td>\n",
" <td>-0.018348</td>\n",
" <td>-0.006248</td>\n",
" <td>-0.063025</td>\n",
" <td>-0.064930</td>\n",
" <td>...</td>\n",
" <td>-0.022668</td>\n",
" <td>-0.000612</td>\n",
" <td>-0.195216</td>\n",
" <td>0.002029</td>\n",
" <td>-0.035730</td>\n",
" <td>0.234470</td>\n",
" <td>-0.001146</td>\n",
" <td>0.051880</td>\n",
" <td>-0.103255</td>\n",
" <td>0.001108</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Disorderly Youth</th>\n",
" <td>-0.003624</td>\n",
" <td>-0.030068</td>\n",
" <td>-0.015139</td>\n",
" <td>1.000000</td>\n",
" <td>-0.004470</td>\n",
" <td>-0.002086</td>\n",
" <td>-0.005197</td>\n",
" <td>-0.001770</td>\n",
" <td>-0.017851</td>\n",
" <td>-0.018391</td>\n",
" <td>...</td>\n",
" <td>-0.006420</td>\n",
" <td>-0.000173</td>\n",
" <td>-0.010866</td>\n",
" <td>-0.000535</td>\n",
" <td>0.016972</td>\n",
" <td>0.014964</td>\n",
" <td>-0.000325</td>\n",
" <td>-0.000785</td>\n",
" <td>0.003804</td>\n",
" <td>0.038681</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Drinking</th>\n",
" <td>0.000443</td>\n",
" <td>-0.031344</td>\n",
" <td>-0.015782</td>\n",
" <td>-0.004470</td>\n",
" <td>1.000000</td>\n",
" <td>-0.002175</td>\n",
" <td>-0.005417</td>\n",
" <td>-0.001845</td>\n",
" <td>-0.018609</td>\n",
" <td>-0.019171</td>\n",
" <td>...</td>\n",
" <td>0.033185</td>\n",
" <td>-0.000181</td>\n",
" <td>-0.035537</td>\n",
" <td>-0.000557</td>\n",
" <td>0.004502</td>\n",
" <td>-0.029265</td>\n",
" <td>-0.000338</td>\n",
" <td>-0.000819</td>\n",
" <td>0.001338</td>\n",
" <td>0.004601</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Graffiti</th>\n",
" <td>0.003661</td>\n",
" <td>-0.014628</td>\n",
" <td>-0.007365</td>\n",
" <td>-0.002086</td>\n",
" <td>-0.002175</td>\n",
" <td>1.000000</td>\n",
" <td>-0.002528</td>\n",
" <td>-0.000861</td>\n",
" <td>-0.008685</td>\n",
" <td>-0.008947</td>\n",
" <td>...</td>\n",
" <td>-0.003124</td>\n",
" <td>-0.000084</td>\n",
" <td>0.009775</td>\n",
" <td>-0.000260</td>\n",
" <td>0.052042</td>\n",
" <td>-0.020793</td>\n",
" <td>-0.000158</td>\n",
" <td>-0.000382</td>\n",
" <td>-0.014102</td>\n",
" <td>-0.000224</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Homeless Encampment</th>\n",
" <td>0.002223</td>\n",
" <td>-0.036441</td>\n",
" <td>-0.018348</td>\n",
" <td>-0.005197</td>\n",
" <td>-0.005417</td>\n",
" <td>-0.002528</td>\n",
" <td>1.000000</td>\n",
" <td>-0.002145</td>\n",
" <td>-0.021635</td>\n",
" <td>-0.022289</td>\n",
" <td>...</td>\n",
" <td>0.065053</td>\n",
" <td>-0.000210</td>\n",
" <td>-0.011059</td>\n",
" <td>0.010250</td>\n",
" <td>0.054342</td>\n",
" <td>-0.009894</td>\n",
" <td>-0.000393</td>\n",
" <td>-0.000952</td>\n",
" <td>-0.034515</td>\n",
" <td>-0.004137</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Illegal Fireworks</th>\n",
" <td>0.000611</td>\n",
" <td>-0.012408</td>\n",
" <td>-0.006248</td>\n",
" <td>-0.001770</td>\n",
" <td>-0.001845</td>\n",
" <td>-0.000861</td>\n",
" <td>-0.002145</td>\n",
" <td>1.000000</td>\n",
" <td>-0.007367</td>\n",
" <td>-0.007589</td>\n",
" <td>...</td>\n",
" <td>0.012066</td>\n",
" <td>0.098023</td>\n",
" <td>-0.009113</td>\n",
" <td>-0.000221</td>\n",
" <td>-0.000733</td>\n",
" <td>0.009697</td>\n",
" <td>-0.000134</td>\n",
" <td>-0.000324</td>\n",
" <td>0.007397</td>\n",
" <td>0.009556</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Illegal Parking</th>\n",
" <td>0.008752</td>\n",
" <td>-0.125174</td>\n",
" <td>-0.063025</td>\n",
" <td>-0.017851</td>\n",
" <td>-0.018609</td>\n",
" <td>-0.008685</td>\n",
" <td>-0.021635</td>\n",
" <td>-0.007367</td>\n",
" <td>1.000000</td>\n",
" <td>-0.076561</td>\n",
" <td>...</td>\n",
" <td>-0.026729</td>\n",
" <td>-0.000722</td>\n",
" <td>-0.230187</td>\n",
" <td>-0.002226</td>\n",
" <td>-0.042131</td>\n",
" <td>0.278735</td>\n",
" <td>-0.001351</td>\n",
" <td>-0.003270</td>\n",
" <td>-0.079658</td>\n",
" <td>0.013434</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Noise - Commercial</th>\n",
" <td>-0.038640</td>\n",
" <td>-0.128956</td>\n",
" <td>-0.064930</td>\n",
" <td>-0.018391</td>\n",
" <td>-0.019171</td>\n",
" <td>-0.008947</td>\n",
" <td>-0.022289</td>\n",
" <td>-0.007589</td>\n",
" <td>-0.076561</td>\n",
" <td>1.000000</td>\n",
" <td>...</td>\n",
" <td>-0.027536</td>\n",
" <td>-0.000744</td>\n",
" <td>-0.237142</td>\n",
" <td>-0.002293</td>\n",
" <td>0.420281</td>\n",
" <td>-0.274673</td>\n",
" <td>-0.001392</td>\n",
" <td>-0.003369</td>\n",
" <td>0.098320</td>\n",
" <td>-0.064028</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Noise - House of Worship</th>\n",
" <td>-0.008410</td>\n",
" <td>-0.028710</td>\n",
" <td>-0.014456</td>\n",
" <td>-0.004094</td>\n",
" <td>-0.004268</td>\n",
" <td>-0.001992</td>\n",
" <td>-0.004962</td>\n",
" <td>-0.001690</td>\n",
" <td>-0.017045</td>\n",
" <td>-0.017560</td>\n",
" <td>...</td>\n",
" <td>-0.006131</td>\n",
" <td>-0.000166</td>\n",
" <td>-0.052796</td>\n",
" <td>-0.000511</td>\n",
" <td>-0.009663</td>\n",
" <td>-0.061152</td>\n",
" <td>-0.000310</td>\n",
" <td>-0.000750</td>\n",
" <td>0.017869</td>\n",
" <td>0.019135</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Noise - Park</th>\n",
" <td>-0.011096</td>\n",
" <td>-0.041050</td>\n",
" <td>-0.020669</td>\n",
" <td>-0.005854</td>\n",
" <td>-0.006103</td>\n",
" <td>-0.002848</td>\n",
" <td>-0.007095</td>\n",
" <td>-0.002416</td>\n",
" <td>-0.024371</td>\n",
" <td>-0.025108</td>\n",
" <td>...</td>\n",
" <td>0.911802</td>\n",
" <td>-0.000237</td>\n",
" <td>-0.075488</td>\n",
" <td>-0.000730</td>\n",
" <td>-0.013816</td>\n",
" <td>-0.087435</td>\n",
" <td>-0.000443</td>\n",
" <td>-0.001072</td>\n",
" <td>0.034193</td>\n",
" <td>0.019035</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Noise - Residential</th>\n",
" <td>-0.035660</td>\n",
" <td>-0.378187</td>\n",
" <td>-0.190418</td>\n",
" <td>-0.053934</td>\n",
" <td>-0.056223</td>\n",
" <td>-0.026240</td>\n",
" <td>-0.065365</td>\n",
" <td>-0.022258</td>\n",
" <td>-0.224530</td>\n",
" <td>-0.231313</td>\n",
" <td>...</td>\n",
" <td>-0.080755</td>\n",
" <td>-0.002182</td>\n",
" <td>0.975422</td>\n",
" <td>-0.006725</td>\n",
" <td>-0.127289</td>\n",
" <td>-0.805532</td>\n",
" <td>-0.004082</td>\n",
" <td>-0.009879</td>\n",
" <td>0.163839</td>\n",
" <td>-0.010872</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Noise - Street/Sidewalk</th>\n",
" <td>-0.027430</td>\n",
" <td>-0.119465</td>\n",
" <td>-0.060151</td>\n",
" <td>-0.017037</td>\n",
" <td>-0.017760</td>\n",
" <td>-0.008289</td>\n",
" <td>-0.020648</td>\n",
" <td>-0.007031</td>\n",
" <td>-0.070926</td>\n",
" <td>-0.073069</td>\n",
" <td>...</td>\n",
" <td>-0.025510</td>\n",
" <td>-0.000689</td>\n",
" <td>-0.219689</td>\n",
" <td>-0.002124</td>\n",
" <td>-0.040209</td>\n",
" <td>0.266023</td>\n",
" <td>-0.001289</td>\n",
" <td>-0.003121</td>\n",
" <td>0.069543</td>\n",
" <td>-0.005228</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Noise - Vehicle</th>\n",
" <td>-0.013517</td>\n",
" <td>-0.102336</td>\n",
" <td>-0.051526</td>\n",
" <td>-0.014594</td>\n",
" <td>-0.015214</td>\n",
" <td>-0.007100</td>\n",
" <td>-0.017688</td>\n",
" <td>-0.006023</td>\n",
" <td>-0.060757</td>\n",
" <td>-0.062592</td>\n",
" <td>...</td>\n",
" <td>-0.021852</td>\n",
" <td>-0.000590</td>\n",
" <td>-0.188190</td>\n",
" <td>-0.001820</td>\n",
" <td>-0.034444</td>\n",
" <td>0.227880</td>\n",
" <td>-0.001104</td>\n",
" <td>-0.002673</td>\n",
" <td>0.014735</td>\n",
" <td>0.001113</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Non-Emergency Police Matter</th>\n",
" <td>0.002573</td>\n",
" <td>-0.052953</td>\n",
" <td>-0.026662</td>\n",
" <td>-0.007552</td>\n",
" <td>-0.007872</td>\n",
" <td>-0.003674</td>\n",
" <td>-0.009152</td>\n",
" <td>-0.003116</td>\n",
" <td>-0.031438</td>\n",
" <td>-0.032388</td>\n",
" <td>...</td>\n",
" <td>0.003295</td>\n",
" <td>-0.000305</td>\n",
" <td>-0.011513</td>\n",
" <td>-0.000942</td>\n",
" <td>0.042630</td>\n",
" <td>0.012152</td>\n",
" <td>-0.000572</td>\n",
" <td>-0.001383</td>\n",
" <td>-0.036119</td>\n",
" <td>0.015610</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Panhandling</th>\n",
" <td>-0.001010</td>\n",
" <td>-0.010032</td>\n",
" <td>-0.005051</td>\n",
" <td>-0.001431</td>\n",
" <td>-0.001491</td>\n",
" <td>-0.000696</td>\n",
" <td>-0.001734</td>\n",
" <td>-0.000590</td>\n",
" <td>-0.005956</td>\n",
" <td>-0.006136</td>\n",
" <td>...</td>\n",
" <td>0.001166</td>\n",
" <td>-0.000058</td>\n",
" <td>-0.014864</td>\n",
" <td>-0.000178</td>\n",
" <td>0.041326</td>\n",
" <td>0.004664</td>\n",
" <td>-0.000108</td>\n",
" <td>-0.000262</td>\n",
" <td>-0.003299</td>\n",
" <td>0.004274</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Posting Advertisement</th>\n",
" <td>-0.000017</td>\n",
" <td>-0.016442</td>\n",
" <td>-0.008279</td>\n",
" <td>-0.002345</td>\n",
" <td>-0.002444</td>\n",
" <td>-0.001141</td>\n",
" <td>-0.002842</td>\n",
" <td>-0.000968</td>\n",
" <td>-0.009762</td>\n",
" <td>-0.010056</td>\n",
" <td>...</td>\n",
" <td>-0.003511</td>\n",
" <td>-0.000095</td>\n",
" <td>0.000613</td>\n",
" <td>-0.000292</td>\n",
" <td>0.008115</td>\n",
" <td>0.000501</td>\n",
" <td>-0.000177</td>\n",
" <td>-0.000429</td>\n",
" <td>-0.014175</td>\n",
" <td>0.002706</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Squeegee</th>\n",
" <td>-0.000001</td>\n",
" <td>-0.002433</td>\n",
" <td>-0.001225</td>\n",
" <td>-0.000347</td>\n",
" <td>-0.000362</td>\n",
" <td>-0.000169</td>\n",
" <td>-0.000420</td>\n",
" <td>-0.000143</td>\n",
" <td>-0.001444</td>\n",
" <td>-0.001488</td>\n",
" <td>...</td>\n",
" <td>-0.000519</td>\n",
" <td>-0.000014</td>\n",
" <td>-0.004473</td>\n",
" <td>-0.000043</td>\n",
" <td>-0.000819</td>\n",
" <td>0.005417</td>\n",
" <td>-0.000026</td>\n",
" <td>-0.000064</td>\n",
" <td>-0.001964</td>\n",
" <td>-0.000094</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Traffic</th>\n",
" <td>-0.003506</td>\n",
" <td>-0.039177</td>\n",
" <td>-0.019726</td>\n",
" <td>-0.005587</td>\n",
" <td>-0.005824</td>\n",
" <td>-0.002718</td>\n",
" <td>-0.006771</td>\n",
" <td>-0.002306</td>\n",
" <td>-0.023260</td>\n",
" <td>-0.023962</td>\n",
" <td>...</td>\n",
" <td>-0.008366</td>\n",
" <td>-0.000226</td>\n",
" <td>-0.072045</td>\n",
" <td>0.055108</td>\n",
" <td>-0.013186</td>\n",
" <td>0.077960</td>\n",
" <td>-0.000423</td>\n",
" <td>-0.001023</td>\n",
" <td>-0.028631</td>\n",
" <td>0.008506</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Traffic/Illegal Parking</th>\n",
" <td>0.009380</td>\n",
" <td>-0.104543</td>\n",
" <td>-0.052637</td>\n",
" <td>-0.014909</td>\n",
" <td>-0.015542</td>\n",
" <td>-0.007253</td>\n",
" <td>-0.018069</td>\n",
" <td>-0.006153</td>\n",
" <td>-0.062067</td>\n",
" <td>-0.063942</td>\n",
" <td>...</td>\n",
" <td>-0.022323</td>\n",
" <td>-0.000603</td>\n",
" <td>-0.192248</td>\n",
" <td>0.006082</td>\n",
" <td>-0.035187</td>\n",
" <td>0.230200</td>\n",
" <td>-0.001128</td>\n",
" <td>-0.002731</td>\n",
" <td>-0.083971</td>\n",
" <td>0.008281</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Urinating in Public</th>\n",
" <td>-0.003777</td>\n",
" <td>-0.016306</td>\n",
" <td>-0.008210</td>\n",
" <td>-0.002325</td>\n",
" <td>-0.002424</td>\n",
" <td>-0.001131</td>\n",
" <td>-0.002818</td>\n",
" <td>-0.000960</td>\n",
" <td>-0.009681</td>\n",
" <td>-0.009973</td>\n",
" <td>...</td>\n",
" <td>0.016890</td>\n",
" <td>-0.000094</td>\n",
" <td>-0.000888</td>\n",
" <td>-0.000290</td>\n",
" <td>0.012206</td>\n",
" <td>-0.005246</td>\n",
" <td>0.139551</td>\n",
" <td>-0.000426</td>\n",
" <td>-0.007046</td>\n",
" <td>0.001344</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Vending</th>\n",
" <td>-0.002135</td>\n",
" <td>-0.056687</td>\n",
" <td>-0.028542</td>\n",
" <td>-0.008084</td>\n",
" <td>-0.008427</td>\n",
" <td>-0.003933</td>\n",
" <td>-0.009798</td>\n",
" <td>-0.003336</td>\n",
" <td>-0.033655</td>\n",
" <td>-0.034672</td>\n",
" <td>...</td>\n",
" <td>0.029785</td>\n",
" <td>-0.000327</td>\n",
" <td>-0.089202</td>\n",
" <td>-0.001008</td>\n",
" <td>0.095989</td>\n",
" <td>0.068512</td>\n",
" <td>-0.000612</td>\n",
" <td>-0.001481</td>\n",
" <td>-0.043701</td>\n",
" <td>0.003756</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Bridge</th>\n",
" <td>-0.000617</td>\n",
" <td>-0.001216</td>\n",
" <td>-0.000612</td>\n",
" <td>-0.000173</td>\n",
" <td>-0.000181</td>\n",
" <td>-0.000084</td>\n",
" <td>0.033378</td>\n",
" <td>-0.000072</td>\n",
" <td>-0.000722</td>\n",
" <td>-0.000744</td>\n",
" <td>...</td>\n",
" <td>-0.000260</td>\n",
" <td>-0.000007</td>\n",
" <td>-0.002237</td>\n",
" <td>-0.000022</td>\n",
" <td>-0.000409</td>\n",
" <td>-0.002591</td>\n",
" <td>-0.000013</td>\n",
" <td>-0.000032</td>\n",
" <td>-0.002557</td>\n",
" <td>-0.001908</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Club/Bar/Restaurant</th>\n",
" <td>-0.035647</td>\n",
" <td>-0.113031</td>\n",
" <td>-0.056911</td>\n",
" <td>-0.016119</td>\n",
" <td>0.123131</td>\n",
" <td>-0.007842</td>\n",
" <td>-0.019536</td>\n",
" <td>-0.006652</td>\n",
" <td>-0.067106</td>\n",
" <td>0.839344</td>\n",
" <td>...</td>\n",
" <td>-0.024136</td>\n",
" <td>-0.000652</td>\n",
" <td>-0.207857</td>\n",
" <td>-0.002010</td>\n",
" <td>-0.038044</td>\n",
" <td>-0.240753</td>\n",
" <td>-0.001220</td>\n",
" <td>-0.002953</td>\n",
" <td>0.106818</td>\n",
" <td>-0.082735</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Highway</th>\n",
" <td>0.000440</td>\n",
" <td>-0.012408</td>\n",
" <td>0.003816</td>\n",
" <td>-0.001770</td>\n",
" <td>-0.001845</td>\n",
" <td>-0.000861</td>\n",
" <td>0.020919</td>\n",
" <td>-0.000730</td>\n",
" <td>-0.007367</td>\n",
" <td>-0.007589</td>\n",
" <td>...</td>\n",
" <td>-0.002650</td>\n",
" <td>-0.000072</td>\n",
" <td>-0.022818</td>\n",
" <td>-0.000221</td>\n",
" <td>-0.004176</td>\n",
" <td>-0.026430</td>\n",
" <td>-0.000134</td>\n",
" <td>-0.000324</td>\n",
" <td>-0.011999</td>\n",
" <td>-0.000737</td>\n",
" </tr>\n",
" <tr>\n",
" <th>House of Worship</th>\n",
" <td>-0.008410</td>\n",
" <td>-0.028710</td>\n",
" <td>-0.014456</td>\n",
" <td>-0.004094</td>\n",
" <td>-0.004268</td>\n",
" <td>-0.001992</td>\n",
" <td>-0.004962</td>\n",
" <td>-0.001690</td>\n",
" <td>-0.017045</td>\n",
" <td>-0.017560</td>\n",
" <td>...</td>\n",
" <td>-0.006131</td>\n",
" <td>-0.000166</td>\n",
" <td>-0.052796</td>\n",
" <td>-0.000511</td>\n",
" <td>-0.009663</td>\n",
" <td>-0.061152</td>\n",
" <td>-0.000310</td>\n",
" <td>-0.000750</td>\n",
" <td>0.017869</td>\n",
" <td>0.019135</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Park/Playground</th>\n",
" <td>-0.010858</td>\n",
" <td>-0.045020</td>\n",
" <td>-0.022668</td>\n",
" <td>-0.006420</td>\n",
" <td>0.033185</td>\n",
" <td>-0.003124</td>\n",
" <td>0.065053</td>\n",
" <td>0.012066</td>\n",
" <td>-0.026729</td>\n",
" <td>-0.027536</td>\n",
" <td>...</td>\n",
" <td>1.000000</td>\n",
" <td>-0.000260</td>\n",
" <td>-0.082790</td>\n",
" <td>-0.000801</td>\n",
" <td>-0.015153</td>\n",
" <td>-0.095893</td>\n",
" <td>-0.000486</td>\n",
" <td>-0.001176</td>\n",
" <td>0.026647</td>\n",
" <td>0.018034</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Pier</th>\n",
" <td>-0.001052</td>\n",
" <td>-0.001216</td>\n",
" <td>-0.000612</td>\n",
" <td>-0.000173</td>\n",
" <td>-0.000181</td>\n",
" <td>-0.000084</td>\n",
" <td>-0.000210</td>\n",
" <td>0.098023</td>\n",
" <td>-0.000722</td>\n",
" <td>-0.000744</td>\n",
" <td>...</td>\n",
" <td>-0.000260</td>\n",
" <td>1.000000</td>\n",
" <td>-0.002237</td>\n",
" <td>-0.000022</td>\n",
" <td>-0.000409</td>\n",
" <td>-0.002591</td>\n",
" <td>-0.000013</td>\n",
" <td>-0.000032</td>\n",
" <td>0.001828</td>\n",
" <td>0.001674</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Residential Building/House</th>\n",
" <td>-0.034525</td>\n",
" <td>-0.387717</td>\n",
" <td>-0.195216</td>\n",
" <td>-0.010866</td>\n",
" <td>-0.035537</td>\n",
" <td>0.009775</td>\n",
" <td>-0.011059</td>\n",
" <td>-0.009113</td>\n",
" <td>-0.230187</td>\n",
" <td>-0.237142</td>\n",
" <td>...</td>\n",
" <td>-0.082790</td>\n",
" <td>-0.002237</td>\n",
" <td>1.000000</td>\n",
" <td>-0.006894</td>\n",
" <td>-0.130496</td>\n",
" <td>-0.825829</td>\n",
" <td>-0.004185</td>\n",
" <td>-0.010128</td>\n",
" <td>0.156972</td>\n",
" <td>-0.006654</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Roadway Tunnel</th>\n",
" <td>-0.000271</td>\n",
" <td>-0.003749</td>\n",
" <td>0.002029</td>\n",
" <td>-0.000535</td>\n",
" <td>-0.000557</td>\n",
" <td>-0.000260</td>\n",
" <td>0.010250</td>\n",
" <td>-0.000221</td>\n",
" <td>-0.002226</td>\n",
" <td>-0.002293</td>\n",
" <td>...</td>\n",
" <td>-0.000801</td>\n",
" <td>-0.000022</td>\n",
" <td>-0.006894</td>\n",
" <td>1.000000</td>\n",
" <td>-0.001262</td>\n",
" <td>-0.007985</td>\n",
" <td>-0.000040</td>\n",
" <td>-0.000098</td>\n",
" <td>-0.000327</td>\n",
" <td>0.002256</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Store/Commercial</th>\n",
" <td>-0.011474</td>\n",
" <td>-0.070963</td>\n",
" <td>-0.035730</td>\n",
" <td>0.016972</td>\n",
" <td>0.004502</td>\n",
" <td>0.052042</td>\n",
" <td>0.054342</td>\n",
" <td>-0.000733</td>\n",
" <td>-0.042131</td>\n",
" <td>0.420281</td>\n",
" <td>...</td>\n",
" <td>-0.015153</td>\n",
" <td>-0.000409</td>\n",
" <td>-0.130496</td>\n",
" <td>-0.001262</td>\n",
" <td>1.000000</td>\n",
" <td>-0.151149</td>\n",
" <td>-0.000766</td>\n",
" <td>-0.001854</td>\n",
" <td>-0.008161</td>\n",
" <td>0.016699</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Street/Sidewalk</th>\n",
" <td>0.056871</td>\n",
" <td>0.469488</td>\n",
" <td>0.234470</td>\n",
" <td>0.014964</td>\n",
" <td>-0.029265</td>\n",
" <td>-0.020793</td>\n",
" <td>-0.009894</td>\n",
" <td>0.009697</td>\n",
" <td>0.278735</td>\n",
" <td>-0.274673</td>\n",
" <td>...</td>\n",
" <td>-0.095893</td>\n",
" <td>-0.002591</td>\n",
" <td>-0.825829</td>\n",
" <td>-0.007985</td>\n",
" <td>-0.151149</td>\n",
" <td>1.000000</td>\n",
" <td>-0.004847</td>\n",
" <td>-0.011731</td>\n",
" <td>-0.208504</td>\n",
" <td>0.034033</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Subway Station</th>\n",
" <td>-0.001119</td>\n",
" <td>-0.002276</td>\n",
" <td>-0.001146</td>\n",
" <td>-0.000325</td>\n",
" <td>-0.000338</td>\n",
" <td>-0.000158</td>\n",
" <td>-0.000393</td>\n",
" <td>-0.000134</td>\n",
" <td>-0.001351</td>\n",
" <td>-0.001392</td>\n",
" <td>...</td>\n",
" <td>-0.000486</td>\n",
" <td>-0.000013</td>\n",
" <td>-0.004185</td>\n",
" <td>-0.000040</td>\n",
" <td>-0.000766</td>\n",
" <td>-0.004847</td>\n",
" <td>1.000000</td>\n",
" <td>-0.000059</td>\n",
" <td>-0.001780</td>\n",
" <td>0.001043</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Vacant Lot</th>\n",
" <td>0.013914</td>\n",
" <td>-0.005507</td>\n",
" <td>0.051880</td>\n",
" <td>-0.000785</td>\n",
" <td>-0.000819</td>\n",
" <td>-0.000382</td>\n",
" <td>-0.000952</td>\n",
" <td>-0.000324</td>\n",
" <td>-0.003270</td>\n",
" <td>-0.003369</td>\n",
" <td>...</td>\n",
" <td>-0.001176</td>\n",
" <td>-0.000032</td>\n",
" <td>-0.010128</td>\n",
" <td>-0.000098</td>\n",
" <td>-0.001854</td>\n",
" <td>-0.011731</td>\n",
" <td>-0.000059</td>\n",
" <td>1.000000</td>\n",
" <td>-0.005821</td>\n",
" <td>-0.000285</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Calls_within_60min</th>\n",
" <td>-0.063448</td>\n",
" <td>-0.141139</td>\n",
" <td>-0.103255</td>\n",
" <td>0.003804</td>\n",
" <td>0.001338</td>\n",
" <td>-0.014102</td>\n",
" <td>-0.034515</td>\n",
" <td>0.007397</td>\n",
" <td>-0.079658</td>\n",
" <td>0.098320</td>\n",
" <td>...</td>\n",
" <td>0.026647</td>\n",
" <td>0.001828</td>\n",
" <td>0.156972</td>\n",
" <td>-0.000327</td>\n",
" <td>-0.008161</td>\n",
" <td>-0.208504</td>\n",
" <td>-0.001780</td>\n",
" <td>-0.005821</td>\n",
" <td>1.000000</td>\n",
" <td>0.281952</td>\n",
" </tr>\n",
" <tr>\n",
" <th>Minutes from midnight</th>\n",
" <td>-0.020181</td>\n",
" <td>0.021892</td>\n",
" <td>0.001108</td>\n",
" <td>0.038681</td>\n",
" <td>0.004601</td>\n",
" <td>-0.000224</td>\n",
" <td>-0.004137</td>\n",
" <td>0.009556</td>\n",
" <td>0.013434</td>\n",
" <td>-0.064028</td>\n",
" <td>...</td>\n",
" <td>0.018034</td>\n",
" <td>0.001674</td>\n",
" <td>-0.006654</td>\n",
" <td>0.002256</td>\n",
" <td>0.016699</td>\n",
" <td>0.034033</td>\n",
" <td>0.001043</td>\n",
" <td>-0.000285</td>\n",
" <td>0.281952</td>\n",
" <td>1.000000</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"<p>37 rows × 37 columns</p>\n",
"</div>"
],
"text/plain": [
" Response Minutes Blocked Driveway \\\n",
"Response Minutes 1.000000 0.017669 \n",
"Blocked Driveway 0.017669 1.000000 \n",
"Derelict Vehicle 0.127927 -0.106157 \n",
"Disorderly Youth -0.003624 -0.030068 \n",
"Drinking 0.000443 -0.031344 \n",
"Graffiti 0.003661 -0.014628 \n",
"Homeless Encampment 0.002223 -0.036441 \n",
"Illegal Fireworks 0.000611 -0.012408 \n",
"Illegal Parking 0.008752 -0.125174 \n",
"Noise - Commercial -0.038640 -0.128956 \n",
"Noise - House of Worship -0.008410 -0.028710 \n",
"Noise - Park -0.011096 -0.041050 \n",
"Noise - Residential -0.035660 -0.378187 \n",
"Noise - Street/Sidewalk -0.027430 -0.119465 \n",
"Noise - Vehicle -0.013517 -0.102336 \n",
"Non-Emergency Police Matter 0.002573 -0.052953 \n",
"Panhandling -0.001010 -0.010032 \n",
"Posting Advertisement -0.000017 -0.016442 \n",
"Squeegee -0.000001 -0.002433 \n",
"Traffic -0.003506 -0.039177 \n",
"Traffic/Illegal Parking 0.009380 -0.104543 \n",
"Urinating in Public -0.003777 -0.016306 \n",
"Vending -0.002135 -0.056687 \n",
"Bridge -0.000617 -0.001216 \n",
"Club/Bar/Restaurant -0.035647 -0.113031 \n",
"Highway 0.000440 -0.012408 \n",
"House of Worship -0.008410 -0.028710 \n",
"Park/Playground -0.010858 -0.045020 \n",
"Pier -0.001052 -0.001216 \n",
"Residential Building/House -0.034525 -0.387717 \n",
"Roadway Tunnel -0.000271 -0.003749 \n",
"Store/Commercial -0.011474 -0.070963 \n",
"Street/Sidewalk 0.056871 0.469488 \n",
"Subway Station -0.001119 -0.002276 \n",
"Vacant Lot 0.013914 -0.005507 \n",
"Calls_within_60min -0.063448 -0.141139 \n",
"Minutes from midnight -0.020181 0.021892 \n",
"\n",
" Derelict Vehicle Disorderly Youth Drinking \\\n",
"Response Minutes 0.127927 -0.003624 0.000443 \n",
"Blocked Driveway -0.106157 -0.030068 -0.031344 \n",
"Derelict Vehicle 1.000000 -0.015139 -0.015782 \n",
"Disorderly Youth -0.015139 1.000000 -0.004470 \n",
"Drinking -0.015782 -0.004470 1.000000 \n",
"Graffiti -0.007365 -0.002086 -0.002175 \n",
"Homeless Encampment -0.018348 -0.005197 -0.005417 \n",
"Illegal Fireworks -0.006248 -0.001770 -0.001845 \n",
"Illegal Parking -0.063025 -0.017851 -0.018609 \n",
"Noise - Commercial -0.064930 -0.018391 -0.019171 \n",
"Noise - House of Worship -0.014456 -0.004094 -0.004268 \n",
"Noise - Park -0.020669 -0.005854 -0.006103 \n",
"Noise - Residential -0.190418 -0.053934 -0.056223 \n",
"Noise - Street/Sidewalk -0.060151 -0.017037 -0.017760 \n",
"Noise - Vehicle -0.051526 -0.014594 -0.015214 \n",
"Non-Emergency Police Matter -0.026662 -0.007552 -0.007872 \n",
"Panhandling -0.005051 -0.001431 -0.001491 \n",
"Posting Advertisement -0.008279 -0.002345 -0.002444 \n",
"Squeegee -0.001225 -0.000347 -0.000362 \n",
"Traffic -0.019726 -0.005587 -0.005824 \n",
"Traffic/Illegal Parking -0.052637 -0.014909 -0.015542 \n",
"Urinating in Public -0.008210 -0.002325 -0.002424 \n",
"Vending -0.028542 -0.008084 -0.008427 \n",
"Bridge -0.000612 -0.000173 -0.000181 \n",
"Club/Bar/Restaurant -0.056911 -0.016119 0.123131 \n",
"Highway 0.003816 -0.001770 -0.001845 \n",
"House of Worship -0.014456 -0.004094 -0.004268 \n",
"Park/Playground -0.022668 -0.006420 0.033185 \n",
"Pier -0.000612 -0.000173 -0.000181 \n",
"Residential Building/House -0.195216 -0.010866 -0.035537 \n",
"Roadway Tunnel 0.002029 -0.000535 -0.000557 \n",
"Store/Commercial -0.035730 0.016972 0.004502 \n",
"Street/Sidewalk 0.234470 0.014964 -0.029265 \n",
"Subway Station -0.001146 -0.000325 -0.000338 \n",
"Vacant Lot 0.051880 -0.000785 -0.000819 \n",
"Calls_within_60min -0.103255 0.003804 0.001338 \n",
"Minutes from midnight 0.001108 0.038681 0.004601 \n",
"\n",
" Graffiti Homeless Encampment Illegal Fireworks \\\n",
"Response Minutes 0.003661 0.002223 0.000611 \n",
"Blocked Driveway -0.014628 -0.036441 -0.012408 \n",
"Derelict Vehicle -0.007365 -0.018348 -0.006248 \n",
"Disorderly Youth -0.002086 -0.005197 -0.001770 \n",
"Drinking -0.002175 -0.005417 -0.001845 \n",
"Graffiti 1.000000 -0.002528 -0.000861 \n",
"Homeless Encampment -0.002528 1.000000 -0.002145 \n",
"Illegal Fireworks -0.000861 -0.002145 1.000000 \n",
"Illegal Parking -0.008685 -0.021635 -0.007367 \n",
"Noise - Commercial -0.008947 -0.022289 -0.007589 \n",
"Noise - House of Worship -0.001992 -0.004962 -0.001690 \n",
"Noise - Park -0.002848 -0.007095 -0.002416 \n",
"Noise - Residential -0.026240 -0.065365 -0.022258 \n",
"Noise - Street/Sidewalk -0.008289 -0.020648 -0.007031 \n",
"Noise - Vehicle -0.007100 -0.017688 -0.006023 \n",
"Non-Emergency Police Matter -0.003674 -0.009152 -0.003116 \n",
"Panhandling -0.000696 -0.001734 -0.000590 \n",
"Posting Advertisement -0.001141 -0.002842 -0.000968 \n",
"Squeegee -0.000169 -0.000420 -0.000143 \n",
"Traffic -0.002718 -0.006771 -0.002306 \n",
"Traffic/Illegal Parking -0.007253 -0.018069 -0.006153 \n",
"Urinating in Public -0.001131 -0.002818 -0.000960 \n",
"Vending -0.003933 -0.009798 -0.003336 \n",
"Bridge -0.000084 0.033378 -0.000072 \n",
"Club/Bar/Restaurant -0.007842 -0.019536 -0.006652 \n",
"Highway -0.000861 0.020919 -0.000730 \n",
"House of Worship -0.001992 -0.004962 -0.001690 \n",
"Park/Playground -0.003124 0.065053 0.012066 \n",
"Pier -0.000084 -0.000210 0.098023 \n",
"Residential Building/House 0.009775 -0.011059 -0.009113 \n",
"Roadway Tunnel -0.000260 0.010250 -0.000221 \n",
"Store/Commercial 0.052042 0.054342 -0.000733 \n",
"Street/Sidewalk -0.020793 -0.009894 0.009697 \n",
"Subway Station -0.000158 -0.000393 -0.000134 \n",
"Vacant Lot -0.000382 -0.000952 -0.000324 \n",
"Calls_within_60min -0.014102 -0.034515 0.007397 \n",
"Minutes from midnight -0.000224 -0.004137 0.009556 \n",
"\n",
" Illegal Parking Noise - Commercial \\\n",
"Response Minutes 0.008752 -0.038640 \n",
"Blocked Driveway -0.125174 -0.128956 \n",
"Derelict Vehicle -0.063025 -0.064930 \n",
"Disorderly Youth -0.017851 -0.018391 \n",
"Drinking -0.018609 -0.019171 \n",
"Graffiti -0.008685 -0.008947 \n",
"Homeless Encampment -0.021635 -0.022289 \n",
"Illegal Fireworks -0.007367 -0.007589 \n",
"Illegal Parking 1.000000 -0.076561 \n",
"Noise - Commercial -0.076561 1.000000 \n",
"Noise - House of Worship -0.017045 -0.017560 \n",
"Noise - Park -0.024371 -0.025108 \n",
"Noise - Residential -0.224530 -0.231313 \n",
"Noise - Street/Sidewalk -0.070926 -0.073069 \n",
"Noise - Vehicle -0.060757 -0.062592 \n",
"Non-Emergency Police Matter -0.031438 -0.032388 \n",
"Panhandling -0.005956 -0.006136 \n",
"Posting Advertisement -0.009762 -0.010056 \n",
"Squeegee -0.001444 -0.001488 \n",
"Traffic -0.023260 -0.023962 \n",
"Traffic/Illegal Parking -0.062067 -0.063942 \n",
"Urinating in Public -0.009681 -0.009973 \n",
"Vending -0.033655 -0.034672 \n",
"Bridge -0.000722 -0.000744 \n",
"Club/Bar/Restaurant -0.067106 0.839344 \n",
"Highway -0.007367 -0.007589 \n",
"House of Worship -0.017045 -0.017560 \n",
"Park/Playground -0.026729 -0.027536 \n",
"Pier -0.000722 -0.000744 \n",
"Residential Building/House -0.230187 -0.237142 \n",
"Roadway Tunnel -0.002226 -0.002293 \n",
"Store/Commercial -0.042131 0.420281 \n",
"Street/Sidewalk 0.278735 -0.274673 \n",
"Subway Station -0.001351 -0.001392 \n",
"Vacant Lot -0.003270 -0.003369 \n",
"Calls_within_60min -0.079658 0.098320 \n",
"Minutes from midnight 0.013434 -0.064028 \n",
"\n",
" ... Park/Playground Pier \\\n",
"Response Minutes ... -0.010858 -0.001052 \n",
"Blocked Driveway ... -0.045020 -0.001216 \n",
"Derelict Vehicle ... -0.022668 -0.000612 \n",
"Disorderly Youth ... -0.006420 -0.000173 \n",
"Drinking ... 0.033185 -0.000181 \n",
"Graffiti ... -0.003124 -0.000084 \n",
"Homeless Encampment ... 0.065053 -0.000210 \n",
"Illegal Fireworks ... 0.012066 0.098023 \n",
"Illegal Parking ... -0.026729 -0.000722 \n",
"Noise - Commercial ... -0.027536 -0.000744 \n",
"Noise - House of Worship ... -0.006131 -0.000166 \n",
"Noise - Park ... 0.911802 -0.000237 \n",
"Noise - Residential ... -0.080755 -0.002182 \n",
"Noise - Street/Sidewalk ... -0.025510 -0.000689 \n",
"Noise - Vehicle ... -0.021852 -0.000590 \n",
"Non-Emergency Police Matter ... 0.003295 -0.000305 \n",
"Panhandling ... 0.001166 -0.000058 \n",
"Posting Advertisement ... -0.003511 -0.000095 \n",
"Squeegee ... -0.000519 -0.000014 \n",
"Traffic ... -0.008366 -0.000226 \n",
"Traffic/Illegal Parking ... -0.022323 -0.000603 \n",
"Urinating in Public ... 0.016890 -0.000094 \n",
"Vending ... 0.029785 -0.000327 \n",
"Bridge ... -0.000260 -0.000007 \n",
"Club/Bar/Restaurant ... -0.024136 -0.000652 \n",
"Highway ... -0.002650 -0.000072 \n",
"House of Worship ... -0.006131 -0.000166 \n",
"Park/Playground ... 1.000000 -0.000260 \n",
"Pier ... -0.000260 1.000000 \n",
"Residential Building/House ... -0.082790 -0.002237 \n",
"Roadway Tunnel ... -0.000801 -0.000022 \n",
"Store/Commercial ... -0.015153 -0.000409 \n",
"Street/Sidewalk ... -0.095893 -0.002591 \n",
"Subway Station ... -0.000486 -0.000013 \n",
"Vacant Lot ... -0.001176 -0.000032 \n",
"Calls_within_60min ... 0.026647 0.001828 \n",
"Minutes from midnight ... 0.018034 0.001674 \n",
"\n",
" Residential Building/House Roadway Tunnel \\\n",
"Response Minutes -0.034525 -0.000271 \n",
"Blocked Driveway -0.387717 -0.003749 \n",
"Derelict Vehicle -0.195216 0.002029 \n",
"Disorderly Youth -0.010866 -0.000535 \n",
"Drinking -0.035537 -0.000557 \n",
"Graffiti 0.009775 -0.000260 \n",
"Homeless Encampment -0.011059 0.010250 \n",
"Illegal Fireworks -0.009113 -0.000221 \n",
"Illegal Parking -0.230187 -0.002226 \n",
"Noise - Commercial -0.237142 -0.002293 \n",
"Noise - House of Worship -0.052796 -0.000511 \n",
"Noise - Park -0.075488 -0.000730 \n",
"Noise - Residential 0.975422 -0.006725 \n",
"Noise - Street/Sidewalk -0.219689 -0.002124 \n",
"Noise - Vehicle -0.188190 -0.001820 \n",
"Non-Emergency Police Matter -0.011513 -0.000942 \n",
"Panhandling -0.014864 -0.000178 \n",
"Posting Advertisement 0.000613 -0.000292 \n",
"Squeegee -0.004473 -0.000043 \n",
"Traffic -0.072045 0.055108 \n",
"Traffic/Illegal Parking -0.192248 0.006082 \n",
"Urinating in Public -0.000888 -0.000290 \n",
"Vending -0.089202 -0.001008 \n",
"Bridge -0.002237 -0.000022 \n",
"Club/Bar/Restaurant -0.207857 -0.002010 \n",
"Highway -0.022818 -0.000221 \n",
"House of Worship -0.052796 -0.000511 \n",
"Park/Playground -0.082790 -0.000801 \n",
"Pier -0.002237 -0.000022 \n",
"Residential Building/House 1.000000 -0.006894 \n",
"Roadway Tunnel -0.006894 1.000000 \n",
"Store/Commercial -0.130496 -0.001262 \n",
"Street/Sidewalk -0.825829 -0.007985 \n",
"Subway Station -0.004185 -0.000040 \n",
"Vacant Lot -0.010128 -0.000098 \n",
"Calls_within_60min 0.156972 -0.000327 \n",
"Minutes from midnight -0.006654 0.002256 \n",
"\n",
" Store/Commercial Street/Sidewalk \\\n",
"Response Minutes -0.011474 0.056871 \n",
"Blocked Driveway -0.070963 0.469488 \n",
"Derelict Vehicle -0.035730 0.234470 \n",
"Disorderly Youth 0.016972 0.014964 \n",
"Drinking 0.004502 -0.029265 \n",
"Graffiti 0.052042 -0.020793 \n",
"Homeless Encampment 0.054342 -0.009894 \n",
"Illegal Fireworks -0.000733 0.009697 \n",
"Illegal Parking -0.042131 0.278735 \n",
"Noise - Commercial 0.420281 -0.274673 \n",
"Noise - House of Worship -0.009663 -0.061152 \n",
"Noise - Park -0.013816 -0.087435 \n",
"Noise - Residential -0.127289 -0.805532 \n",
"Noise - Street/Sidewalk -0.040209 0.266023 \n",
"Noise - Vehicle -0.034444 0.227880 \n",
"Non-Emergency Police Matter 0.042630 0.012152 \n",
"Panhandling 0.041326 0.004664 \n",
"Posting Advertisement 0.008115 0.000501 \n",
"Squeegee -0.000819 0.005417 \n",
"Traffic -0.013186 0.077960 \n",
"Traffic/Illegal Parking -0.035187 0.230200 \n",
"Urinating in Public 0.012206 -0.005246 \n",
"Vending 0.095989 0.068512 \n",
"Bridge -0.000409 -0.002591 \n",
"Club/Bar/Restaurant -0.038044 -0.240753 \n",
"Highway -0.004176 -0.026430 \n",
"House of Worship -0.009663 -0.061152 \n",
"Park/Playground -0.015153 -0.095893 \n",
"Pier -0.000409 -0.002591 \n",
"Residential Building/House -0.130496 -0.825829 \n",
"Roadway Tunnel -0.001262 -0.007985 \n",
"Store/Commercial 1.000000 -0.151149 \n",
"Street/Sidewalk -0.151149 1.000000 \n",
"Subway Station -0.000766 -0.004847 \n",
"Vacant Lot -0.001854 -0.011731 \n",
"Calls_within_60min -0.008161 -0.208504 \n",
"Minutes from midnight 0.016699 0.034033 \n",
"\n",
" Subway Station Vacant Lot Calls_within_60min \\\n",
"Response Minutes -0.001119 0.013914 -0.063448 \n",
"Blocked Driveway -0.002276 -0.005507 -0.141139 \n",
"Derelict Vehicle -0.001146 0.051880 -0.103255 \n",
"Disorderly Youth -0.000325 -0.000785 0.003804 \n",
"Drinking -0.000338 -0.000819 0.001338 \n",
"Graffiti -0.000158 -0.000382 -0.014102 \n",
"Homeless Encampment -0.000393 -0.000952 -0.034515 \n",
"Illegal Fireworks -0.000134 -0.000324 0.007397 \n",
"Illegal Parking -0.001351 -0.003270 -0.079658 \n",
"Noise - Commercial -0.001392 -0.003369 0.098320 \n",
"Noise - House of Worship -0.000310 -0.000750 0.017869 \n",
"Noise - Park -0.000443 -0.001072 0.034193 \n",
"Noise - Residential -0.004082 -0.009879 0.163839 \n",
"Noise - Street/Sidewalk -0.001289 -0.003121 0.069543 \n",
"Noise - Vehicle -0.001104 -0.002673 0.014735 \n",
"Non-Emergency Police Matter -0.000572 -0.001383 -0.036119 \n",
"Panhandling -0.000108 -0.000262 -0.003299 \n",
"Posting Advertisement -0.000177 -0.000429 -0.014175 \n",
"Squeegee -0.000026 -0.000064 -0.001964 \n",
"Traffic -0.000423 -0.001023 -0.028631 \n",
"Traffic/Illegal Parking -0.001128 -0.002731 -0.083971 \n",
"Urinating in Public 0.139551 -0.000426 -0.007046 \n",
"Vending -0.000612 -0.001481 -0.043701 \n",
"Bridge -0.000013 -0.000032 -0.002557 \n",
"Club/Bar/Restaurant -0.001220 -0.002953 0.106818 \n",
"Highway -0.000134 -0.000324 -0.011999 \n",
"House of Worship -0.000310 -0.000750 0.017869 \n",
"Park/Playground -0.000486 -0.001176 0.026647 \n",
"Pier -0.000013 -0.000032 0.001828 \n",
"Residential Building/House -0.004185 -0.010128 0.156972 \n",
"Roadway Tunnel -0.000040 -0.000098 -0.000327 \n",
"Store/Commercial -0.000766 -0.001854 -0.008161 \n",
"Street/Sidewalk -0.004847 -0.011731 -0.208504 \n",
"Subway Station 1.000000 -0.000059 -0.001780 \n",
"Vacant Lot -0.000059 1.000000 -0.005821 \n",
"Calls_within_60min -0.001780 -0.005821 1.000000 \n",
"Minutes from midnight 0.001043 -0.000285 0.281952 \n",
"\n",
" Minutes from midnight \n",
"Response Minutes -0.020181 \n",
"Blocked Driveway 0.021892 \n",
"Derelict Vehicle 0.001108 \n",
"Disorderly Youth 0.038681 \n",
"Drinking 0.004601 \n",
"Graffiti -0.000224 \n",
"Homeless Encampment -0.004137 \n",
"Illegal Fireworks 0.009556 \n",
"Illegal Parking 0.013434 \n",
"Noise - Commercial -0.064028 \n",
"Noise - House of Worship 0.019135 \n",
"Noise - Park 0.019035 \n",
"Noise - Residential -0.010872 \n",
"Noise - Street/Sidewalk -0.005228 \n",
"Noise - Vehicle 0.001113 \n",
"Non-Emergency Police Matter 0.015610 \n",
"Panhandling 0.004274 \n",
"Posting Advertisement 0.002706 \n",
"Squeegee -0.000094 \n",
"Traffic 0.008506 \n",
"Traffic/Illegal Parking 0.008281 \n",
"Urinating in Public 0.001344 \n",
"Vending 0.003756 \n",
"Bridge -0.001908 \n",
"Club/Bar/Restaurant -0.082735 \n",
"Highway -0.000737 \n",
"House of Worship 0.019135 \n",
"Park/Playground 0.018034 \n",
"Pier 0.001674 \n",
"Residential Building/House -0.006654 \n",
"Roadway Tunnel 0.002256 \n",
"Store/Commercial 0.016699 \n",
"Street/Sidewalk 0.034033 \n",
"Subway Station 0.001043 \n",
"Vacant Lot -0.000285 \n",
"Calls_within_60min 0.281952 \n",
"Minutes from midnight 1.000000 \n",
"\n",
"[37 rows x 37 columns]"
]
},
"execution_count": 35,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"df.corr()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Using a PCA package which uses Singular Value Decomposition, and setting the number of components to two. We get an explained variance ratio:"
]
},
{
"cell_type": "code",
"execution_count": 38,
"metadata": {
"collapsed": false,
"scrolled": true
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"[ 0.67436813 0.32419482]\n"
]
}
],
"source": [
"print(pca2.explained_variance_ratio_) "
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Setting the number of components to three and four respectively, we get the following explained variance ratio. It seems that the third component isn't explaining away much variance."
]
},
{
"cell_type": "code",
"execution_count": 44,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"[ 0.67436813 0.32419482 0.00143254]\n"
]
}
],
"source": [
"print (pca3.explained_variance_ratio_)"
]
},
{
"cell_type": "code",
"execution_count": 46,
"metadata": {
"collapsed": false,
"scrolled": true
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"[ 6.74368126e-01 3.24194818e-01 1.43254097e-03 2.32313371e-06]\n"
]
}
],
"source": [
"print (pca4.explained_variance_ratio_)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Using built-in Maximum Likelihood method to figure out number of principle components. 36 principal componenets were suggested. The list of explained variance ratio show that the amount of variance explained by each PCs gets progressively smaller."
]
},
{
"cell_type": "code",
"execution_count": 49,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/plain": [
"array([ 6.74368126e-01, 3.24194818e-01, 1.43254097e-03,\n",
" 2.32313371e-06, 5.70782597e-07, 4.22375178e-07,\n",
" 2.24319347e-07, 1.92383410e-07, 1.68657285e-07,\n",
" 1.61496879e-07, 1.09203348e-07, 7.42297189e-08,\n",
" 5.52029430e-08, 4.94458469e-08, 3.15116987e-08,\n",
" 2.77667122e-08, 2.47429238e-08, 1.85025224e-08,\n",
" 1.64346983e-08, 1.37627096e-08, 7.79067572e-09,\n",
" 4.84022679e-09, 4.31330753e-09, 3.61228678e-09,\n",
" 2.99865259e-09, 2.58605241e-09, 2.44425784e-09,\n",
" 1.68306077e-09, 5.66537866e-10, 2.56231763e-10,\n",
" 2.48606572e-10, 9.26919195e-11, 9.21059257e-11,\n",
" 3.02404688e-11, 2.36970533e-11, 7.41646522e-12])"
]
},
"execution_count": 49,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"pca_mle.explained_variance_ratio_"
]
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 2",
"language": "python",
"name": "python2"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 2
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython2",
"version": "2.7.11"
}
},
"nbformat": 4,
"nbformat_minor": 0
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment