Created
August 6, 2019 21:55
-
-
Save rezapci/b9d384dc08c2375fcb37580c96a04df1 to your computer and use it in GitHub Desktop.
Created on Cognitive Class Labs
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
{ | |
"cells": [ | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"<a href=\"https://cognitiveclass.ai\"><img src = \"https://ibm.box.com/shared/static/9gegpsmnsoo25ikkbl4qzlvlyjbgxs5x.png\" width = 400> </a>\n", | |
"\n", | |
"<h1 align=center><font size = 5>Learning FourSquare API with Python</font></h1>\n", | |
"\n", | |
"| Name | Description | Date\n", | |
"| :- |-------------: | :-:\n", | |
"|Reza Hashemi| IBM Applied Data Science Capstone. | On 6th of August 2019" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
" " | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"## Introduction\n", | |
"\n", | |
"In this lab, I will demostrate in details how to make calls to the Foursquare API for different purposes. lets see how to construct a URL to send a request to the API to search for a specific type of venues, to explore a particular venue, to explore a Foursquare user, to explore a geographical location, and to get trending venues around a location. Also, you can learn how to use the visualization library, Folium, to visualize the results." | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"## Table of Contents\n", | |
"\n", | |
"1. <a href=\"#item1\">Foursquare API Search Function</a>\n", | |
"2. <a href=\"#item2\">Explore a Given Venue</a> \n", | |
"3. <a href=\"#item3\">Explore a User</a> \n", | |
"4. <a href=\"#item4\">Foursquare API Explore Function</a> \n", | |
"5. <a href=\"#item5\">Get Trending Venues</a> " | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"### Import necessary Libraries" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 67, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"name": "stdout", | |
"output_type": "stream", | |
"text": [ | |
"Folium installed\n", | |
"Libraries imported.\n" | |
] | |
} | |
], | |
"source": [ | |
"import requests # library to handle requests\n", | |
"import pandas as pd # library for data analsysis\n", | |
"import numpy as np # library to handle data in a vectorized manner\n", | |
"import random # library for random number generation\n", | |
"\n", | |
"# !conda install -c conda-forge geopy --yes \n", | |
"from geopy.geocoders import Nominatim # module to convert an address into latitude and longitude values\n", | |
"\n", | |
"# libraries for displaying images\n", | |
"from IPython.display import Image \n", | |
"from IPython.core.display import HTML \n", | |
" \n", | |
"# tranforming json file into a pandas dataframe library\n", | |
"from pandas.io.json import json_normalize\n", | |
"\n", | |
"# !conda install -c conda-forge folium=0.5.0 --yes\n", | |
"import folium # plotting library\n", | |
"\n", | |
"print('Folium installed')\n", | |
"print('Libraries imported.')" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"### Define Foursquare Credentials and Version" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"##### Making sure that i have created a Foursquare developer account and have my credentials handy" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 68, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"name": "stdout", | |
"output_type": "stream", | |
"text": [ | |
"Your credentails:\n", | |
"CLIENT_ID: RJRNPM53LPRPIQT1ZC2YQTVSLJ3CP3LXE3CRH0DVCO0LODOL\n", | |
"CLIENT_SECRET:XIADFIC2V4FL453CQEM0S22EMIGSXTYRUF5RS4E2XX40KKO3\n" | |
] | |
} | |
], | |
"source": [ | |
"CLIENT_ID = 'RJRNPM53LPRPIQT1ZC2YQTVSLJ3CP3LXE3CRH0DVCO0LODOL' # your Foursquare ID\n", | |
"CLIENT_SECRET = 'XIADFIC2V4FL453CQEM0S22EMIGSXTYRUF5RS4E2XX40KKO3' # your Foursquare Secret\n", | |
"VERSION = '20180604'\n", | |
"LIMIT = 30\n", | |
"print('Your credentails:')\n", | |
"print('CLIENT_ID: ' + CLIENT_ID)\n", | |
"print('CLIENT_SECRET:' + CLIENT_SECRET)" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
" " | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Let's again assume that you are staying at the Conrad hotel. So let's start by converting the Contrad Hotel's address to its latitude and longitude coordinates." | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": {}, | |
"source": [ | |
"In order to define an instance of the geocoder, we need to define a user_agent. We will name our agent <em>foursquare_agent</em>, as shown below." | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 69, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"name": "stdout", | |
"output_type": "stream", | |
"text": [ | |
"40.7149555 -74.0153365\n" | |
] | |
} | |
], | |
"source": [ | |
"address = '102 North End Ave, New York, NY'\n", | |
"\n", | |
"geolocator = Nominatim(user_agent=\"foursquare_agent\")\n", | |
"location = geolocator.geocode(address)\n", | |
"latitude = location.latitude\n", | |
"longitude = location.longitude\n", | |
"print(latitude, longitude)" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
" " | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"<a id=\"item1\"></a>" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"## 1. Search for a specific venue category\n", | |
"> `https://api.foursquare.com/v2/venues/`**search**`?client_id=`**CLIENT_ID**`&client_secret=`**CLIENT_SECRET**`&ll=`**LATITUDE**`,`**LONGITUDE**`&v=`**VERSION**`&query=`**QUERY**`&radius=`**RADIUS**`&limit=`**LIMIT**" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Now, let's assume that it is lunch time, and you are craving Italian food. So, let's define a query to search for Italian food that is within 500 metres from the Conrad Hotel. " | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 70, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
}, | |
"scrolled": true | |
}, | |
"outputs": [ | |
{ | |
"name": "stdout", | |
"output_type": "stream", | |
"text": [ | |
"Italian .... OK!\n" | |
] | |
} | |
], | |
"source": [ | |
"search_query = 'Italian'\n", | |
"radius = 500\n", | |
"print(search_query + ' .... OK!')" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Define the corresponding URL" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 71, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"'https://api.foursquare.com/v2/venues/search?client_id=RJRNPM53LPRPIQT1ZC2YQTVSLJ3CP3LXE3CRH0DVCO0LODOL&client_secret=XIADFIC2V4FL453CQEM0S22EMIGSXTYRUF5RS4E2XX40KKO3&ll=40.7149555,-74.0153365&v=20180604&query=Italian&radius=500&limit=30'" | |
] | |
}, | |
"execution_count": 71, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"url = 'https://api.foursquare.com/v2/venues/search?client_id={}&client_secret={}&ll={},{}&v={}&query={}&radius={}&limit={}'.format(CLIENT_ID, CLIENT_SECRET, latitude, longitude, VERSION, search_query, radius, LIMIT)\n", | |
"url" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Send the GET Request and examine the results" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 72, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
}, | |
"scrolled": true | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"{'meta': {'code': 200, 'requestId': '5d49f4318ad62e0039e484be'},\n", | |
" 'response': {'venues': [{'id': '4fa862b3e4b0ebff2f749f06',\n", | |
" 'name': \"Harry's Italian Pizza Bar\",\n", | |
" 'location': {'address': '225 Murray St',\n", | |
" 'lat': 40.71521779064671,\n", | |
" 'lng': -74.01473940209351,\n", | |
" 'labeledLatLngs': [{'label': 'display',\n", | |
" 'lat': 40.71521779064671,\n", | |
" 'lng': -74.01473940209351}],\n", | |
" 'distance': 58,\n", | |
" 'postalCode': '10282',\n", | |
" 'cc': 'US',\n", | |
" 'city': 'New York',\n", | |
" 'state': 'NY',\n", | |
" 'country': 'United States',\n", | |
" 'formattedAddress': ['225 Murray St',\n", | |
" 'New York, NY 10282',\n", | |
" 'United States']},\n", | |
" 'categories': [{'id': '4bf58dd8d48988d1ca941735',\n", | |
" 'name': 'Pizza Place',\n", | |
" 'pluralName': 'Pizza Places',\n", | |
" 'shortName': 'Pizza',\n", | |
" 'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/pizza_',\n", | |
" 'suffix': '.png'},\n", | |
" 'primary': True}],\n", | |
" 'delivery': {'id': '294544',\n", | |
" 'url': 'https://www.seamless.com/menu/harrys-italian-pizza-bar-225-murray-st-new-york/294544?affiliate=1131&utm_source=foursquare-affiliate-network&utm_medium=affiliate&utm_campaign=1131&utm_content=294544',\n", | |
" 'provider': {'name': 'seamless',\n", | |
" 'icon': {'prefix': 'https://fastly.4sqi.net/img/general/cap/',\n", | |
" 'sizes': [40, 50],\n", | |
" 'name': '/delivery_provider_seamless_20180129.png'}}},\n", | |
" 'referralId': 'v-1565127729',\n", | |
" 'hasPerk': False},\n", | |
" {'id': '4f3232e219836c91c7bfde94',\n", | |
" 'name': 'Conca Cucina Italian Restaurant',\n", | |
" 'location': {'address': '63 W Broadway',\n", | |
" 'lat': 40.71446,\n", | |
" 'lng': -74.010086,\n", | |
" 'labeledLatLngs': [{'label': 'display',\n", | |
" 'lat': 40.71446,\n", | |
" 'lng': -74.010086}],\n", | |
" 'distance': 446,\n", | |
" 'postalCode': '10007',\n", | |
" 'cc': 'US',\n", | |
" 'city': 'New York',\n", | |
" 'state': 'NY',\n", | |
" 'country': 'United States',\n", | |
" 'formattedAddress': ['63 W Broadway',\n", | |
" 'New York, NY 10007',\n", | |
" 'United States']},\n", | |
" 'categories': [{'id': '4d4b7105d754a06374d81259',\n", | |
" 'name': 'Food',\n", | |
" 'pluralName': 'Food',\n", | |
" 'shortName': 'Food',\n", | |
" 'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/default_',\n", | |
" 'suffix': '.png'},\n", | |
" 'primary': True}],\n", | |
" 'referralId': 'v-1565127729',\n", | |
" 'hasPerk': False},\n", | |
" {'id': '3fd66200f964a520f4e41ee3',\n", | |
" 'name': 'Ecco',\n", | |
" 'location': {'address': '124 Chambers St',\n", | |
" 'crossStreet': 'btwn Church St & W Broadway',\n", | |
" 'lat': 40.71533713859952,\n", | |
" 'lng': -74.00884766217825,\n", | |
" 'labeledLatLngs': [{'label': 'display',\n", | |
" 'lat': 40.71533713859952,\n", | |
" 'lng': -74.00884766217825}],\n", | |
" 'distance': 549,\n", | |
" 'postalCode': '10007',\n", | |
" 'cc': 'US',\n", | |
" 'city': 'New York',\n", | |
" 'state': 'NY',\n", | |
" 'country': 'United States',\n", | |
" 'formattedAddress': ['124 Chambers St (btwn Church St & W Broadway)',\n", | |
" 'New York, NY 10007',\n", | |
" 'United States']},\n", | |
" 'categories': [{'id': '4bf58dd8d48988d110941735',\n", | |
" 'name': 'Italian Restaurant',\n", | |
" 'pluralName': 'Italian Restaurants',\n", | |
" 'shortName': 'Italian',\n", | |
" 'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/italian_',\n", | |
" 'suffix': '.png'},\n", | |
" 'primary': True}],\n", | |
" 'referralId': 'v-1565127729',\n", | |
" 'hasPerk': False}]}}" | |
] | |
}, | |
"execution_count": 72, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"results = requests.get(url).json()\n", | |
"results" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Get relevant part of JSON and transform it into a *pandas* dataframe" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 73, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/html": [ | |
"<div>\n", | |
"<style scoped>\n", | |
" .dataframe tbody tr th:only-of-type {\n", | |
" vertical-align: middle;\n", | |
" }\n", | |
"\n", | |
" .dataframe tbody tr th {\n", | |
" vertical-align: top;\n", | |
" }\n", | |
"\n", | |
" .dataframe thead th {\n", | |
" text-align: right;\n", | |
" }\n", | |
"</style>\n", | |
"<table border=\"1\" class=\"dataframe\">\n", | |
" <thead>\n", | |
" <tr style=\"text-align: right;\">\n", | |
" <th></th>\n", | |
" <th>id</th>\n", | |
" <th>name</th>\n", | |
" <th>categories</th>\n", | |
" <th>referralId</th>\n", | |
" <th>hasPerk</th>\n", | |
" <th>location.address</th>\n", | |
" <th>location.lat</th>\n", | |
" <th>location.lng</th>\n", | |
" <th>location.labeledLatLngs</th>\n", | |
" <th>location.distance</th>\n", | |
" <th>...</th>\n", | |
" <th>location.state</th>\n", | |
" <th>location.country</th>\n", | |
" <th>location.formattedAddress</th>\n", | |
" <th>delivery.id</th>\n", | |
" <th>delivery.url</th>\n", | |
" <th>delivery.provider.name</th>\n", | |
" <th>delivery.provider.icon.prefix</th>\n", | |
" <th>delivery.provider.icon.sizes</th>\n", | |
" <th>delivery.provider.icon.name</th>\n", | |
" <th>location.crossStreet</th>\n", | |
" </tr>\n", | |
" </thead>\n", | |
" <tbody>\n", | |
" <tr>\n", | |
" <th>0</th>\n", | |
" <td>4fa862b3e4b0ebff2f749f06</td>\n", | |
" <td>Harry's Italian Pizza Bar</td>\n", | |
" <td>[{'id': '4bf58dd8d48988d1ca941735', 'name': 'Pizza Place', 'pluralName': 'Pizza Places', 'shortName': 'Pizza', 'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/pizza_', 'suffix': '.png'}, 'primary': True}]</td>\n", | |
" <td>v-1565127729</td>\n", | |
" <td>False</td>\n", | |
" <td>225 Murray St</td>\n", | |
" <td>40.715218</td>\n", | |
" <td>-74.014739</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.71521779064671, 'lng': -74.01473940209351}]</td>\n", | |
" <td>58</td>\n", | |
" <td>...</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[225 Murray St, New York, NY 10282, United States]</td>\n", | |
" <td>294544</td>\n", | |
" <td>https://www.seamless.com/menu/harrys-italian-pizza-bar-225-murray-st-new-york/294544?affiliate=1131&utm_source=foursquare-affiliate-network&utm_medium=affiliate&utm_campaign=1131&utm_content=294544</td>\n", | |
" <td>seamless</td>\n", | |
" <td>https://fastly.4sqi.net/img/general/cap/</td>\n", | |
" <td>[40, 50]</td>\n", | |
" <td>/delivery_provider_seamless_20180129.png</td>\n", | |
" <td>NaN</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>1</th>\n", | |
" <td>4f3232e219836c91c7bfde94</td>\n", | |
" <td>Conca Cucina Italian Restaurant</td>\n", | |
" <td>[{'id': '4d4b7105d754a06374d81259', 'name': 'Food', 'pluralName': 'Food', 'shortName': 'Food', 'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/default_', 'suffix': '.png'}, 'primary': True}]</td>\n", | |
" <td>v-1565127729</td>\n", | |
" <td>False</td>\n", | |
" <td>63 W Broadway</td>\n", | |
" <td>40.714460</td>\n", | |
" <td>-74.010086</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.71446, 'lng': -74.010086}]</td>\n", | |
" <td>446</td>\n", | |
" <td>...</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[63 W Broadway, New York, NY 10007, United States]</td>\n", | |
" <td>NaN</td>\n", | |
" <td>NaN</td>\n", | |
" <td>NaN</td>\n", | |
" <td>NaN</td>\n", | |
" <td>NaN</td>\n", | |
" <td>NaN</td>\n", | |
" <td>NaN</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>2</th>\n", | |
" <td>3fd66200f964a520f4e41ee3</td>\n", | |
" <td>Ecco</td>\n", | |
" <td>[{'id': '4bf58dd8d48988d110941735', 'name': 'Italian Restaurant', 'pluralName': 'Italian Restaurants', 'shortName': 'Italian', 'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/italian_', 'suffix': '.png'}, 'primary': True}]</td>\n", | |
" <td>v-1565127729</td>\n", | |
" <td>False</td>\n", | |
" <td>124 Chambers St</td>\n", | |
" <td>40.715337</td>\n", | |
" <td>-74.008848</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.71533713859952, 'lng': -74.00884766217825}]</td>\n", | |
" <td>549</td>\n", | |
" <td>...</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[124 Chambers St (btwn Church St & W Broadway), New York, NY 10007, United States]</td>\n", | |
" <td>NaN</td>\n", | |
" <td>NaN</td>\n", | |
" <td>NaN</td>\n", | |
" <td>NaN</td>\n", | |
" <td>NaN</td>\n", | |
" <td>NaN</td>\n", | |
" <td>btwn Church St & W Broadway</td>\n", | |
" </tr>\n", | |
" </tbody>\n", | |
"</table>\n", | |
"<p>3 rows × 23 columns</p>\n", | |
"</div>" | |
], | |
"text/plain": [ | |
" id name \\\n", | |
"0 4fa862b3e4b0ebff2f749f06 Harry's Italian Pizza Bar \n", | |
"1 4f3232e219836c91c7bfde94 Conca Cucina Italian Restaurant \n", | |
"2 3fd66200f964a520f4e41ee3 Ecco \n", | |
"\n", | |
" categories \\\n", | |
"0 [{'id': '4bf58dd8d48988d1ca941735', 'name': 'Pizza Place', 'pluralName': 'Pizza Places', 'shortName': 'Pizza', 'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/pizza_', 'suffix': '.png'}, 'primary': True}] \n", | |
"1 [{'id': '4d4b7105d754a06374d81259', 'name': 'Food', 'pluralName': 'Food', 'shortName': 'Food', 'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/default_', 'suffix': '.png'}, 'primary': True}] \n", | |
"2 [{'id': '4bf58dd8d48988d110941735', 'name': 'Italian Restaurant', 'pluralName': 'Italian Restaurants', 'shortName': 'Italian', 'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/italian_', 'suffix': '.png'}, 'primary': True}] \n", | |
"\n", | |
" referralId hasPerk location.address location.lat location.lng \\\n", | |
"0 v-1565127729 False 225 Murray St 40.715218 -74.014739 \n", | |
"1 v-1565127729 False 63 W Broadway 40.714460 -74.010086 \n", | |
"2 v-1565127729 False 124 Chambers St 40.715337 -74.008848 \n", | |
"\n", | |
" location.labeledLatLngs \\\n", | |
"0 [{'label': 'display', 'lat': 40.71521779064671, 'lng': -74.01473940209351}] \n", | |
"1 [{'label': 'display', 'lat': 40.71446, 'lng': -74.010086}] \n", | |
"2 [{'label': 'display', 'lat': 40.71533713859952, 'lng': -74.00884766217825}] \n", | |
"\n", | |
" location.distance ... location.state location.country \\\n", | |
"0 58 ... NY United States \n", | |
"1 446 ... NY United States \n", | |
"2 549 ... NY United States \n", | |
"\n", | |
" location.formattedAddress \\\n", | |
"0 [225 Murray St, New York, NY 10282, United States] \n", | |
"1 [63 W Broadway, New York, NY 10007, United States] \n", | |
"2 [124 Chambers St (btwn Church St & W Broadway), New York, NY 10007, United States] \n", | |
"\n", | |
" delivery.id \\\n", | |
"0 294544 \n", | |
"1 NaN \n", | |
"2 NaN \n", | |
"\n", | |
" delivery.url \\\n", | |
"0 https://www.seamless.com/menu/harrys-italian-pizza-bar-225-murray-st-new-york/294544?affiliate=1131&utm_source=foursquare-affiliate-network&utm_medium=affiliate&utm_campaign=1131&utm_content=294544 \n", | |
"1 NaN \n", | |
"2 NaN \n", | |
"\n", | |
" delivery.provider.name delivery.provider.icon.prefix \\\n", | |
"0 seamless https://fastly.4sqi.net/img/general/cap/ \n", | |
"1 NaN NaN \n", | |
"2 NaN NaN \n", | |
"\n", | |
" delivery.provider.icon.sizes delivery.provider.icon.name \\\n", | |
"0 [40, 50] /delivery_provider_seamless_20180129.png \n", | |
"1 NaN NaN \n", | |
"2 NaN NaN \n", | |
"\n", | |
" location.crossStreet \n", | |
"0 NaN \n", | |
"1 NaN \n", | |
"2 btwn Church St & W Broadway \n", | |
"\n", | |
"[3 rows x 23 columns]" | |
] | |
}, | |
"execution_count": 73, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"# assign relevant part of JSON to venues\n", | |
"venues = results['response']['venues']\n", | |
"\n", | |
"# tranform venues into a dataframe\n", | |
"dataframe = json_normalize(venues)\n", | |
"dataframe.head()" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Define information of interest and filter dataframe" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 86, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
}, | |
"scrolled": true | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/html": [ | |
"<div>\n", | |
"<style scoped>\n", | |
" .dataframe tbody tr th:only-of-type {\n", | |
" vertical-align: middle;\n", | |
" }\n", | |
"\n", | |
" .dataframe tbody tr th {\n", | |
" vertical-align: top;\n", | |
" }\n", | |
"\n", | |
" .dataframe thead th {\n", | |
" text-align: right;\n", | |
" }\n", | |
"</style>\n", | |
"<table border=\"1\" class=\"dataframe\">\n", | |
" <thead>\n", | |
" <tr style=\"text-align: right;\">\n", | |
" <th></th>\n", | |
" <th>name</th>\n", | |
" <th>categories</th>\n", | |
" <th>address</th>\n", | |
" <th>lat</th>\n", | |
" <th>lng</th>\n", | |
" <th>labeledLatLngs</th>\n", | |
" <th>distance</th>\n", | |
" <th>postalCode</th>\n", | |
" <th>cc</th>\n", | |
" <th>city</th>\n", | |
" <th>state</th>\n", | |
" <th>country</th>\n", | |
" <th>formattedAddress</th>\n", | |
" <th>crossStreet</th>\n", | |
" <th>id</th>\n", | |
" </tr>\n", | |
" </thead>\n", | |
" <tbody>\n", | |
" <tr>\n", | |
" <th>0</th>\n", | |
" <td>Harry's Italian Pizza Bar</td>\n", | |
" <td>Pizza Place</td>\n", | |
" <td>225 Murray St</td>\n", | |
" <td>40.715218</td>\n", | |
" <td>-74.014739</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.71521779064671, 'lng': -74.01473940209351}]</td>\n", | |
" <td>58</td>\n", | |
" <td>10282</td>\n", | |
" <td>US</td>\n", | |
" <td>New York</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[225 Murray St, New York, NY 10282, United States]</td>\n", | |
" <td>NaN</td>\n", | |
" <td>4fa862b3e4b0ebff2f749f06</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>1</th>\n", | |
" <td>Conca Cucina Italian Restaurant</td>\n", | |
" <td>Food</td>\n", | |
" <td>63 W Broadway</td>\n", | |
" <td>40.714460</td>\n", | |
" <td>-74.010086</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.71446, 'lng': -74.010086}]</td>\n", | |
" <td>446</td>\n", | |
" <td>10007</td>\n", | |
" <td>US</td>\n", | |
" <td>New York</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[63 W Broadway, New York, NY 10007, United States]</td>\n", | |
" <td>NaN</td>\n", | |
" <td>4f3232e219836c91c7bfde94</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>2</th>\n", | |
" <td>Ecco</td>\n", | |
" <td>Italian Restaurant</td>\n", | |
" <td>124 Chambers St</td>\n", | |
" <td>40.715337</td>\n", | |
" <td>-74.008848</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.71533713859952, 'lng': -74.00884766217825}]</td>\n", | |
" <td>549</td>\n", | |
" <td>10007</td>\n", | |
" <td>US</td>\n", | |
" <td>New York</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[124 Chambers St (btwn Church St & W Broadway), New York, NY 10007, United States]</td>\n", | |
" <td>btwn Church St & W Broadway</td>\n", | |
" <td>3fd66200f964a520f4e41ee3</td>\n", | |
" </tr>\n", | |
" </tbody>\n", | |
"</table>\n", | |
"</div>" | |
], | |
"text/plain": [ | |
" name categories address \\\n", | |
"0 Harry's Italian Pizza Bar Pizza Place 225 Murray St \n", | |
"1 Conca Cucina Italian Restaurant Food 63 W Broadway \n", | |
"2 Ecco Italian Restaurant 124 Chambers St \n", | |
"\n", | |
" lat lng \\\n", | |
"0 40.715218 -74.014739 \n", | |
"1 40.714460 -74.010086 \n", | |
"2 40.715337 -74.008848 \n", | |
"\n", | |
" labeledLatLngs \\\n", | |
"0 [{'label': 'display', 'lat': 40.71521779064671, 'lng': -74.01473940209351}] \n", | |
"1 [{'label': 'display', 'lat': 40.71446, 'lng': -74.010086}] \n", | |
"2 [{'label': 'display', 'lat': 40.71533713859952, 'lng': -74.00884766217825}] \n", | |
"\n", | |
" distance postalCode cc city state country \\\n", | |
"0 58 10282 US New York NY United States \n", | |
"1 446 10007 US New York NY United States \n", | |
"2 549 10007 US New York NY United States \n", | |
"\n", | |
" formattedAddress \\\n", | |
"0 [225 Murray St, New York, NY 10282, United States] \n", | |
"1 [63 W Broadway, New York, NY 10007, United States] \n", | |
"2 [124 Chambers St (btwn Church St & W Broadway), New York, NY 10007, United States] \n", | |
"\n", | |
" crossStreet id \n", | |
"0 NaN 4fa862b3e4b0ebff2f749f06 \n", | |
"1 NaN 4f3232e219836c91c7bfde94 \n", | |
"2 btwn Church St & W Broadway 3fd66200f964a520f4e41ee3 " | |
] | |
}, | |
"execution_count": 86, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"# keep only columns that include venue name, and anything that is associated with location\n", | |
"filtered_columns = ['name', 'categories'] + [col for col in dataframe.columns if col.startswith('location.')] + ['id']\n", | |
"dataframe_filtered = dataframe.loc[:, filtered_columns]\n", | |
"\n", | |
"# function that extracts the category of the venue\n", | |
"def get_category_type(row):\n", | |
" try:\n", | |
" categories_list = row['categories']\n", | |
" except:\n", | |
" categories_list = row['venue.categories']\n", | |
" \n", | |
" if len(categories_list) == 0:\n", | |
" return None\n", | |
" else:\n", | |
" return categories_list[0]['name']\n", | |
"\n", | |
"# filter the category for each row\n", | |
"dataframe_filtered['categories'] = dataframe_filtered.apply(get_category_type, axis=1)\n", | |
"\n", | |
"# clean column names by keeping only last term\n", | |
"dataframe_filtered.columns = [column.split('.')[-1] for column in dataframe_filtered.columns]\n", | |
"\n", | |
"dataframe_filtered" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Let's visualize the Italian restaurants that are nearby" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 87, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"0 Harry's Italian Pizza Bar \n", | |
"1 Conca Cucina Italian Restaurant\n", | |
"2 Ecco \n", | |
"Name: name, dtype: object" | |
] | |
}, | |
"execution_count": 87, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"dataframe_filtered.name" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 88, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/html": [ | |
"<div style=\"width:100%;\"><div style=\"position:relative;width:100%;height:0;padding-bottom:60%;\"><iframe src=\"data:text/html;charset=utf-8;base64,PCFET0NUWVBFIGh0bWw+CjxoZWFkPiAgICAKICAgIDxtZXRhIGh0dHAtZXF1aXY9ImNvbnRlbnQtdHlwZSIgY29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PVVURi04IiAvPgogICAgPHNjcmlwdD5MX1BSRUZFUl9DQU5WQVMgPSBmYWxzZTsgTF9OT19UT1VDSCA9IGZhbHNlOyBMX0RJU0FCTEVfM0QgPSBmYWxzZTs8L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL2Nkbi5qc2RlbGl2ci5uZXQvbnBtL2xlYWZsZXRAMS4yLjAvZGlzdC9sZWFmbGV0LmpzIj48L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL2FqYXguZ29vZ2xlYXBpcy5jb20vYWpheC9saWJzL2pxdWVyeS8xLjExLjEvanF1ZXJ5Lm1pbi5qcyI+PC9zY3JpcHQ+CiAgICA8c2NyaXB0IHNyYz0iaHR0cHM6Ly9tYXhjZG4uYm9vdHN0cmFwY2RuLmNvbS9ib290c3RyYXAvMy4yLjAvanMvYm9vdHN0cmFwLm1pbi5qcyI+PC9zY3JpcHQ+CiAgICA8c2NyaXB0IHNyYz0iaHR0cHM6Ly9jZG5qcy5jbG91ZGZsYXJlLmNvbS9hamF4L2xpYnMvTGVhZmxldC5hd2Vzb21lLW1hcmtlcnMvMi4wLjIvbGVhZmxldC5hd2Vzb21lLW1hcmtlcnMuanMiPjwvc2NyaXB0PgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL2Nkbi5qc2RlbGl2ci5uZXQvbnBtL2xlYWZsZXRAMS4yLjAvZGlzdC9sZWFmbGV0LmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL21heGNkbi5ib290c3RyYXBjZG4uY29tL2Jvb3RzdHJhcC8zLjIuMC9jc3MvYm9vdHN0cmFwLm1pbi5jc3MiLz4KICAgIDxsaW5rIHJlbD0ic3R5bGVzaGVldCIgaHJlZj0iaHR0cHM6Ly9tYXhjZG4uYm9vdHN0cmFwY2RuLmNvbS9ib290c3RyYXAvMy4yLjAvY3NzL2Jvb3RzdHJhcC10aGVtZS5taW4uY3NzIi8+CiAgICA8bGluayByZWw9InN0eWxlc2hlZXQiIGhyZWY9Imh0dHBzOi8vbWF4Y2RuLmJvb3RzdHJhcGNkbi5jb20vZm9udC1hd2Vzb21lLzQuNi4zL2Nzcy9mb250LWF3ZXNvbWUubWluLmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL2NkbmpzLmNsb3VkZmxhcmUuY29tL2FqYXgvbGlicy9MZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy8yLjAuMi9sZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy5jc3MiLz4KICAgIDxsaW5rIHJlbD0ic3R5bGVzaGVldCIgaHJlZj0iaHR0cHM6Ly9yYXdnaXQuY29tL3B5dGhvbi12aXN1YWxpemF0aW9uL2ZvbGl1bS9tYXN0ZXIvZm9saXVtL3RlbXBsYXRlcy9sZWFmbGV0LmF3ZXNvbWUucm90YXRlLmNzcyIvPgogICAgPHN0eWxlPmh0bWwsIGJvZHkge3dpZHRoOiAxMDAlO2hlaWdodDogMTAwJTttYXJnaW46IDA7cGFkZGluZzogMDt9PC9zdHlsZT4KICAgIDxzdHlsZT4jbWFwIHtwb3NpdGlvbjphYnNvbHV0ZTt0b3A6MDtib3R0b206MDtyaWdodDowO2xlZnQ6MDt9PC9zdHlsZT4KICAgIAogICAgICAgICAgICA8c3R5bGU+ICNtYXBfYmEyMWVhZDgyYjk4NDUxNWFlY2Y0YzA0ZDRiYmUxZTUgewogICAgICAgICAgICAgICAgcG9zaXRpb24gOiByZWxhdGl2ZTsKICAgICAgICAgICAgICAgIHdpZHRoIDogMTAwLjAlOwogICAgICAgICAgICAgICAgaGVpZ2h0OiAxMDAuMCU7CiAgICAgICAgICAgICAgICBsZWZ0OiAwLjAlOwogICAgICAgICAgICAgICAgdG9wOiAwLjAlOwogICAgICAgICAgICAgICAgfQogICAgICAgICAgICA8L3N0eWxlPgogICAgICAgIAo8L2hlYWQ+Cjxib2R5PiAgICAKICAgIAogICAgICAgICAgICA8ZGl2IGNsYXNzPSJmb2xpdW0tbWFwIiBpZD0ibWFwX2JhMjFlYWQ4MmI5ODQ1MTVhZWNmNGMwNGQ0YmJlMWU1IiA+PC9kaXY+CiAgICAgICAgCjwvYm9keT4KPHNjcmlwdD4gICAgCiAgICAKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGJvdW5kcyA9IG51bGw7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgdmFyIG1hcF9iYTIxZWFkODJiOTg0NTE1YWVjZjRjMDRkNGJiZTFlNSA9IEwubWFwKAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgJ21hcF9iYTIxZWFkODJiOTg0NTE1YWVjZjRjMDRkNGJiZTFlNScsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB7Y2VudGVyOiBbNDAuNzE0OTU1NSwtNzQuMDE1MzM2NV0sCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB6b29tOiAxMywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1heEJvdW5kczogYm91bmRzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbGF5ZXJzOiBbXSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHdvcmxkQ29weUp1bXA6IGZhbHNlLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgY3JzOiBMLkNSUy5FUFNHMzg1NwogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB9KTsKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHRpbGVfbGF5ZXJfZjNhNmEyZjBjNjdmNDBkNGI4NjIxMWQ5OGFjOTM2MmEgPSBMLnRpbGVMYXllcigKICAgICAgICAgICAgICAgICdodHRwczovL3tzfS50aWxlLm9wZW5zdHJlZXRtYXAub3JnL3t6fS97eH0ve3l9LnBuZycsCiAgICAgICAgICAgICAgICB7CiAgImF0dHJpYnV0aW9uIjogbnVsbCwKICAiZGV0ZWN0UmV0aW5hIjogZmFsc2UsCiAgIm1heFpvb20iOiAxOCwKICAibWluWm9vbSI6IDEsCiAgIm5vV3JhcCI6IGZhbHNlLAogICJzdWJkb21haW5zIjogImFiYyIKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfYmEyMWVhZDgyYjk4NDUxNWFlY2Y0YzA0ZDRiYmUxZTUpOwogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzhlOTIxYmYyM2FjYTQ0MTc4MmQ3ZjJiNTNjOTMxNDE2ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzE0OTU1NSwtNzQuMDE1MzM2NV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJyZWQiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJyZWQiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDEwLAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2JhMjFlYWQ4MmI5ODQ1MTVhZWNmNGMwNGQ0YmJlMWU1KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzI2NmU4OWY5NTQ0NTRlZWRhZDI0MWZlZTRhZmNjODBkID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzUwY2M5MDg5OWVkOTQzZmViMGQyZWQxOTc3MzYwMmY3ID0gJCgnPGRpdiBpZD0iaHRtbF81MGNjOTA4OTllZDk0M2ZlYjBkMmVkMTk3NzM2MDJmNyIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+Q29ucmFkIEhvdGVsPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF8yNjZlODlmOTU0NDU0ZWVkYWQyNDFmZWU0YWZjYzgwZC5zZXRDb250ZW50KGh0bWxfNTBjYzkwODk5ZWQ5NDNmZWIwZDJlZDE5NzczNjAyZjcpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfOGU5MjFiZjIzYWNhNDQxNzgyZDdmMmI1M2M5MzE0MTYuYmluZFBvcHVwKHBvcHVwXzI2NmU4OWY5NTQ0NTRlZWRhZDI0MWZlZTRhZmNjODBkKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzVjMzI1NGRkZTU0MDRkOTBiZTFmMTQyZTA0NWU2NGI4ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzE1MjE3NzkwNjQ2NzEsLTc0LjAxNDczOTQwMjA5MzUxXSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2JhMjFlYWQ4MmI5ODQ1MTVhZWNmNGMwNGQ0YmJlMWU1KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2RjMmYxNmVmNGVkMjQ4ZDI5ZDI5NDJiYmMyYmY2OWMwID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzM3MzVlNzM0ZTMyMzRiYzY5Y2VlZWVmYzI0Yzc2NjE5ID0gJCgnPGRpdiBpZD0iaHRtbF8zNzM1ZTczNGUzMjM0YmM2OWNlZWVlZmMyNGM3NjYxOSIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+UGl6emEgUGxhY2U8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2RjMmYxNmVmNGVkMjQ4ZDI5ZDI5NDJiYmMyYmY2OWMwLnNldENvbnRlbnQoaHRtbF8zNzM1ZTczNGUzMjM0YmM2OWNlZWVlZmMyNGM3NjYxOSk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl81YzMyNTRkZGU1NDA0ZDkwYmUxZjE0MmUwNDVlNjRiOC5iaW5kUG9wdXAocG9wdXBfZGMyZjE2ZWY0ZWQyNDhkMjlkMjk0MmJiYzJiZjY5YzApOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfZjk5NWUzMTFiODk3NDRhZmJhMzhlNzNkNTkxZGY0YTggPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43MTQ0NiwtNzQuMDEwMDg2XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2JhMjFlYWQ4MmI5ODQ1MTVhZWNmNGMwNGQ0YmJlMWU1KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2VlOTU5NzlkYWIyOTQ1ZTE5MDdkNmNjNWQwOTk2NDE5ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2YzYTdiMDZjYmUzZDRjY2FhM2VjZDRiYWU0OGYwZWU1ID0gJCgnPGRpdiBpZD0iaHRtbF9mM2E3YjA2Y2JlM2Q0Y2NhYTNlY2Q0YmFlNDhmMGVlNSIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+Rm9vZDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfZWU5NTk3OWRhYjI5NDVlMTkwN2Q2Y2M1ZDA5OTY0MTkuc2V0Q29udGVudChodG1sX2YzYTdiMDZjYmUzZDRjY2FhM2VjZDRiYWU0OGYwZWU1KTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyX2Y5OTVlMzExYjg5NzQ0YWZiYTM4ZTczZDU5MWRmNGE4LmJpbmRQb3B1cChwb3B1cF9lZTk1OTc5ZGFiMjk0NWUxOTA3ZDZjYzVkMDk5NjQxOSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9hMWY5NGM2NDU2MTk0ZmJjOTViMGI4MTMzNjhlOWRjOSA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjcxNTMzNzEzODU5OTUyLC03NC4wMDg4NDc2NjIxNzgyNV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9iYTIxZWFkODJiOTg0NTE1YWVjZjRjMDRkNGJiZTFlNSk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF8xYjY2YWU5YTY0MmY0MWNmOTMyMzIyYzU2NTdiOTliOSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF84MTQwYjYzZDllYWU0ZDhiYTBiOTdhMGE0MWI2ZTM3MyA9ICQoJzxkaXYgaWQ9Imh0bWxfODE0MGI2M2Q5ZWFlNGQ4YmEwYjk3YTBhNDFiNmUzNzMiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkl0YWxpYW4gUmVzdGF1cmFudDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfMWI2NmFlOWE2NDJmNDFjZjkzMjMyMmM1NjU3Yjk5Yjkuc2V0Q29udGVudChodG1sXzgxNDBiNjNkOWVhZTRkOGJhMGI5N2EwYTQxYjZlMzczKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyX2ExZjk0YzY0NTYxOTRmYmM5NWIwYjgxMzM2OGU5ZGM5LmJpbmRQb3B1cChwb3B1cF8xYjY2YWU5YTY0MmY0MWNmOTMyMzIyYzU2NTdiOTliOSk7CgogICAgICAgICAgICAKICAgICAgICAKPC9zY3JpcHQ+\" style=\"position:absolute;width:100%;height:100%;left:0;top:0;border:none !important;\" allowfullscreen webkitallowfullscreen mozallowfullscreen></iframe></div></div>" | |
], | |
"text/plain": [ | |
"<folium.folium.Map at 0x7f9b3b0c9828>" | |
] | |
}, | |
"execution_count": 88, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"venues_map = folium.Map(location=[latitude, longitude], zoom_start=13) # generate map centred around the Conrad Hotel\n", | |
"\n", | |
"# add a red circle marker to represent the Conrad Hotel\n", | |
"folium.features.CircleMarker(\n", | |
" [latitude, longitude],\n", | |
" radius=10,\n", | |
" color='red',\n", | |
" popup='Conrad Hotel',\n", | |
" fill = True,\n", | |
" fill_color = 'red',\n", | |
" fill_opacity = 0.6\n", | |
").add_to(venues_map)\n", | |
"\n", | |
"# add the Italian restaurants as blue circle markers\n", | |
"for lat, lng, label in zip(dataframe_filtered.lat, dataframe_filtered.lng, dataframe_filtered.categories):\n", | |
" folium.features.CircleMarker(\n", | |
" [lat, lng],\n", | |
" radius=5,\n", | |
" color='blue',\n", | |
" popup=label,\n", | |
" fill = True,\n", | |
" fill_color='blue',\n", | |
" fill_opacity=0.6\n", | |
" ).add_to(venues_map)\n", | |
"\n", | |
"# display map\n", | |
"venues_map" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
" " | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"<a id=\"item2\"></a>" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"## 2. Explore a Given Venue\n", | |
"> `https://api.foursquare.com/v2/venues/`**VENUE_ID**`?client_id=`**CLIENT_ID**`&client_secret=`**CLIENT_SECRET**`&v=`**VERSION**" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"### A. Let's explore the closest Italian restaurant -- _Harry's Italian Pizza Bar_" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 77, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"'https://api.foursquare.com/v2/venues/4fa862b3e4b0ebff2f749f06?client_id=RJRNPM53LPRPIQT1ZC2YQTVSLJ3CP3LXE3CRH0DVCO0LODOL&client_secret=XIADFIC2V4FL453CQEM0S22EMIGSXTYRUF5RS4E2XX40KKO3&v=20180604'" | |
] | |
}, | |
"execution_count": 77, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"venue_id = '4fa862b3e4b0ebff2f749f06' # ID of Harry's Italian Pizza Bar\n", | |
"url = 'https://api.foursquare.com/v2/venues/{}?client_id={}&client_secret={}&v={}'.format(venue_id, CLIENT_ID, CLIENT_SECRET, VERSION)\n", | |
"url" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Send GET request for result" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 78, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"name": "stdout", | |
"output_type": "stream", | |
"text": [ | |
"dict_keys(['id', 'name', 'contact', 'location', 'canonicalUrl', 'categories', 'verified', 'stats', 'url', 'price', 'hasMenu', 'likes', 'dislike', 'ok', 'rating', 'ratingColor', 'ratingSignals', 'delivery', 'menu', 'allowMenuUrlEdit', 'beenHere', 'specials', 'photos', 'reasons', 'hereNow', 'createdAt', 'tips', 'shortUrl', 'timeZone', 'listed', 'hours', 'popular', 'pageUpdates', 'inbox', 'attributes', 'bestPhoto', 'colors'])\n" | |
] | |
}, | |
{ | |
"data": { | |
"text/plain": [ | |
"{'id': '4fa862b3e4b0ebff2f749f06',\n", | |
" 'name': \"Harry's Italian Pizza Bar\",\n", | |
" 'contact': {'phone': '2126081007', 'formattedPhone': '(212) 608-1007'},\n", | |
" 'location': {'address': '225 Murray St',\n", | |
" 'lat': 40.71521779064671,\n", | |
" 'lng': -74.01473940209351,\n", | |
" 'labeledLatLngs': [{'label': 'display',\n", | |
" 'lat': 40.71521779064671,\n", | |
" 'lng': -74.01473940209351}],\n", | |
" 'postalCode': '10282',\n", | |
" 'cc': 'US',\n", | |
" 'city': 'New York',\n", | |
" 'state': 'NY',\n", | |
" 'country': 'United States',\n", | |
" 'formattedAddress': ['225 Murray St',\n", | |
" 'New York, NY 10282',\n", | |
" 'United States']},\n", | |
" 'canonicalUrl': 'https://foursquare.com/v/harrys-italian-pizza-bar/4fa862b3e4b0ebff2f749f06',\n", | |
" 'categories': [{'id': '4bf58dd8d48988d1ca941735',\n", | |
" 'name': 'Pizza Place',\n", | |
" 'pluralName': 'Pizza Places',\n", | |
" 'shortName': 'Pizza',\n", | |
" 'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/pizza_',\n", | |
" 'suffix': '.png'},\n", | |
" 'primary': True},\n", | |
" {'id': '4bf58dd8d48988d110941735',\n", | |
" 'name': 'Italian Restaurant',\n", | |
" 'pluralName': 'Italian Restaurants',\n", | |
" 'shortName': 'Italian',\n", | |
" 'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/italian_',\n", | |
" 'suffix': '.png'}}],\n", | |
" 'verified': False,\n", | |
" 'stats': {'tipCount': 57},\n", | |
" 'url': 'http://harrysitalian.com',\n", | |
" 'price': {'tier': 2, 'message': 'Moderate', 'currency': '$'},\n", | |
" 'hasMenu': True,\n", | |
" 'likes': {'count': 120,\n", | |
" 'groups': [{'type': 'others', 'count': 120, 'items': []}],\n", | |
" 'summary': '120 Likes'},\n", | |
" 'dislike': False,\n", | |
" 'ok': False,\n", | |
" 'rating': 7.1,\n", | |
" 'ratingColor': 'C5DE35',\n", | |
" 'ratingSignals': 214,\n", | |
" 'delivery': {'id': '294544',\n", | |
" 'url': 'https://www.seamless.com/menu/harrys-italian-pizza-bar-225-murray-st-new-york/294544?affiliate=1131&utm_source=foursquare-affiliate-network&utm_medium=affiliate&utm_campaign=1131&utm_content=294544',\n", | |
" 'provider': {'name': 'seamless',\n", | |
" 'icon': {'prefix': 'https://fastly.4sqi.net/img/general/cap/',\n", | |
" 'sizes': [40, 50],\n", | |
" 'name': '/delivery_provider_seamless_20180129.png'}}},\n", | |
" 'menu': {'type': 'Menu',\n", | |
" 'label': 'Menu',\n", | |
" 'anchor': 'View Menu',\n", | |
" 'url': 'https://foursquare.com/v/harrys-italian-pizza-bar/4fa862b3e4b0ebff2f749f06/menu',\n", | |
" 'mobileUrl': 'https://foursquare.com/v/4fa862b3e4b0ebff2f749f06/device_menu'},\n", | |
" 'allowMenuUrlEdit': True,\n", | |
" 'beenHere': {'count': 0,\n", | |
" 'unconfirmedCount': 0,\n", | |
" 'marked': False,\n", | |
" 'lastCheckinExpiredAt': 0},\n", | |
" 'specials': {'count': 0, 'items': []},\n", | |
" 'photos': {'count': 149,\n", | |
" 'groups': [{'type': 'checkin',\n", | |
" 'name': \"Friends' check-in photos\",\n", | |
" 'count': 0,\n", | |
" 'items': []},\n", | |
" {'type': 'venue',\n", | |
" 'name': 'Venue photos',\n", | |
" 'count': 149,\n", | |
" 'items': [{'id': '4fad980de4b091b4626c3633',\n", | |
" 'createdAt': 1336776717,\n", | |
" 'source': {'name': 'Foursquare for Android',\n", | |
" 'url': 'https://foursquare.com/download/#/android'},\n", | |
" 'prefix': 'https://fastly.4sqi.net/img/general/',\n", | |
" 'suffix': '/ya1iQFI7pLjuIJp1PGDKlrZS3OJdHCF7tpILMmjv_2w.jpg',\n", | |
" 'width': 480,\n", | |
" 'height': 640,\n", | |
" 'user': {'id': '13676709',\n", | |
" 'firstName': 'Leony',\n", | |
" 'lastName': 'Naciri',\n", | |
" 'gender': 'none',\n", | |
" 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n", | |
" 'suffix': '/T0ANFNGNMCHUDEUE.jpg'}},\n", | |
" 'visibility': 'public'}]}],\n", | |
" 'summary': '0 photos'},\n", | |
" 'reasons': {'count': 1,\n", | |
" 'items': [{'summary': 'Lots of people like this place',\n", | |
" 'type': 'general',\n", | |
" 'reasonName': 'rawLikesReason'}]},\n", | |
" 'hereNow': {'count': 0, 'summary': 'Nobody here', 'groups': []},\n", | |
" 'createdAt': 1336435379,\n", | |
" 'tips': {'count': 57,\n", | |
" 'groups': [{'type': 'others',\n", | |
" 'name': 'All tips',\n", | |
" 'count': 57,\n", | |
" 'items': [{'id': '53d27909498e0523841340b6',\n", | |
" 'createdAt': 1406302473,\n", | |
" 'text': \"Harry's Italian Pizza bar is known for it's amazing pizza, but did you know that the brunches here are amazing too? Try the Nutella French toast and we know you'll be sold.\",\n", | |
" 'type': 'user',\n", | |
" 'canonicalUrl': 'https://foursquare.com/item/53d27909498e0523841340b6',\n", | |
" 'lang': 'en',\n", | |
" 'likes': {'count': 4,\n", | |
" 'groups': [{'type': 'others',\n", | |
" 'count': 4,\n", | |
" 'items': [{'id': '369426',\n", | |
" 'firstName': 'P.',\n", | |
" 'lastName': 'M.',\n", | |
" 'gender': 'male',\n", | |
" 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n", | |
" 'suffix': '/JPQYUWJKUT0H2OO4.jpg'}},\n", | |
" {'id': '87587879',\n", | |
" 'firstName': 'Diane',\n", | |
" 'lastName': 'Danneels',\n", | |
" 'gender': 'female',\n", | |
" 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n", | |
" 'suffix': '/87587879-ESLRSZLQ2CBE2P4W.jpg'}},\n", | |
" {'id': '87591341',\n", | |
" 'firstName': 'Tim',\n", | |
" 'lastName': 'Sheehan',\n", | |
" 'gender': 'male',\n", | |
" 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n", | |
" 'suffix': '/-Z4YK4VKE0JSVXIY1.jpg'}},\n", | |
" {'id': '87473404',\n", | |
" 'firstName': 'TenantKing.com',\n", | |
" 'gender': 'none',\n", | |
" 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n", | |
" 'suffix': '/87473404-HI5DTBTK0HX401CA.png'},\n", | |
" 'type': 'page'}]}],\n", | |
" 'summary': '4 likes'},\n", | |
" 'logView': True,\n", | |
" 'agreeCount': 4,\n", | |
" 'disagreeCount': 0,\n", | |
" 'todo': {'count': 0},\n", | |
" 'user': {'id': '87473404',\n", | |
" 'firstName': 'TenantKing.com',\n", | |
" 'gender': 'none',\n", | |
" 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n", | |
" 'suffix': '/87473404-HI5DTBTK0HX401CA.png'},\n", | |
" 'type': 'page'}}]}]},\n", | |
" 'shortUrl': 'http://4sq.com/JNblHV',\n", | |
" 'timeZone': 'America/New_York',\n", | |
" 'listed': {'count': 54,\n", | |
" 'groups': [{'type': 'others',\n", | |
" 'name': 'Lists from other people',\n", | |
" 'count': 54,\n", | |
" 'items': [{'id': '4fa32fd0e4b04193744746b1',\n", | |
" 'name': 'Manhattan Haunts',\n", | |
" 'description': '',\n", | |
" 'type': 'others',\n", | |
" 'user': {'id': '24592223',\n", | |
" 'firstName': 'Becca',\n", | |
" 'lastName': 'McArthur',\n", | |
" 'gender': 'female',\n", | |
" 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n", | |
" 'suffix': '/24592223-RAW2UYM0GIB1U40K.jpg'}},\n", | |
" 'editable': False,\n", | |
" 'public': True,\n", | |
" 'collaborative': False,\n", | |
" 'url': '/becca_mcarthur/list/manhattan-haunts',\n", | |
" 'canonicalUrl': 'https://foursquare.com/becca_mcarthur/list/manhattan-haunts',\n", | |
" 'createdAt': 1336094672,\n", | |
" 'updatedAt': 1380845377,\n", | |
" 'photo': {'id': '4e8cc9461081e3b3544e12e5',\n", | |
" 'createdAt': 1317849414,\n", | |
" 'prefix': 'https://fastly.4sqi.net/img/general/',\n", | |
" 'suffix': '/0NLVU2HC1JF4DXIMKWUFW3QBUT31DC11EFNYYHMJG3NDWAPS.jpg',\n", | |
" 'width': 492,\n", | |
" 'height': 330,\n", | |
" 'user': {'id': '742542',\n", | |
" 'firstName': 'Time Out New York',\n", | |
" 'gender': 'none',\n", | |
" 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n", | |
" 'suffix': '/XXHKCBSQHBORZNSR.jpg'},\n", | |
" 'type': 'page'},\n", | |
" 'visibility': 'public'},\n", | |
" 'followers': {'count': 22},\n", | |
" 'listItems': {'count': 187,\n", | |
" 'items': [{'id': 'v4fa862b3e4b0ebff2f749f06',\n", | |
" 'createdAt': 1342934485}]}},\n", | |
" {'id': '4fae817be4b085f6b2a74d19',\n", | |
" 'name': 'USA NYC MAN FiDi',\n", | |
" 'description': 'Where to go for decent eats in the restaurant wasteland of Downtown NYC aka FiDi, along with Tribeca & Battery Park City.',\n", | |
" 'type': 'others',\n", | |
" 'user': {'id': '12113441',\n", | |
" 'firstName': 'Kino',\n", | |
" 'gender': 'male',\n", | |
" 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n", | |
" 'suffix': '/12113441-K5HTHFLU2MUCM0CM.jpg'}},\n", | |
" 'editable': False,\n", | |
" 'public': True,\n", | |
" 'collaborative': False,\n", | |
" 'url': '/kinosfault/list/usa-nyc-man-fidi',\n", | |
" 'canonicalUrl': 'https://foursquare.com/kinosfault/list/usa-nyc-man-fidi',\n", | |
" 'createdAt': 1336836475,\n", | |
" 'updatedAt': 1556754919,\n", | |
" 'photo': {'id': '55984992498e13ba75e353bb',\n", | |
" 'createdAt': 1436043666,\n", | |
" 'prefix': 'https://fastly.4sqi.net/img/general/',\n", | |
" 'suffix': '/12113441_iOa6Uh-Xi8bhj2-gpzkkw8MKiAIs7RmOcz_RM7m8ink.jpg',\n", | |
" 'width': 540,\n", | |
" 'height': 960,\n", | |
" 'user': {'id': '12113441',\n", | |
" 'firstName': 'Kino',\n", | |
" 'gender': 'male',\n", | |
" 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n", | |
" 'suffix': '/12113441-K5HTHFLU2MUCM0CM.jpg'}},\n", | |
" 'visibility': 'public'},\n", | |
" 'followers': {'count': 20},\n", | |
" 'listItems': {'count': 273,\n", | |
" 'items': [{'id': 'v4fa862b3e4b0ebff2f749f06',\n", | |
" 'createdAt': 1373909433}]}},\n", | |
" {'id': '4fddeff0e4b0e078037ac0d3',\n", | |
" 'name': 'NYC Resturants',\n", | |
" 'description': '',\n", | |
" 'type': 'others',\n", | |
" 'user': {'id': '21563126',\n", | |
" 'firstName': 'Richard',\n", | |
" 'lastName': 'Revilla',\n", | |
" 'gender': 'male',\n", | |
" 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n", | |
" 'suffix': '/21563126_v05J1KPw_SVj6Ehq9g8B9jeAGjFUMsU5QGl-NZ8inUQ7pKQm5bKplW37EmR7jS2A7GYPBBAtl.jpg'}},\n", | |
" 'editable': False,\n", | |
" 'public': True,\n", | |
" 'collaborative': True,\n", | |
" 'url': '/rickr7/list/nyc-resturants',\n", | |
" 'canonicalUrl': 'https://foursquare.com/rickr7/list/nyc-resturants',\n", | |
" 'createdAt': 1339944944,\n", | |
" 'updatedAt': 1561951163,\n", | |
" 'photo': {'id': '5072dd13e4b09145cdf782d1',\n", | |
" 'createdAt': 1349704979,\n", | |
" 'prefix': 'https://fastly.4sqi.net/img/general/',\n", | |
" 'suffix': '/208205_fGh2OuAZ9qJ4agbAA5wMVNOSIm9kNUlRtNwj1N-adqg.jpg',\n", | |
" 'width': 800,\n", | |
" 'height': 800,\n", | |
" 'user': {'id': '208205',\n", | |
" 'firstName': 'Thalia',\n", | |
" 'lastName': 'K',\n", | |
" 'gender': 'female',\n", | |
" 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n", | |
" 'suffix': '/SNOOLCAW2AG04ZKD.jpg'}},\n", | |
" 'visibility': 'public'},\n", | |
" 'followers': {'count': 12},\n", | |
" 'listItems': {'count': 196,\n", | |
" 'items': [{'id': 't54ed3b13498e857fd7dbb6fc',\n", | |
" 'createdAt': 1514680908}]}},\n", | |
" {'id': '5266c68a498e7c667807fe09',\n", | |
" 'name': 'Foodie Love in NY - 02',\n", | |
" 'description': '',\n", | |
" 'type': 'others',\n", | |
" 'user': {'id': '547977',\n", | |
" 'firstName': 'WiLL',\n", | |
" 'gender': 'male',\n", | |
" 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n", | |
" 'suffix': '/-Q5NYGDMFDMOITQRR.jpg'}},\n", | |
" 'editable': False,\n", | |
" 'public': True,\n", | |
" 'collaborative': False,\n", | |
" 'url': '/sweetiewill/list/foodie-love-in-ny--02',\n", | |
" 'canonicalUrl': 'https://foursquare.com/sweetiewill/list/foodie-love-in-ny--02',\n", | |
" 'createdAt': 1382467210,\n", | |
" 'updatedAt': 1391995585,\n", | |
" 'followers': {'count': 7},\n", | |
" 'listItems': {'count': 200,\n", | |
" 'items': [{'id': 'v4fa862b3e4b0ebff2f749f06',\n", | |
" 'createdAt': 1386809936}]}}]}]},\n", | |
" 'hours': {'status': 'Open until 11:00 PM',\n", | |
" 'richStatus': {'entities': [], 'text': 'Open until 11:00 PM'},\n", | |
" 'isOpen': True,\n", | |
" 'isLocalHoliday': False,\n", | |
" 'dayData': [],\n", | |
" 'timeframes': [{'days': 'Mon–Wed, Sun',\n", | |
" 'includesToday': True,\n", | |
" 'open': [{'renderedTime': '11:30 AM–11:00 PM'}],\n", | |
" 'segments': []},\n", | |
" {'days': 'Thu–Sat',\n", | |
" 'open': [{'renderedTime': '11:30 AM–Midnight'}],\n", | |
" 'segments': []}]},\n", | |
" 'popular': {'status': 'Likely open',\n", | |
" 'richStatus': {'entities': [], 'text': 'Likely open'},\n", | |
" 'isOpen': True,\n", | |
" 'isLocalHoliday': False,\n", | |
" 'timeframes': [{'days': 'Today',\n", | |
" 'includesToday': True,\n", | |
" 'open': [{'renderedTime': 'Noon–2:00 PM'},\n", | |
" {'renderedTime': '5:00 PM–10:00 PM'}],\n", | |
" 'segments': []},\n", | |
" {'days': 'Wed–Thu',\n", | |
" 'open': [{'renderedTime': 'Noon–2:00 PM'},\n", | |
" {'renderedTime': '5:00 PM–10:00 PM'}],\n", | |
" 'segments': []},\n", | |
" {'days': 'Fri',\n", | |
" 'open': [{'renderedTime': 'Noon–3:00 PM'},\n", | |
" {'renderedTime': '5:00 PM–11:00 PM'}],\n", | |
" 'segments': []},\n", | |
" {'days': 'Sat',\n", | |
" 'open': [{'renderedTime': 'Noon–11:00 PM'}],\n", | |
" 'segments': []},\n", | |
" {'days': 'Sun',\n", | |
" 'open': [{'renderedTime': 'Noon–3:00 PM'},\n", | |
" {'renderedTime': '5:00 PM–8:00 PM'}],\n", | |
" 'segments': []},\n", | |
" {'days': 'Mon',\n", | |
" 'open': [{'renderedTime': 'Noon–2:00 PM'},\n", | |
" {'renderedTime': '6:00 PM–8:00 PM'}],\n", | |
" 'segments': []}]},\n", | |
" 'pageUpdates': {'count': 0, 'items': []},\n", | |
" 'inbox': {'count': 0, 'items': []},\n", | |
" 'attributes': {'groups': [{'type': 'price',\n", | |
" 'name': 'Price',\n", | |
" 'summary': '$$',\n", | |
" 'count': 1,\n", | |
" 'items': [{'displayName': 'Price', 'displayValue': '$$', 'priceTier': 2}]},\n", | |
" {'type': 'payments',\n", | |
" 'name': 'Credit Cards',\n", | |
" 'summary': 'Credit Cards',\n", | |
" 'count': 7,\n", | |
" 'items': [{'displayName': 'Credit Cards',\n", | |
" 'displayValue': 'Yes (incl. American Express)'}]},\n", | |
" {'type': 'outdoorSeating',\n", | |
" 'name': 'Outdoor Seating',\n", | |
" 'summary': 'Outdoor Seating',\n", | |
" 'count': 1,\n", | |
" 'items': [{'displayName': 'Outdoor Seating', 'displayValue': 'Yes'}]},\n", | |
" {'type': 'serves',\n", | |
" 'name': 'Menus',\n", | |
" 'summary': 'Happy Hour, Brunch & more',\n", | |
" 'count': 8,\n", | |
" 'items': [{'displayName': 'Brunch', 'displayValue': 'Brunch'},\n", | |
" {'displayName': 'Lunch', 'displayValue': 'Lunch'},\n", | |
" {'displayName': 'Dinner', 'displayValue': 'Dinner'},\n", | |
" {'displayName': 'Happy Hour', 'displayValue': 'Happy Hour'}]},\n", | |
" {'type': 'drinks',\n", | |
" 'name': 'Drinks',\n", | |
" 'summary': 'Beer, Wine & Cocktails',\n", | |
" 'count': 5,\n", | |
" 'items': [{'displayName': 'Beer', 'displayValue': 'Beer'},\n", | |
" {'displayName': 'Wine', 'displayValue': 'Wine'},\n", | |
" {'displayName': 'Cocktails', 'displayValue': 'Cocktails'}]},\n", | |
" {'type': 'diningOptions',\n", | |
" 'name': 'Dining Options',\n", | |
" 'summary': 'Delivery',\n", | |
" 'count': 5,\n", | |
" 'items': [{'displayName': 'Delivery', 'displayValue': 'Delivery'}]}]},\n", | |
" 'bestPhoto': {'id': '4fad980de4b091b4626c3633',\n", | |
" 'createdAt': 1336776717,\n", | |
" 'source': {'name': 'Foursquare for Android',\n", | |
" 'url': 'https://foursquare.com/download/#/android'},\n", | |
" 'prefix': 'https://fastly.4sqi.net/img/general/',\n", | |
" 'suffix': '/ya1iQFI7pLjuIJp1PGDKlrZS3OJdHCF7tpILMmjv_2w.jpg',\n", | |
" 'width': 480,\n", | |
" 'height': 640,\n", | |
" 'visibility': 'public'},\n", | |
" 'colors': {'highlightColor': {'photoId': '4fad980de4b091b4626c3633',\n", | |
" 'value': -13619152},\n", | |
" 'highlightTextColor': {'photoId': '4fad980de4b091b4626c3633', 'value': -1},\n", | |
" 'algoVersion': 3}}" | |
] | |
}, | |
"execution_count": 78, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"result = requests.get(url).json()\n", | |
"print(result['response']['venue'].keys())\n", | |
"result['response']['venue']" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"### B. Get the venue's overall rating" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 79, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"name": "stdout", | |
"output_type": "stream", | |
"text": [ | |
"7.1\n" | |
] | |
} | |
], | |
"source": [ | |
"try:\n", | |
" print(result['response']['venue']['rating'])\n", | |
"except:\n", | |
" print('This venue has not been rated yet.')" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"That is not a very good rating. Let's check the rating of the second closest Italian restaurant." | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 80, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"name": "stdout", | |
"output_type": "stream", | |
"text": [ | |
"This venue has not been rated yet.\n" | |
] | |
} | |
], | |
"source": [ | |
"venue_id = '4f3232e219836c91c7bfde94' # ID of Conca Cucina Italian Restaurant\n", | |
"url = 'https://api.foursquare.com/v2/venues/{}?client_id={}&client_secret={}&v={}'.format(venue_id, CLIENT_ID, CLIENT_SECRET, VERSION)\n", | |
"\n", | |
"result = requests.get(url).json()\n", | |
"try:\n", | |
" print(result['response']['venue']['rating'])\n", | |
"except:\n", | |
" print('This venue has not been rated yet.')" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"Since this restaurant has no ratings, let's check the third restaurant." | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 81, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"name": "stdout", | |
"output_type": "stream", | |
"text": [ | |
"8.0\n" | |
] | |
} | |
], | |
"source": [ | |
"venue_id = '3fd66200f964a520f4e41ee3' # ID of Ecco\n", | |
"url = 'https://api.foursquare.com/v2/venues/{}?client_id={}&client_secret={}&v={}'.format(venue_id, CLIENT_ID, CLIENT_SECRET, VERSION)\n", | |
"\n", | |
"result = requests.get(url).json()\n", | |
"try:\n", | |
" print(result['response']['venue']['rating'])\n", | |
"except:\n", | |
" print('This venue has not been rated yet.')" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"Since this restaurant has a slightly better rating, let's explore it further." | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"### C. Get the number of tips" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 82, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"17" | |
] | |
}, | |
"execution_count": 82, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"result['response']['venue']['tips']['count']" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"### D. Get the venue's tips\n", | |
"> `https://api.foursquare.com/v2/venues/`**VENUE_ID**`/tips?client_id=`**CLIENT_ID**`&client_secret=`**CLIENT_SECRET**`&v=`**VERSION**`&limit=`**LIMIT**" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Create URL and send GET request. Make sure to set limit to get all tips" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 83, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"{'meta': {'code': 200, 'requestId': '5d49f43e99295100262f3fbb'},\n", | |
" 'response': {'tips': {'count': 17,\n", | |
" 'items': [{'id': '5ab1cb46c9a517174651d3fe',\n", | |
" 'createdAt': 1521601350,\n", | |
" 'text': 'A+ Italian food! Trust me on this: my mom’s side of the family is 100% Italian. I was born and bred to know good pasta when I see it, and Ecco is one of my all-time NYC favorites',\n", | |
" 'type': 'user',\n", | |
" 'canonicalUrl': 'https://foursquare.com/item/5ab1cb46c9a517174651d3fe',\n", | |
" 'lang': 'en',\n", | |
" 'likes': {'count': 0, 'groups': []},\n", | |
" 'logView': True,\n", | |
" 'agreeCount': 3,\n", | |
" 'disagreeCount': 0,\n", | |
" 'lastVoteText': 'Upvoted May 14',\n", | |
" 'lastUpvoteTimestamp': 1557868336,\n", | |
" 'todo': {'count': 0},\n", | |
" 'user': {'id': '484542633',\n", | |
" 'firstName': 'Nick',\n", | |
" 'lastName': 'El-Tawil',\n", | |
" 'gender': 'male',\n", | |
" 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n", | |
" 'suffix': '/484542633_mK2Yum7T_7Tn9fWpndidJsmw2Hof_6T5vJBKCHPLMK5OL-U5ZiJGj51iwBstcpDLYa3Zvhvis.jpg'}},\n", | |
" 'authorInteractionType': 'liked'}]}}}" | |
] | |
}, | |
"execution_count": 83, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"## Ecco Tips\n", | |
"limit = 15 # set limit to be greater than or equal to the total number of tips\n", | |
"url = 'https://api.foursquare.com/v2/venues/{}/tips?client_id={}&client_secret={}&v={}&limit={}'.format(venue_id, CLIENT_ID, CLIENT_SECRET, VERSION, limit)\n", | |
"\n", | |
"results = requests.get(url).json()\n", | |
"results" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Get tips and list of associated features" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 84, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"dict_keys(['id', 'createdAt', 'text', 'type', 'canonicalUrl', 'lang', 'likes', 'logView', 'agreeCount', 'disagreeCount', 'lastVoteText', 'lastUpvoteTimestamp', 'todo', 'user', 'authorInteractionType'])" | |
] | |
}, | |
"execution_count": 84, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"tips = results['response']['tips']['items']\n", | |
"\n", | |
"tip = results['response']['tips']['items'][0]\n", | |
"tip.keys()" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Format column width and display all tips" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 85, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/html": [ | |
"<div>\n", | |
"<style scoped>\n", | |
" .dataframe tbody tr th:only-of-type {\n", | |
" vertical-align: middle;\n", | |
" }\n", | |
"\n", | |
" .dataframe tbody tr th {\n", | |
" vertical-align: top;\n", | |
" }\n", | |
"\n", | |
" .dataframe thead th {\n", | |
" text-align: right;\n", | |
" }\n", | |
"</style>\n", | |
"<table border=\"1\" class=\"dataframe\">\n", | |
" <thead>\n", | |
" <tr style=\"text-align: right;\">\n", | |
" <th></th>\n", | |
" <th>text</th>\n", | |
" <th>agreeCount</th>\n", | |
" <th>disagreeCount</th>\n", | |
" <th>id</th>\n", | |
" <th>user.firstName</th>\n", | |
" <th>user.lastName</th>\n", | |
" <th>user.gender</th>\n", | |
" <th>user.id</th>\n", | |
" </tr>\n", | |
" </thead>\n", | |
" <tbody>\n", | |
" <tr>\n", | |
" <th>0</th>\n", | |
" <td>A+ Italian food! Trust me on this: my mom’s side of the family is 100% Italian. I was born and bred to know good pasta when I see it, and Ecco is one of my all-time NYC favorites</td>\n", | |
" <td>3</td>\n", | |
" <td>0</td>\n", | |
" <td>5ab1cb46c9a517174651d3fe</td>\n", | |
" <td>Nick</td>\n", | |
" <td>El-Tawil</td>\n", | |
" <td>male</td>\n", | |
" <td>484542633</td>\n", | |
" </tr>\n", | |
" </tbody>\n", | |
"</table>\n", | |
"</div>" | |
], | |
"text/plain": [ | |
" text \\\n", | |
"0 A+ Italian food! Trust me on this: my mom’s side of the family is 100% Italian. I was born and bred to know good pasta when I see it, and Ecco is one of my all-time NYC favorites \n", | |
"\n", | |
" agreeCount disagreeCount id user.firstName \\\n", | |
"0 3 0 5ab1cb46c9a517174651d3fe Nick \n", | |
"\n", | |
" user.lastName user.gender user.id \n", | |
"0 El-Tawil male 484542633 " | |
] | |
}, | |
"execution_count": 85, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"pd.set_option('display.max_colwidth', -1)\n", | |
"\n", | |
"tips_df = json_normalize(tips) # json normalize tips\n", | |
"\n", | |
"# columns to keep\n", | |
"filtered_columns = ['text', 'agreeCount', 'disagreeCount', 'id', 'user.firstName', 'user.lastName', 'user.gender', 'user.id']\n", | |
"tips_filtered = tips_df.loc[:, filtered_columns]\n", | |
"\n", | |
"# display tips\n", | |
"tips_filtered" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"Now remember that because we are using a personal developer account, then we can access only 2 of the restaurant's tips, instead of all 15 tips." | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
" " | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"<a id=\"item3\"></a>" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"## 3. Search a Foursquare User\n", | |
"> `https://api.foursquare.com/v2/users/`**USER_ID**`?client_id=`**CLIENT_ID**`&client_secret=`**CLIENT_SECRET**`&v=`**VERSION**" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"### Define URL, send GET request and display features associated with user" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 36, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"dict_keys(['id', 'firstName', 'lastName', 'gender', 'canonicalUrl', 'photo', 'friends', 'tips', 'homeCity', 'bio', 'contact', 'photos', 'type', 'mayorships', 'checkins', 'lists', 'lenses'])" | |
] | |
}, | |
"execution_count": 36, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"user_id = '484542633' # user ID with most agree counts and complete profile\n", | |
"\n", | |
"url = 'https://api.foursquare.com/v2/users/{}?client_id={}&client_secret={}&v={}'.format(user_id, CLIENT_ID, CLIENT_SECRET, VERSION) # define URL\n", | |
"\n", | |
"# send GET request\n", | |
"results = requests.get(url).json()\n", | |
"user_data = results['response']['user']\n", | |
"\n", | |
"# display features associated with user\n", | |
"user_data.keys()" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 37, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"name": "stdout", | |
"output_type": "stream", | |
"text": [ | |
"First Name: Nick\n", | |
"Last Name: El-Tawil\n", | |
"Home City: New York, NY\n" | |
] | |
} | |
], | |
"source": [ | |
"print('First Name: ' + user_data['firstName'])\n", | |
"print('Last Name: ' + user_data['lastName'])\n", | |
"print('Home City: ' + user_data['homeCity'])" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### How many tips has this user submitted?" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 38, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"{'count': 239}" | |
] | |
}, | |
"execution_count": 38, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"user_data['tips']" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"Wow! So it turns out that Nick is a very active Foursquare user, with more than 250 tips." | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"### Get User's tips" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 39, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/html": [ | |
"<div>\n", | |
"<style scoped>\n", | |
" .dataframe tbody tr th:only-of-type {\n", | |
" vertical-align: middle;\n", | |
" }\n", | |
"\n", | |
" .dataframe tbody tr th {\n", | |
" vertical-align: top;\n", | |
" }\n", | |
"\n", | |
" .dataframe thead th {\n", | |
" text-align: right;\n", | |
" }\n", | |
"</style>\n", | |
"<table border=\"1\" class=\"dataframe\">\n", | |
" <thead>\n", | |
" <tr style=\"text-align: right;\">\n", | |
" <th></th>\n", | |
" <th>text</th>\n", | |
" <th>agreeCount</th>\n", | |
" <th>disagreeCount</th>\n", | |
" <th>id</th>\n", | |
" </tr>\n", | |
" </thead>\n", | |
" <tbody>\n", | |
" <tr>\n", | |
" <th>0</th>\n", | |
" <td>The best! I’m especially fond of the salmon burger, but I’ve had half of the menu and never been disappointed. There’s a reason this place is well known even outside of the Village!</td>\n", | |
" <td>1</td>\n", | |
" <td>0</td>\n", | |
" <td>5aec594b1f7440002c138612</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>1</th>\n", | |
" <td>I used to down a pint of chocolate like it was nothing back when I was bulking. Highly recommended!</td>\n", | |
" <td>1</td>\n", | |
" <td>0</td>\n", | |
" <td>5accc9f66fa81f196724807b</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>2</th>\n", | |
" <td>They serve coffee!!!!!!</td>\n", | |
" <td>1</td>\n", | |
" <td>0</td>\n", | |
" <td>5accc98c0313204c9d7ec157</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>3</th>\n", | |
" <td>I’m a fan. In fact, I’m such a big fan, I want Taim to hire me to be their spokesman. Kind of like the Arabic Jared Fogle - but without the kid stuff.</td>\n", | |
" <td>1</td>\n", | |
" <td>0</td>\n", | |
" <td>5accbf033abcaf09a24612a0</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>4</th>\n", | |
" <td>The linguine with clams is on point 👌</td>\n", | |
" <td>1</td>\n", | |
" <td>0</td>\n", | |
" <td>5accbe3a911fc423730f3ed3</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>5</th>\n", | |
" <td>Great for a quick, cheap lunch! Shorter lines than Chipotle too👌</td>\n", | |
" <td>1</td>\n", | |
" <td>0</td>\n", | |
" <td>5acbecb86fa81f1967e019b0</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>6</th>\n", | |
" <td>Quick, cheap lunch that tastes good! Way shorter line than Chipotle, too.</td>\n", | |
" <td>1</td>\n", | |
" <td>0</td>\n", | |
" <td>5acbec70a0215b732e264fe8</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>7</th>\n", | |
" <td>You’re not a real New Yorker until you’ve shame-ordered Insomnia Cookies for delivery at 3am</td>\n", | |
" <td>1</td>\n", | |
" <td>0</td>\n", | |
" <td>5acbbd4eb1538e45373b07f5</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>8</th>\n", | |
" <td>Good for you yet still tasty! Clean green protein is my go-to after I hit the gym 💪</td>\n", | |
" <td>2</td>\n", | |
" <td>0</td>\n", | |
" <td>5acbbcda01235808d5d6dc75</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>9</th>\n", | |
" <td>Coffee game on point</td>\n", | |
" <td>1</td>\n", | |
" <td>0</td>\n", | |
" <td>5acbbb1501235808d5d6525e</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>10</th>\n", | |
" <td>This is the dive bar to end all other dive bars. Go here if you like cheap drinks! 🥃</td>\n", | |
" <td>1</td>\n", | |
" <td>0</td>\n", | |
" <td>5ab576abea1e444f2abb051e</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>11</th>\n", | |
" <td>Burger game strong 💪</td>\n", | |
" <td>1</td>\n", | |
" <td>0</td>\n", | |
" <td>5ab575fb6bdee65f759da8c1</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>12</th>\n", | |
" <td>Great burgers & fries! Also, this place is exactly what it’s like when you go to a bar in the Southwest. Source: I’m from Arizona.</td>\n", | |
" <td>2</td>\n", | |
" <td>0</td>\n", | |
" <td>5ab5575d73fe2516ad8f363b</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>13</th>\n", | |
" <td>That guy looks familiar...</td>\n", | |
" <td>1</td>\n", | |
" <td>0</td>\n", | |
" <td>5ab5299635f98312029a53b7</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>14</th>\n", | |
" <td>Açaí bowl + peanut butter + whey protein = 💪💪💪</td>\n", | |
" <td>1</td>\n", | |
" <td>0</td>\n", | |
" <td>5ab42db53c858d64af2688a4</td>\n", | |
" </tr>\n", | |
" </tbody>\n", | |
"</table>\n", | |
"</div>" | |
], | |
"text/plain": [ | |
" text \\\n", | |
"0 The best! I’m especially fond of the salmon burger, but I’ve had half of the menu and never been disappointed. There’s a reason this place is well known even outside of the Village! \n", | |
"1 I used to down a pint of chocolate like it was nothing back when I was bulking. Highly recommended! \n", | |
"2 They serve coffee!!!!!! \n", | |
"3 I’m a fan. In fact, I’m such a big fan, I want Taim to hire me to be their spokesman. Kind of like the Arabic Jared Fogle - but without the kid stuff. \n", | |
"4 The linguine with clams is on point 👌 \n", | |
"5 Great for a quick, cheap lunch! Shorter lines than Chipotle too👌 \n", | |
"6 Quick, cheap lunch that tastes good! Way shorter line than Chipotle, too. \n", | |
"7 You’re not a real New Yorker until you’ve shame-ordered Insomnia Cookies for delivery at 3am \n", | |
"8 Good for you yet still tasty! Clean green protein is my go-to after I hit the gym 💪 \n", | |
"9 Coffee game on point \n", | |
"10 This is the dive bar to end all other dive bars. Go here if you like cheap drinks! 🥃 \n", | |
"11 Burger game strong 💪 \n", | |
"12 Great burgers & fries! Also, this place is exactly what it’s like when you go to a bar in the Southwest. Source: I’m from Arizona. \n", | |
"13 That guy looks familiar... \n", | |
"14 Açaí bowl + peanut butter + whey protein = 💪💪💪 \n", | |
"\n", | |
" agreeCount disagreeCount id \n", | |
"0 1 0 5aec594b1f7440002c138612 \n", | |
"1 1 0 5accc9f66fa81f196724807b \n", | |
"2 1 0 5accc98c0313204c9d7ec157 \n", | |
"3 1 0 5accbf033abcaf09a24612a0 \n", | |
"4 1 0 5accbe3a911fc423730f3ed3 \n", | |
"5 1 0 5acbecb86fa81f1967e019b0 \n", | |
"6 1 0 5acbec70a0215b732e264fe8 \n", | |
"7 1 0 5acbbd4eb1538e45373b07f5 \n", | |
"8 2 0 5acbbcda01235808d5d6dc75 \n", | |
"9 1 0 5acbbb1501235808d5d6525e \n", | |
"10 1 0 5ab576abea1e444f2abb051e \n", | |
"11 1 0 5ab575fb6bdee65f759da8c1 \n", | |
"12 2 0 5ab5575d73fe2516ad8f363b \n", | |
"13 1 0 5ab5299635f98312029a53b7 \n", | |
"14 1 0 5ab42db53c858d64af2688a4 " | |
] | |
}, | |
"execution_count": 39, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"# define tips URL\n", | |
"url = 'https://api.foursquare.com/v2/users/{}/tips?client_id={}&client_secret={}&v={}&limit={}'.format(user_id, CLIENT_ID, CLIENT_SECRET, VERSION, limit)\n", | |
"\n", | |
"# send GET request and get user's tips\n", | |
"results = requests.get(url).json()\n", | |
"tips = results['response']['tips']['items']\n", | |
"\n", | |
"# format column width\n", | |
"pd.set_option('display.max_colwidth', -1)\n", | |
"\n", | |
"tips_df = json_normalize(tips)\n", | |
"\n", | |
"# filter columns\n", | |
"filtered_columns = ['text', 'agreeCount', 'disagreeCount', 'id']\n", | |
"tips_filtered = tips_df.loc[:, filtered_columns]\n", | |
"\n", | |
"# display user's tips\n", | |
"tips_filtered" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Let's get the venue for the tip with the greatest number of agree counts" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 40, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"name": "stdout", | |
"output_type": "stream", | |
"text": [ | |
"Cowgirl\n", | |
"{'address': '519 Hudson St', 'crossStreet': 'at W 10th St', 'lat': 40.73373338282062, 'lng': -74.0062998849649, 'labeledLatLngs': [{'label': 'display', 'lat': 40.73373338282062, 'lng': -74.0062998849649}], 'postalCode': '10014', 'cc': 'US', 'city': 'New York', 'state': 'NY', 'country': 'United States', 'formattedAddress': ['519 Hudson St (at W 10th St)', 'New York, NY 10014', 'United States']}\n" | |
] | |
} | |
], | |
"source": [ | |
"tip_id = '5ab5575d73fe2516ad8f363b' # tip id\n", | |
"\n", | |
"# define URL\n", | |
"url = 'http://api.foursquare.com/v2/tips/{}?client_id={}&client_secret={}&v={}'.format(tip_id, CLIENT_ID, CLIENT_SECRET, VERSION)\n", | |
"\n", | |
"# send GET Request and examine results\n", | |
"result = requests.get(url).json()\n", | |
"print(result['response']['tip']['venue']['name'])\n", | |
"print(result['response']['tip']['venue']['location'])" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"### Get User's friends" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 41, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/html": [ | |
"<div>\n", | |
"<style scoped>\n", | |
" .dataframe tbody tr th:only-of-type {\n", | |
" vertical-align: middle;\n", | |
" }\n", | |
"\n", | |
" .dataframe tbody tr th {\n", | |
" vertical-align: top;\n", | |
" }\n", | |
"\n", | |
" .dataframe thead th {\n", | |
" text-align: right;\n", | |
" }\n", | |
"</style>\n", | |
"<table border=\"1\" class=\"dataframe\">\n", | |
" <thead>\n", | |
" <tr style=\"text-align: right;\">\n", | |
" <th></th>\n", | |
" </tr>\n", | |
" </thead>\n", | |
" <tbody>\n", | |
" </tbody>\n", | |
"</table>\n", | |
"</div>" | |
], | |
"text/plain": [ | |
"Empty DataFrame\n", | |
"Columns: []\n", | |
"Index: []" | |
] | |
}, | |
"execution_count": 41, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"user_friends = json_normalize(user_data['friends']['groups'][0]['items'])\n", | |
"user_friends" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"Interesting. Despite being very active, it turns out that Nick does not have any friends on Foursquare. This might definitely change in the future." | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"### Retrieve the User's Profile Image" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 42, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
}, | |
"scrolled": true | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"{'id': '484542633',\n", | |
" 'firstName': 'Nick',\n", | |
" 'lastName': 'El-Tawil',\n", | |
" 'gender': 'male',\n", | |
" 'canonicalUrl': 'https://foursquare.com/nickeltawil',\n", | |
" 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n", | |
" 'suffix': '/484542633_mK2Yum7T_7Tn9fWpndidJsmw2Hof_6T5vJBKCHPLMK5OL-U5ZiJGj51iwBstcpDLYa3Zvhvis.jpg'},\n", | |
" 'friends': {'count': 0,\n", | |
" 'groups': [{'type': 'others',\n", | |
" 'name': 'Other friends',\n", | |
" 'count': 0,\n", | |
" 'items': []}]},\n", | |
" 'tips': {'count': 239},\n", | |
" 'homeCity': 'New York, NY',\n", | |
" 'bio': 'https://www.tawil.team/nick-el-tawil/',\n", | |
" 'contact': {},\n", | |
" 'photos': {'count': 0, 'items': []},\n", | |
" 'type': 'user',\n", | |
" 'mayorships': {'count': 0, 'items': []},\n", | |
" 'checkins': {'count': 1, 'items': []},\n", | |
" 'lists': {'count': 2,\n", | |
" 'groups': [{'type': 'created', 'count': 0, 'items': []},\n", | |
" {'type': 'followed', 'count': 0, 'items': []},\n", | |
" {'type': 'yours',\n", | |
" 'count': 2,\n", | |
" 'items': [{'id': '484542633/todos',\n", | |
" 'name': \"Nick's Saved Places\",\n", | |
" 'description': '',\n", | |
" 'type': 'todos',\n", | |
" 'editable': False,\n", | |
" 'public': True,\n", | |
" 'collaborative': False,\n", | |
" 'url': '/nickeltawil/list/todos',\n", | |
" 'canonicalUrl': 'https://foursquare.com/nickeltawil/list/todos',\n", | |
" 'listItems': {'count': 0}},\n", | |
" {'id': '484542633/venuelikes',\n", | |
" 'name': 'Nick’s Liked Places',\n", | |
" 'description': '',\n", | |
" 'type': 'likes',\n", | |
" 'editable': False,\n", | |
" 'public': True,\n", | |
" 'collaborative': False,\n", | |
" 'url': '/nickeltawil/list/venuelikes',\n", | |
" 'canonicalUrl': 'https://foursquare.com/nickeltawil/list/venuelikes',\n", | |
" 'listItems': {'count': 0}}]}]},\n", | |
" 'lenses': []}" | |
] | |
}, | |
"execution_count": 42, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"user_data" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 43, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/html": [ | |
"<img src=\"https://igx.4sqi.net/img/user/300x300/484542633_mK2Yum7T_7Tn9fWpndidJsmw2Hof_6T5vJBKCHPLMK5OL-U5ZiJGj51iwBstcpDLYa3Zvhvis.jpg\"/>" | |
], | |
"text/plain": [ | |
"<IPython.core.display.Image object>" | |
] | |
}, | |
"execution_count": 43, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"# 1. grab prefix of photo\n", | |
"# 2. grab suffix of photo\n", | |
"# 3. concatenate them using the image size \n", | |
"Image(url='https://igx.4sqi.net/img/user/300x300/484542633_mK2Yum7T_7Tn9fWpndidJsmw2Hof_6T5vJBKCHPLMK5OL-U5ZiJGj51iwBstcpDLYa3Zvhvis.jpg')" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
" " | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"<a id=\"item4\"></a>" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"## 4. Explore a location\n", | |
"> `https://api.foursquare.com/v2/venues/`**explore**`?client_id=`**CLIENT_ID**`&client_secret=`**CLIENT_SECRET**`&ll=`**LATITUDE**`,`**LONGITUDE**`&v=`**VERSION**`&limit=`**LIMIT**" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### So, you just finished your gourmet dish at Ecco, and are just curious about the popular spots around the restaurant. In order to explore the area, let's start by getting the latitude and longitude values of Ecco Restaurant." | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 44, | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [], | |
"source": [ | |
"latitude = 40.715337\n", | |
"longitude = -74.008848" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Define URL" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 45, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"'https://api.foursquare.com/v2/venues/explore?client_id=RJRNPM53LPRPIQT1ZC2YQTVSLJ3CP3LXE3CRH0DVCO0LODOL&client_secret=XIADFIC2V4FL453CQEM0S22EMIGSXTYRUF5RS4E2XX40KKO3&ll=40.715337,-74.008848&v=20180604&radius=500&limit=30'" | |
] | |
}, | |
"execution_count": 45, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"url = 'https://api.foursquare.com/v2/venues/explore?client_id={}&client_secret={}&ll={},{}&v={}&radius={}&limit={}'.format(CLIENT_ID, CLIENT_SECRET, latitude, longitude, VERSION, radius, LIMIT)\n", | |
"url" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Send GET request and examine results" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 46, | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [], | |
"source": [ | |
"import requests" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 47, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"'There are 30 around Ecco restaurant.'" | |
] | |
}, | |
"execution_count": 47, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"results = requests.get(url).json()\n", | |
"'There are {} around Ecco restaurant.'.format(len(results['response']['groups'][0]['items']))" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Get relevant part of JSON" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 48, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"{'reasons': {'count': 0,\n", | |
" 'items': [{'summary': 'This spot is popular',\n", | |
" 'type': 'general',\n", | |
" 'reasonName': 'globalInteractionReason'}]},\n", | |
" 'venue': {'id': '4af5d65ff964a52091fd21e3',\n", | |
" 'name': 'Korin',\n", | |
" 'location': {'address': '57 Warren St',\n", | |
" 'crossStreet': 'Church St',\n", | |
" 'lat': 40.71482437714839,\n", | |
" 'lng': -74.00940425461492,\n", | |
" 'labeledLatLngs': [{'label': 'display',\n", | |
" 'lat': 40.71482437714839,\n", | |
" 'lng': -74.00940425461492}],\n", | |
" 'distance': 73,\n", | |
" 'postalCode': '10007',\n", | |
" 'cc': 'US',\n", | |
" 'neighborhood': 'Tribeca',\n", | |
" 'city': 'New York',\n", | |
" 'state': 'NY',\n", | |
" 'country': 'United States',\n", | |
" 'formattedAddress': ['57 Warren St (Church St)',\n", | |
" 'New York, NY 10007',\n", | |
" 'United States']},\n", | |
" 'categories': [{'id': '4bf58dd8d48988d1f8941735',\n", | |
" 'name': 'Furniture / Home Store',\n", | |
" 'pluralName': 'Furniture / Home Stores',\n", | |
" 'shortName': 'Furniture / Home',\n", | |
" 'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/shops/furniture_',\n", | |
" 'suffix': '.png'},\n", | |
" 'primary': True}],\n", | |
" 'photos': {'count': 0, 'groups': []},\n", | |
" 'venuePage': {'id': '33104775'}},\n", | |
" 'referralId': 'e-0-4af5d65ff964a52091fd21e3-0'}" | |
] | |
}, | |
"execution_count": 48, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"items = results['response']['groups'][0]['items']\n", | |
"items[0]" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Process JSON and convert it to a clean dataframe" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 49, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/html": [ | |
"<div>\n", | |
"<style scoped>\n", | |
" .dataframe tbody tr th:only-of-type {\n", | |
" vertical-align: middle;\n", | |
" }\n", | |
"\n", | |
" .dataframe tbody tr th {\n", | |
" vertical-align: top;\n", | |
" }\n", | |
"\n", | |
" .dataframe thead th {\n", | |
" text-align: right;\n", | |
" }\n", | |
"</style>\n", | |
"<table border=\"1\" class=\"dataframe\">\n", | |
" <thead>\n", | |
" <tr style=\"text-align: right;\">\n", | |
" <th></th>\n", | |
" <th>name</th>\n", | |
" <th>categories</th>\n", | |
" <th>address</th>\n", | |
" <th>crossStreet</th>\n", | |
" <th>lat</th>\n", | |
" <th>lng</th>\n", | |
" <th>labeledLatLngs</th>\n", | |
" <th>distance</th>\n", | |
" <th>postalCode</th>\n", | |
" <th>cc</th>\n", | |
" <th>neighborhood</th>\n", | |
" <th>city</th>\n", | |
" <th>state</th>\n", | |
" <th>country</th>\n", | |
" <th>formattedAddress</th>\n", | |
" <th>id</th>\n", | |
" </tr>\n", | |
" </thead>\n", | |
" <tbody>\n", | |
" <tr>\n", | |
" <th>0</th>\n", | |
" <td>Korin</td>\n", | |
" <td>Furniture / Home Store</td>\n", | |
" <td>57 Warren St</td>\n", | |
" <td>Church St</td>\n", | |
" <td>40.714824</td>\n", | |
" <td>-74.009404</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.71482437714839, 'lng': -74.00940425461492}]</td>\n", | |
" <td>73</td>\n", | |
" <td>10007</td>\n", | |
" <td>US</td>\n", | |
" <td>Tribeca</td>\n", | |
" <td>New York</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[57 Warren St (Church St), New York, NY 10007, United States]</td>\n", | |
" <td>4af5d65ff964a52091fd21e3</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>1</th>\n", | |
" <td>Juice Press</td>\n", | |
" <td>Vegetarian / Vegan Restaurant</td>\n", | |
" <td>83 Murray St</td>\n", | |
" <td>btwn Greenwich St & W Broadway</td>\n", | |
" <td>40.714788</td>\n", | |
" <td>-74.011132</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.71478769908051, 'lng': -74.0111317502157}]</td>\n", | |
" <td>202</td>\n", | |
" <td>10007</td>\n", | |
" <td>US</td>\n", | |
" <td>NaN</td>\n", | |
" <td>New York</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[83 Murray St (btwn Greenwich St & W Broadway), New York, NY 10007, United States]</td>\n", | |
" <td>54148bc6498ea7bb8c05b70a</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>2</th>\n", | |
" <td>Takahachi Bakery</td>\n", | |
" <td>Bakery</td>\n", | |
" <td>25 Murray St</td>\n", | |
" <td>at Church St</td>\n", | |
" <td>40.713653</td>\n", | |
" <td>-74.008804</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.713652845301894, 'lng': -74.0088038953017}]</td>\n", | |
" <td>187</td>\n", | |
" <td>10007</td>\n", | |
" <td>US</td>\n", | |
" <td>NaN</td>\n", | |
" <td>New York</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[25 Murray St (at Church St), New York, NY 10007, United States]</td>\n", | |
" <td>4c154c9a77cea593c401d260</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>3</th>\n", | |
" <td>Takahachi</td>\n", | |
" <td>Sushi Restaurant</td>\n", | |
" <td>145 Duane St</td>\n", | |
" <td>btwn W Broadway & Church St</td>\n", | |
" <td>40.716526</td>\n", | |
" <td>-74.008101</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.71652647412374, 'lng': -74.00810108466207}]</td>\n", | |
" <td>146</td>\n", | |
" <td>10013</td>\n", | |
" <td>US</td>\n", | |
" <td>NaN</td>\n", | |
" <td>New York</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[145 Duane St (btwn W Broadway & Church St), New York, NY 10013, United States]</td>\n", | |
" <td>4a8f2f39f964a520471420e3</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>4</th>\n", | |
" <td>Chambers Street Wines</td>\n", | |
" <td>Wine Shop</td>\n", | |
" <td>148 Chambers St</td>\n", | |
" <td>btwn West Broadway & Hudson St</td>\n", | |
" <td>40.715773</td>\n", | |
" <td>-74.009718</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.715773063928374, 'lng': -74.00971823312332}]</td>\n", | |
" <td>88</td>\n", | |
" <td>10007</td>\n", | |
" <td>US</td>\n", | |
" <td>NaN</td>\n", | |
" <td>New York</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[148 Chambers St (btwn West Broadway & Hudson St), New York, NY 10007, United States]</td>\n", | |
" <td>4adcf23cf964a520cc6221e3</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>5</th>\n", | |
" <td>Heyday</td>\n", | |
" <td>Spa</td>\n", | |
" <td>92 Reade St</td>\n", | |
" <td>NaN</td>\n", | |
" <td>40.715598</td>\n", | |
" <td>-74.007882</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.715598486687675, 'lng': -74.00788227511288}]</td>\n", | |
" <td>86</td>\n", | |
" <td>10013</td>\n", | |
" <td>US</td>\n", | |
" <td>NaN</td>\n", | |
" <td>New York</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[92 Reade St, New York, NY 10013, United States]</td>\n", | |
" <td>57ad129c498e05b086594d72</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>6</th>\n", | |
" <td>Philip Williams Posters</td>\n", | |
" <td>Antique Shop</td>\n", | |
" <td>122 Chambers St</td>\n", | |
" <td>NaN</td>\n", | |
" <td>40.715284</td>\n", | |
" <td>-74.008781</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.71528423132827, 'lng': -74.00878093952018}]</td>\n", | |
" <td>8</td>\n", | |
" <td>10007</td>\n", | |
" <td>US</td>\n", | |
" <td>NaN</td>\n", | |
" <td>New York</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[122 Chambers St, New York, NY 10007, United States]</td>\n", | |
" <td>4b747291f964a52042dd2de3</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>7</th>\n", | |
" <td>Equinox Tribeca</td>\n", | |
" <td>Gym</td>\n", | |
" <td>54 Murray Street</td>\n", | |
" <td>at W Broadway</td>\n", | |
" <td>40.714099</td>\n", | |
" <td>-74.009686</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.71409860726041, 'lng': -74.0096857179283}]</td>\n", | |
" <td>154</td>\n", | |
" <td>10007</td>\n", | |
" <td>US</td>\n", | |
" <td>NaN</td>\n", | |
" <td>New York</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[54 Murray Street (at W Broadway), New York, NY 10007, United States]</td>\n", | |
" <td>4a6e331af964a52031d41fe3</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>8</th>\n", | |
" <td>Mulberry & Vine</td>\n", | |
" <td>Café</td>\n", | |
" <td>73 Warren St</td>\n", | |
" <td>btwn W Broadway & Greenwich St</td>\n", | |
" <td>40.715177</td>\n", | |
" <td>-74.010227</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.71517693966315, 'lng': -74.01022747778285}]</td>\n", | |
" <td>117</td>\n", | |
" <td>10007</td>\n", | |
" <td>US</td>\n", | |
" <td>NaN</td>\n", | |
" <td>New York</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[73 Warren St (btwn W Broadway & Greenwich St), New York, NY 10007, United States]</td>\n", | |
" <td>5171b5cc011cef9833bbb787</td>\n", | |
" </tr>\n", | |
" <tr>\n", | |
" <th>9</th>\n", | |
" <td>Whole Foods Market</td>\n", | |
" <td>Grocery Store</td>\n", | |
" <td>270 Greenwich Street</td>\n", | |
" <td>at Warren St</td>\n", | |
" <td>40.715579</td>\n", | |
" <td>-74.011368</td>\n", | |
" <td>[{'label': 'display', 'lat': 40.715579155420606, 'lng': -74.01136823958119}]</td>\n", | |
" <td>214</td>\n", | |
" <td>10007</td>\n", | |
" <td>US</td>\n", | |
" <td>Tribeca</td>\n", | |
" <td>New York</td>\n", | |
" <td>NY</td>\n", | |
" <td>United States</td>\n", | |
" <td>[270 Greenwich Street (at Warren St), New York, NY 10007, United States]</td>\n", | |
" <td>49bc3b0af964a52020541fe3</td>\n", | |
" </tr>\n", | |
" </tbody>\n", | |
"</table>\n", | |
"</div>" | |
], | |
"text/plain": [ | |
" name categories \\\n", | |
"0 Korin Furniture / Home Store \n", | |
"1 Juice Press Vegetarian / Vegan Restaurant \n", | |
"2 Takahachi Bakery Bakery \n", | |
"3 Takahachi Sushi Restaurant \n", | |
"4 Chambers Street Wines Wine Shop \n", | |
"5 Heyday Spa \n", | |
"6 Philip Williams Posters Antique Shop \n", | |
"7 Equinox Tribeca Gym \n", | |
"8 Mulberry & Vine Café \n", | |
"9 Whole Foods Market Grocery Store \n", | |
"\n", | |
" address crossStreet lat lng \\\n", | |
"0 57 Warren St Church St 40.714824 -74.009404 \n", | |
"1 83 Murray St btwn Greenwich St & W Broadway 40.714788 -74.011132 \n", | |
"2 25 Murray St at Church St 40.713653 -74.008804 \n", | |
"3 145 Duane St btwn W Broadway & Church St 40.716526 -74.008101 \n", | |
"4 148 Chambers St btwn West Broadway & Hudson St 40.715773 -74.009718 \n", | |
"5 92 Reade St NaN 40.715598 -74.007882 \n", | |
"6 122 Chambers St NaN 40.715284 -74.008781 \n", | |
"7 54 Murray Street at W Broadway 40.714099 -74.009686 \n", | |
"8 73 Warren St btwn W Broadway & Greenwich St 40.715177 -74.010227 \n", | |
"9 270 Greenwich Street at Warren St 40.715579 -74.011368 \n", | |
"\n", | |
" labeledLatLngs \\\n", | |
"0 [{'label': 'display', 'lat': 40.71482437714839, 'lng': -74.00940425461492}] \n", | |
"1 [{'label': 'display', 'lat': 40.71478769908051, 'lng': -74.0111317502157}] \n", | |
"2 [{'label': 'display', 'lat': 40.713652845301894, 'lng': -74.0088038953017}] \n", | |
"3 [{'label': 'display', 'lat': 40.71652647412374, 'lng': -74.00810108466207}] \n", | |
"4 [{'label': 'display', 'lat': 40.715773063928374, 'lng': -74.00971823312332}] \n", | |
"5 [{'label': 'display', 'lat': 40.715598486687675, 'lng': -74.00788227511288}] \n", | |
"6 [{'label': 'display', 'lat': 40.71528423132827, 'lng': -74.00878093952018}] \n", | |
"7 [{'label': 'display', 'lat': 40.71409860726041, 'lng': -74.0096857179283}] \n", | |
"8 [{'label': 'display', 'lat': 40.71517693966315, 'lng': -74.01022747778285}] \n", | |
"9 [{'label': 'display', 'lat': 40.715579155420606, 'lng': -74.01136823958119}] \n", | |
"\n", | |
" distance postalCode cc neighborhood city state country \\\n", | |
"0 73 10007 US Tribeca New York NY United States \n", | |
"1 202 10007 US NaN New York NY United States \n", | |
"2 187 10007 US NaN New York NY United States \n", | |
"3 146 10013 US NaN New York NY United States \n", | |
"4 88 10007 US NaN New York NY United States \n", | |
"5 86 10013 US NaN New York NY United States \n", | |
"6 8 10007 US NaN New York NY United States \n", | |
"7 154 10007 US NaN New York NY United States \n", | |
"8 117 10007 US NaN New York NY United States \n", | |
"9 214 10007 US Tribeca New York NY United States \n", | |
"\n", | |
" formattedAddress \\\n", | |
"0 [57 Warren St (Church St), New York, NY 10007, United States] \n", | |
"1 [83 Murray St (btwn Greenwich St & W Broadway), New York, NY 10007, United States] \n", | |
"2 [25 Murray St (at Church St), New York, NY 10007, United States] \n", | |
"3 [145 Duane St (btwn W Broadway & Church St), New York, NY 10013, United States] \n", | |
"4 [148 Chambers St (btwn West Broadway & Hudson St), New York, NY 10007, United States] \n", | |
"5 [92 Reade St, New York, NY 10013, United States] \n", | |
"6 [122 Chambers St, New York, NY 10007, United States] \n", | |
"7 [54 Murray Street (at W Broadway), New York, NY 10007, United States] \n", | |
"8 [73 Warren St (btwn W Broadway & Greenwich St), New York, NY 10007, United States] \n", | |
"9 [270 Greenwich Street (at Warren St), New York, NY 10007, United States] \n", | |
"\n", | |
" id \n", | |
"0 4af5d65ff964a52091fd21e3 \n", | |
"1 54148bc6498ea7bb8c05b70a \n", | |
"2 4c154c9a77cea593c401d260 \n", | |
"3 4a8f2f39f964a520471420e3 \n", | |
"4 4adcf23cf964a520cc6221e3 \n", | |
"5 57ad129c498e05b086594d72 \n", | |
"6 4b747291f964a52042dd2de3 \n", | |
"7 4a6e331af964a52031d41fe3 \n", | |
"8 5171b5cc011cef9833bbb787 \n", | |
"9 49bc3b0af964a52020541fe3 " | |
] | |
}, | |
"execution_count": 49, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"dataframe = json_normalize(items) # flatten JSON\n", | |
"\n", | |
"# filter columns\n", | |
"filtered_columns = ['venue.name', 'venue.categories'] + [col for col in dataframe.columns if col.startswith('venue.location.')] + ['venue.id']\n", | |
"dataframe_filtered = dataframe.loc[:, filtered_columns]\n", | |
"\n", | |
"# filter the category for each row\n", | |
"dataframe_filtered['venue.categories'] = dataframe_filtered.apply(get_category_type, axis=1)\n", | |
"\n", | |
"# clean columns\n", | |
"dataframe_filtered.columns = [col.split('.')[-1] for col in dataframe_filtered.columns]\n", | |
"\n", | |
"dataframe_filtered.head(10)" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Let's visualize these items on the map around our location" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 50, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/html": [ | |
"<div style=\"width:100%;\"><div style=\"position:relative;width:100%;height:0;padding-bottom:60%;\"><iframe src=\"data:text/html;charset=utf-8;base64,PCFET0NUWVBFIGh0bWw+CjxoZWFkPiAgICAKICAgIDxtZXRhIGh0dHAtZXF1aXY9ImNvbnRlbnQtdHlwZSIgY29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PVVURi04IiAvPgogICAgPHNjcmlwdD5MX1BSRUZFUl9DQU5WQVMgPSBmYWxzZTsgTF9OT19UT1VDSCA9IGZhbHNlOyBMX0RJU0FCTEVfM0QgPSBmYWxzZTs8L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL2Nkbi5qc2RlbGl2ci5uZXQvbnBtL2xlYWZsZXRAMS4yLjAvZGlzdC9sZWFmbGV0LmpzIj48L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL2FqYXguZ29vZ2xlYXBpcy5jb20vYWpheC9saWJzL2pxdWVyeS8xLjExLjEvanF1ZXJ5Lm1pbi5qcyI+PC9zY3JpcHQ+CiAgICA8c2NyaXB0IHNyYz0iaHR0cHM6Ly9tYXhjZG4uYm9vdHN0cmFwY2RuLmNvbS9ib290c3RyYXAvMy4yLjAvanMvYm9vdHN0cmFwLm1pbi5qcyI+PC9zY3JpcHQ+CiAgICA8c2NyaXB0IHNyYz0iaHR0cHM6Ly9jZG5qcy5jbG91ZGZsYXJlLmNvbS9hamF4L2xpYnMvTGVhZmxldC5hd2Vzb21lLW1hcmtlcnMvMi4wLjIvbGVhZmxldC5hd2Vzb21lLW1hcmtlcnMuanMiPjwvc2NyaXB0PgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL2Nkbi5qc2RlbGl2ci5uZXQvbnBtL2xlYWZsZXRAMS4yLjAvZGlzdC9sZWFmbGV0LmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL21heGNkbi5ib290c3RyYXBjZG4uY29tL2Jvb3RzdHJhcC8zLjIuMC9jc3MvYm9vdHN0cmFwLm1pbi5jc3MiLz4KICAgIDxsaW5rIHJlbD0ic3R5bGVzaGVldCIgaHJlZj0iaHR0cHM6Ly9tYXhjZG4uYm9vdHN0cmFwY2RuLmNvbS9ib290c3RyYXAvMy4yLjAvY3NzL2Jvb3RzdHJhcC10aGVtZS5taW4uY3NzIi8+CiAgICA8bGluayByZWw9InN0eWxlc2hlZXQiIGhyZWY9Imh0dHBzOi8vbWF4Y2RuLmJvb3RzdHJhcGNkbi5jb20vZm9udC1hd2Vzb21lLzQuNi4zL2Nzcy9mb250LWF3ZXNvbWUubWluLmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL2NkbmpzLmNsb3VkZmxhcmUuY29tL2FqYXgvbGlicy9MZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy8yLjAuMi9sZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy5jc3MiLz4KICAgIDxsaW5rIHJlbD0ic3R5bGVzaGVldCIgaHJlZj0iaHR0cHM6Ly9yYXdnaXQuY29tL3B5dGhvbi12aXN1YWxpemF0aW9uL2ZvbGl1bS9tYXN0ZXIvZm9saXVtL3RlbXBsYXRlcy9sZWFmbGV0LmF3ZXNvbWUucm90YXRlLmNzcyIvPgogICAgPHN0eWxlPmh0bWwsIGJvZHkge3dpZHRoOiAxMDAlO2hlaWdodDogMTAwJTttYXJnaW46IDA7cGFkZGluZzogMDt9PC9zdHlsZT4KICAgIDxzdHlsZT4jbWFwIHtwb3NpdGlvbjphYnNvbHV0ZTt0b3A6MDtib3R0b206MDtyaWdodDowO2xlZnQ6MDt9PC9zdHlsZT4KICAgIAogICAgICAgICAgICA8c3R5bGU+ICNtYXBfYjNiOGVkNDQzNjk4NDY5ZGI4NmMzOGM5MDE5OGYyMWUgewogICAgICAgICAgICAgICAgcG9zaXRpb24gOiByZWxhdGl2ZTsKICAgICAgICAgICAgICAgIHdpZHRoIDogMTAwLjAlOwogICAgICAgICAgICAgICAgaGVpZ2h0OiAxMDAuMCU7CiAgICAgICAgICAgICAgICBsZWZ0OiAwLjAlOwogICAgICAgICAgICAgICAgdG9wOiAwLjAlOwogICAgICAgICAgICAgICAgfQogICAgICAgICAgICA8L3N0eWxlPgogICAgICAgIAo8L2hlYWQ+Cjxib2R5PiAgICAKICAgIAogICAgICAgICAgICA8ZGl2IGNsYXNzPSJmb2xpdW0tbWFwIiBpZD0ibWFwX2IzYjhlZDQ0MzY5ODQ2OWRiODZjMzhjOTAxOThmMjFlIiA+PC9kaXY+CiAgICAgICAgCjwvYm9keT4KPHNjcmlwdD4gICAgCiAgICAKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGJvdW5kcyA9IG51bGw7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgdmFyIG1hcF9iM2I4ZWQ0NDM2OTg0NjlkYjg2YzM4YzkwMTk4ZjIxZSA9IEwubWFwKAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgJ21hcF9iM2I4ZWQ0NDM2OTg0NjlkYjg2YzM4YzkwMTk4ZjIxZScsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB7Y2VudGVyOiBbNDAuNzE1MzM3LC03NC4wMDg4NDhdLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgem9vbTogMTUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtYXhCb3VuZHM6IGJvdW5kcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGxheWVyczogW10sCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB3b3JsZENvcHlKdW1wOiBmYWxzZSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGNyczogTC5DUlMuRVBTRzM4NTcKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgfSk7CiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciB0aWxlX2xheWVyX2Y0YmI0NDBjNmMyNjRlNDdhNDhmNzQ5MGYxNTkyYzYxID0gTC50aWxlTGF5ZXIoCiAgICAgICAgICAgICAgICAnaHR0cHM6Ly97c30udGlsZS5vcGVuc3RyZWV0bWFwLm9yZy97en0ve3h9L3t5fS5wbmcnLAogICAgICAgICAgICAgICAgewogICJhdHRyaWJ1dGlvbiI6IG51bGwsCiAgImRldGVjdFJldGluYSI6IGZhbHNlLAogICJtYXhab29tIjogMTgsCiAgIm1pblpvb20iOiAxLAogICJub1dyYXAiOiBmYWxzZSwKICAic3ViZG9tYWlucyI6ICJhYmMiCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2IzYjhlZDQ0MzY5ODQ2OWRiODZjMzhjOTAxOThmMjFlKTsKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl83YmJiYzFkYzJhMjA0ZTQ0ODc5MTc2NjcwZWIyOTI4NyA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjcxNTMzNywtNzQuMDA4ODQ4XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogInJlZCIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogInJlZCIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogMTAsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfYjNiOGVkNDQzNjk4NDY5ZGI4NmMzOGM5MDE5OGYyMWUpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfZTM0YTQ4YzJmZjcxNGQwZjkzZTFmZTYyYzgyODJkOTkgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfNDZjMjlmYzA0NzQzNDQ3OGJiMTg0YjA3ODU3ODRlM2UgPSAkKCc8ZGl2IGlkPSJodG1sXzQ2YzI5ZmMwNDc0MzQ0NzhiYjE4NGIwNzg1Nzg0ZTNlIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5FY2NvPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF9lMzRhNDhjMmZmNzE0ZDBmOTNlMWZlNjJjODI4MmQ5OS5zZXRDb250ZW50KGh0bWxfNDZjMjlmYzA0NzQzNDQ3OGJiMTg0YjA3ODU3ODRlM2UpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfN2JiYmMxZGMyYTIwNGU0NDg3OTE3NjY3MGViMjkyODcuYmluZFBvcHVwKHBvcHVwX2UzNGE0OGMyZmY3MTRkMGY5M2UxZmU2MmM4MjgyZDk5KTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzNjM2VhYmIzMzFhNTRkYzFhNzFmNjk4NjYzYWM4MDllID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzE0ODI0Mzc3MTQ4MzksLTc0LjAwOTQwNDI1NDYxNDkyXSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2IzYjhlZDQ0MzY5ODQ2OWRiODZjMzhjOTAxOThmMjFlKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzgwZDllYjFiOTIzMzRhM2JiM2UzODFlYThmNDE3ZmUzID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzY4YTNlMDdiN2UxMTRhYjlhMzY1MmE0MjE1ZmM3YjhjID0gJCgnPGRpdiBpZD0iaHRtbF82OGEzZTA3YjdlMTE0YWI5YTM2NTJhNDIxNWZjN2I4YyIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+RnVybml0dXJlIC8gSG9tZSBTdG9yZTwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfODBkOWViMWI5MjMzNGEzYmIzZTM4MWVhOGY0MTdmZTMuc2V0Q29udGVudChodG1sXzY4YTNlMDdiN2UxMTRhYjlhMzY1MmE0MjE1ZmM3YjhjKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzNjM2VhYmIzMzFhNTRkYzFhNzFmNjk4NjYzYWM4MDllLmJpbmRQb3B1cChwb3B1cF84MGQ5ZWIxYjkyMzM0YTNiYjNlMzgxZWE4ZjQxN2ZlMyk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl82N2I3MzFmOTZhM2Q0ZTMxODQzMTUyOTFlZWMyZDFjOSA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjcxNDc4NzY5OTA4MDUxLC03NC4wMTExMzE3NTAyMTU3XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2IzYjhlZDQ0MzY5ODQ2OWRiODZjMzhjOTAxOThmMjFlKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2U0ZWJiMTI5YjAxODQ1YTk4ODQ5MTJhYTA1YzkzNTg1ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzhjY2EyZWVlNDQ4ODRkYmU5ZWQ3ZjBlYTRhN2NhN2U2ID0gJCgnPGRpdiBpZD0iaHRtbF84Y2NhMmVlZTQ0ODg0ZGJlOWVkN2YwZWE0YTdjYTdlNiIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+VmVnZXRhcmlhbiAvIFZlZ2FuIFJlc3RhdXJhbnQ8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2U0ZWJiMTI5YjAxODQ1YTk4ODQ5MTJhYTA1YzkzNTg1LnNldENvbnRlbnQoaHRtbF84Y2NhMmVlZTQ0ODg0ZGJlOWVkN2YwZWE0YTdjYTdlNik7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl82N2I3MzFmOTZhM2Q0ZTMxODQzMTUyOTFlZWMyZDFjOS5iaW5kUG9wdXAocG9wdXBfZTRlYmIxMjliMDE4NDVhOTg4NDkxMmFhMDVjOTM1ODUpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfOTU1YTQyODRlODExNDk5MWExN2FiYmZhYmM3NDJlNTEgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43MTM2NTI4NDUzMDE4OTQsLTc0LjAwODgwMzg5NTMwMTddLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfYjNiOGVkNDQzNjk4NDY5ZGI4NmMzOGM5MDE5OGYyMWUpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfNzNlNTc2ZDZlMjllNDYwNzliNjI2NTQ4NmI1ZWM2NDggPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfMWM3YTMwZDU3NTdiNDQ5MWIyMWU0NmY5OTA3MTk5ZGEgPSAkKCc8ZGl2IGlkPSJodG1sXzFjN2EzMGQ1NzU3YjQ0OTFiMjFlNDZmOTkwNzE5OWRhIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5CYWtlcnk8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzczZTU3NmQ2ZTI5ZTQ2MDc5YjYyNjU0ODZiNWVjNjQ4LnNldENvbnRlbnQoaHRtbF8xYzdhMzBkNTc1N2I0NDkxYjIxZTQ2Zjk5MDcxOTlkYSk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl85NTVhNDI4NGU4MTE0OTkxYTE3YWJiZmFiYzc0MmU1MS5iaW5kUG9wdXAocG9wdXBfNzNlNTc2ZDZlMjllNDYwNzliNjI2NTQ4NmI1ZWM2NDgpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfZGEyYzQ1YzNhNWU1NDQyY2E5ZmMwZTJiZGMyNzVmODIgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43MTY1MjY0NzQxMjM3NCwtNzQuMDA4MTAxMDg0NjYyMDddLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfYjNiOGVkNDQzNjk4NDY5ZGI4NmMzOGM5MDE5OGYyMWUpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfYzhkMjY2Y2RhN2U0NDkxNmFmYjA2NmIxMmM5ZTI1MGYgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfZTRiY2Q1N2UwMjFhNDQyYjhhYjRkN2MwNWYyMTNmMGEgPSAkKCc8ZGl2IGlkPSJodG1sX2U0YmNkNTdlMDIxYTQ0MmI4YWI0ZDdjMDVmMjEzZjBhIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5TdXNoaSBSZXN0YXVyYW50PC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF9jOGQyNjZjZGE3ZTQ0OTE2YWZiMDY2YjEyYzllMjUwZi5zZXRDb250ZW50KGh0bWxfZTRiY2Q1N2UwMjFhNDQyYjhhYjRkN2MwNWYyMTNmMGEpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfZGEyYzQ1YzNhNWU1NDQyY2E5ZmMwZTJiZGMyNzVmODIuYmluZFBvcHVwKHBvcHVwX2M4ZDI2NmNkYTdlNDQ5MTZhZmIwNjZiMTJjOWUyNTBmKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzAxMGIyYTViOThiNzRlZDE4YjQyN2Y2MzM0NjI0NGJiID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzE1NzczMDYzOTI4Mzc0LC03NC4wMDk3MTgyMzMxMjMzMl0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9iM2I4ZWQ0NDM2OTg0NjlkYjg2YzM4YzkwMTk4ZjIxZSk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF82YzdhZGE5ZWZmZWI0MWVkYTRiZTVjM2JmODgyOWIzOCA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF9lODVjNzZlMGU0ZDE0MzM3OTBkNzBmZWJiZjU4MDFmZSA9ICQoJzxkaXYgaWQ9Imh0bWxfZTg1Yzc2ZTBlNGQxNDMzNzkwZDcwZmViYmY1ODAxZmUiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPldpbmUgU2hvcDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfNmM3YWRhOWVmZmViNDFlZGE0YmU1YzNiZjg4MjliMzguc2V0Q29udGVudChodG1sX2U4NWM3NmUwZTRkMTQzMzc5MGQ3MGZlYmJmNTgwMWZlKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzAxMGIyYTViOThiNzRlZDE4YjQyN2Y2MzM0NjI0NGJiLmJpbmRQb3B1cChwb3B1cF82YzdhZGE5ZWZmZWI0MWVkYTRiZTVjM2JmODgyOWIzOCk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl85NWU0OWUxYTI2MzE0MThmOTY4ZWU5ZGM1ZmJmYTk2MyA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjcxNTU5ODQ4NjY4NzY3NSwtNzQuMDA3ODgyMjc1MTEyODhdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfYjNiOGVkNDQzNjk4NDY5ZGI4NmMzOGM5MDE5OGYyMWUpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfZGRiYWFjYjlkZjVjNGEwYmExNmI3ZDAwMTcyZmUwNjkgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfODg0MDNkMWM3MjcyNDM4YWIwZWMzYzUzYTQzYmFmZjggPSAkKCc8ZGl2IGlkPSJodG1sXzg4NDAzZDFjNzI3MjQzOGFiMGVjM2M1M2E0M2JhZmY4IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5TcGE8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2RkYmFhY2I5ZGY1YzRhMGJhMTZiN2QwMDE3MmZlMDY5LnNldENvbnRlbnQoaHRtbF84ODQwM2QxYzcyNzI0MzhhYjBlYzNjNTNhNDNiYWZmOCk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl85NWU0OWUxYTI2MzE0MThmOTY4ZWU5ZGM1ZmJmYTk2My5iaW5kUG9wdXAocG9wdXBfZGRiYWFjYjlkZjVjNGEwYmExNmI3ZDAwMTcyZmUwNjkpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfMzRiMWFlMWNlYzhhNDRlMzk5ZTQ0ODEyNWJkOWQwNjggPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43MTUyODQyMzEzMjgyNywtNzQuMDA4NzgwOTM5NTIwMThdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfYjNiOGVkNDQzNjk4NDY5ZGI4NmMzOGM5MDE5OGYyMWUpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfZjQ0MmJjZDk5NWU1NDdiZWI0MjA4NWQzZGM5ODE4NjAgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfMDcxZmExOTJhZDE2NGRkMzllYjZjOGY0YTJiM2RlMGYgPSAkKCc8ZGl2IGlkPSJodG1sXzA3MWZhMTkyYWQxNjRkZDM5ZWI2YzhmNGEyYjNkZTBmIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5BbnRpcXVlIFNob3A8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2Y0NDJiY2Q5OTVlNTQ3YmViNDIwODVkM2RjOTgxODYwLnNldENvbnRlbnQoaHRtbF8wNzFmYTE5MmFkMTY0ZGQzOWViNmM4ZjRhMmIzZGUwZik7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl8zNGIxYWUxY2VjOGE0NGUzOTllNDQ4MTI1YmQ5ZDA2OC5iaW5kUG9wdXAocG9wdXBfZjQ0MmJjZDk5NWU1NDdiZWI0MjA4NWQzZGM5ODE4NjApOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfOTA3ZThiODQ1YjU0NDI4Y2IyYzZiNjBiZTI3YjFjOWIgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43MTQwOTg2MDcyNjA0MSwtNzQuMDA5Njg1NzE3OTI4M10sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9iM2I4ZWQ0NDM2OTg0NjlkYjg2YzM4YzkwMTk4ZjIxZSk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF9jMzVhMDliODIwZmI0NzI1ODM3Y2ZlNWJjNDA0ODI2MSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF8yNDQ2MDNiMGY4NzI0NTFmOTdkMTdjMjM4NWY2YjhkZSA9ICQoJzxkaXYgaWQ9Imh0bWxfMjQ0NjAzYjBmODcyNDUxZjk3ZDE3YzIzODVmNmI4ZGUiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkd5bTwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfYzM1YTA5YjgyMGZiNDcyNTgzN2NmZTViYzQwNDgyNjEuc2V0Q29udGVudChodG1sXzI0NDYwM2IwZjg3MjQ1MWY5N2QxN2MyMzg1ZjZiOGRlKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzkwN2U4Yjg0NWI1NDQyOGNiMmM2YjYwYmUyN2IxYzliLmJpbmRQb3B1cChwb3B1cF9jMzVhMDliODIwZmI0NzI1ODM3Y2ZlNWJjNDA0ODI2MSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9hM2U2MTVkMzM0N2E0YjU3YTU4OWQ4NjRmYTU1MzEyMCA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjcxNTE3NjkzOTY2MzE1LC03NC4wMTAyMjc0Nzc3ODI4NV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9iM2I4ZWQ0NDM2OTg0NjlkYjg2YzM4YzkwMTk4ZjIxZSk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF83YTM2MTUxMDNmY2Y0MWU4ODAxMzYyMzk0Y2EyMjdkNyA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF8zZmU2NTQyN2M3ZDE0MTQzODM5YWEyMjI2Zjg4ODI3NCA9ICQoJzxkaXYgaWQ9Imh0bWxfM2ZlNjU0MjdjN2QxNDE0MzgzOWFhMjIyNmY4ODgyNzQiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkNhZsOpPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF83YTM2MTUxMDNmY2Y0MWU4ODAxMzYyMzk0Y2EyMjdkNy5zZXRDb250ZW50KGh0bWxfM2ZlNjU0MjdjN2QxNDE0MzgzOWFhMjIyNmY4ODgyNzQpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfYTNlNjE1ZDMzNDdhNGI1N2E1ODlkODY0ZmE1NTMxMjAuYmluZFBvcHVwKHBvcHVwXzdhMzYxNTEwM2ZjZjQxZTg4MDEzNjIzOTRjYTIyN2Q3KTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzJiMWE1MGI0NzY1MDQ0MDliODFlZjA1OTI5MTczMDEyID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzE1NTc5MTU1NDIwNjA2LC03NC4wMTEzNjgyMzk1ODExOV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9iM2I4ZWQ0NDM2OTg0NjlkYjg2YzM4YzkwMTk4ZjIxZSk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF9jNDgzZDEzYTk1YjU0MmU0OTU0NjdjZjBhYWQxYzRjNiA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF9jNmQ3MDA2MWM5OTY0YTUxYjg1M2IwZTQ0MDA3MzE2MyA9ICQoJzxkaXYgaWQ9Imh0bWxfYzZkNzAwNjFjOTk2NGE1MWI4NTNiMGU0NDAwNzMxNjMiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkdyb2NlcnkgU3RvcmU8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2M0ODNkMTNhOTViNTQyZTQ5NTQ2N2NmMGFhZDFjNGM2LnNldENvbnRlbnQoaHRtbF9jNmQ3MDA2MWM5OTY0YTUxYjg1M2IwZTQ0MDA3MzE2Myk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl8yYjFhNTBiNDc2NTA0NDA5YjgxZWYwNTkyOTE3MzAxMi5iaW5kUG9wdXAocG9wdXBfYzQ4M2QxM2E5NWI1NDJlNDk1NDY3Y2YwYWFkMWM0YzYpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfNWFhMDYzOGJiYTU0NDE2MTlmYzcxOWMyMzNiZjM3ZGMgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43MTU1MzcxMDExNjQxNiwtNzQuMDA3NzI0NTI5MjU1NjVdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfYjNiOGVkNDQzNjk4NDY5ZGI4NmMzOGM5MDE5OGYyMWUpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfZTRkYzQ1MzI1N2U3NGU5YmI2NjI0ZDZiNTJjODZjNDggPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfYjM5MWUyMWI4NTA5NDQzNTkwMmIxMjg1MzM1MzY0MWYgPSAkKCc8ZGl2IGlkPSJodG1sX2IzOTFlMjFiODUwOTQ0MzU5MDJiMTI4NTMzNTM2NDFmIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5GYWxhZmVsIFJlc3RhdXJhbnQ8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2U0ZGM0NTMyNTdlNzRlOWJiNjYyNGQ2YjUyYzg2YzQ4LnNldENvbnRlbnQoaHRtbF9iMzkxZTIxYjg1MDk0NDM1OTAyYjEyODUzMzUzNjQxZik7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl81YWEwNjM4YmJhNTQ0MTYxOWZjNzE5YzIzM2JmMzdkYy5iaW5kUG9wdXAocG9wdXBfZTRkYzQ1MzI1N2U3NGU5YmI2NjI0ZDZiNTJjODZjNDgpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfOWUxOTczOWRkZWNkNDk4YWJlYTFkZjk4ZWMzOTk5MDggPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43MTU2Mjg2MjAwMjU2LC03NC4wMDc5OTIyNTgzODUzXSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2IzYjhlZDQ0MzY5ODQ2OWRiODZjMzhjOTAxOThmMjFlKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzgxNWRhNjY2Nzc2YzRkN2JiMmZhY2FjZWI0MDFkN2RlID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2QyY2ZlODA3MjJlMDQ2ZTA5ZmFiOWZiMjI5YWNlODRiID0gJCgnPGRpdiBpZD0iaHRtbF9kMmNmZTgwNzIyZTA0NmUwOWZhYjlmYjIyOWFjZTg0YiIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+R3ltIC8gRml0bmVzcyBDZW50ZXI8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzgxNWRhNjY2Nzc2YzRkN2JiMmZhY2FjZWI0MDFkN2RlLnNldENvbnRlbnQoaHRtbF9kMmNmZTgwNzIyZTA0NmUwOWZhYjlmYjIyOWFjZTg0Yik7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl85ZTE5NzM5ZGRlY2Q0OThhYmVhMWRmOThlYzM5OTkwOC5iaW5kUG9wdXAocG9wdXBfODE1ZGE2NjY3NzZjNGQ3YmIyZmFjYWNlYjQwMWQ3ZGUpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfZWZkNTY1NjFiNmQ2NDAwOThkNDA1YWY0ZjMwZWU5M2YgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43MTU0ODY1ODUyNDk3MzUsLTc0LjAwOTEzMzEzNTEwODM2XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2IzYjhlZDQ0MzY5ODQ2OWRiODZjMzhjOTAxOThmMjFlKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzM1MWQwM2UwNDQxYzRhMDc5OGE4MTZiNmIwOThiYmRjID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2ExMTRiNzE1ZWQ2ODQ2YmM4ZmM2YTUyN2E1YjE0NDJkID0gJCgnPGRpdiBpZD0iaHRtbF9hMTE0YjcxNWVkNjg0NmJjOGZjNmE1MjdhNWIxNDQyZCIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+QW1lcmljYW4gUmVzdGF1cmFudDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfMzUxZDAzZTA0NDFjNGEwNzk4YTgxNmI2YjA5OGJiZGMuc2V0Q29udGVudChodG1sX2ExMTRiNzE1ZWQ2ODQ2YmM4ZmM2YTUyN2E1YjE0NDJkKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyX2VmZDU2NTYxYjZkNjQwMDk4ZDQwNWFmNGYzMGVlOTNmLmJpbmRQb3B1cChwb3B1cF8zNTFkMDNlMDQ0MWM0YTA3OThhODE2YjZiMDk4YmJkYyk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl81ZWNlZWYxMTdlN2I0MjQ3ODY5YjAxZGI4NzVlMDMxNiA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjcxNDM1LC03NC4wMDk4XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2IzYjhlZDQ0MzY5ODQ2OWRiODZjMzhjOTAxOThmMjFlKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2U3NTBlY2JmYjZmZjQ4MTZiZjdhY2UwYmQ5M2U5ZGIxID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2IyNTY3NWNmZWU3MjQxZTZiMzBmYTdhNzc3ZmRkNjViID0gJCgnPGRpdiBpZD0iaHRtbF9iMjU2NzVjZmVlNzI0MWU2YjMwZmE3YTc3N2ZkZDY1YiIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+U3RyaXAgQ2x1YjwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfZTc1MGVjYmZiNmZmNDgxNmJmN2FjZTBiZDkzZTlkYjEuc2V0Q29udGVudChodG1sX2IyNTY3NWNmZWU3MjQxZTZiMzBmYTdhNzc3ZmRkNjViKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzVlY2VlZjExN2U3YjQyNDc4NjliMDFkYjg3NWUwMzE2LmJpbmRQb3B1cChwb3B1cF9lNzUwZWNiZmI2ZmY0ODE2YmY3YWNlMGJkOTNlOWRiMSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9lOTVmYWJiZmFiOGM0MzUyYTVjZTA1ZjkwOGU1ZjYyYiA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjcxNjc5MzA0ODU1ODA4LC03NC4wMDgyMTk5ODg3ODQ1N10sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9iM2I4ZWQ0NDM2OTg0NjlkYjg2YzM4YzkwMTk4ZjIxZSk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF9jY2ZiZDRmZmE2YjY0M2Y1YWVmODEwYTkwMGQ4ZjA1ZiA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF8zYjUwYjcyYzg1MjE0MGFiOWU3ZWFjMDhmOTFlODBkYSA9ICQoJzxkaXYgaWQ9Imh0bWxfM2I1MGI3MmM4NTIxNDBhYjllN2VhYzA4ZjkxZTgwZGEiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkFtZXJpY2FuIFJlc3RhdXJhbnQ8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2NjZmJkNGZmYTZiNjQzZjVhZWY4MTBhOTAwZDhmMDVmLnNldENvbnRlbnQoaHRtbF8zYjUwYjcyYzg1MjE0MGFiOWU3ZWFjMDhmOTFlODBkYSk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9lOTVmYWJiZmFiOGM0MzUyYTVjZTA1ZjkwOGU1ZjYyYi5iaW5kUG9wdXAocG9wdXBfY2NmYmQ0ZmZhNmI2NDNmNWFlZjgxMGE5MDBkOGYwNWYpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfYjgyYzhjMzQyN2Y0NGIyNDkyYzQ1YWYzNGY0YjdkNzIgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43MTQ5MDk1MDE1Mzk4MiwtNzQuMDA5NDgwMjcwMTE5MDNdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfYjNiOGVkNDQzNjk4NDY5ZGI4NmMzOGM5MDE5OGYyMWUpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfNWM2MDM4NGJlZTZjNDdiY2I2ODQwNzBlZTI1NjAyZWMgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfOGY0YzEzMTE2ZGM1NGMyNGJmMDI2YmNiYWY1MDUwNDggPSAkKCc8ZGl2IGlkPSJodG1sXzhmNGMxMzExNmRjNTRjMjRiZjAyNmJjYmFmNTA1MDQ4IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Cb29rc3RvcmU8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzVjNjAzODRiZWU2YzQ3YmNiNjg0MDcwZWUyNTYwMmVjLnNldENvbnRlbnQoaHRtbF84ZjRjMTMxMTZkYzU0YzI0YmYwMjZiY2JhZjUwNTA0OCk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9iODJjOGMzNDI3ZjQ0YjI0OTJjNDVhZjM0ZjRiN2Q3Mi5iaW5kUG9wdXAocG9wdXBfNWM2MDM4NGJlZTZjNDdiY2I2ODQwNzBlZTI1NjAyZWMpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfZTQ5NzkyN2RkNjRlNDU0Yjg0YzVmZjFhY2RiZWRmNWQgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43MTY3NDA4NDE2MzM2OSwtNzQuMDA4NjY2NDQzODg5M10sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9iM2I4ZWQ0NDM2OTg0NjlkYjg2YzM4YzkwMTk4ZjIxZSk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF9lMjljNzQxNWNmNmE0NTM2YTkzNDdlZjM5MjhjYWQ1YyA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF9lMjFmYzQ4NDZkYTI0YTZjOWUyNDA5NTk0N2I5MGNmYSA9ICQoJzxkaXYgaWQ9Imh0bWxfZTIxZmM0ODQ2ZGEyNGE2YzllMjQwOTU5NDdiOTBjZmEiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkNvY2t0YWlsIEJhcjwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfZTI5Yzc0MTVjZjZhNDUzNmE5MzQ3ZWYzOTI4Y2FkNWMuc2V0Q29udGVudChodG1sX2UyMWZjNDg0NmRhMjRhNmM5ZTI0MDk1OTQ3YjkwY2ZhKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyX2U0OTc5MjdkZDY0ZTQ1NGI4NGM1ZmYxYWNkYmVkZjVkLmJpbmRQb3B1cChwb3B1cF9lMjljNzQxNWNmNmE0NTM2YTkzNDdlZjM5MjhjYWQ1Yyk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl8yYzkzNjc5N2I1MjQ0ZjA1OTRkZDM4ZjM2ZTE3NThmNCA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjcxNjM3OTg0MzE3MDcxLC03NC4wMDk2MjkzMzQ1MzQyOF0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9iM2I4ZWQ0NDM2OTg0NjlkYjg2YzM4YzkwMTk4ZjIxZSk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF9hY2FjMTc4ZDY0N2U0N2E0YTNhMDU4NWY5ODdhZTZjYSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF9iYzJmYmE5YTUxYmQ0MDhlOTE4OTI4NTNmNTBiNTM1NCA9ICQoJzxkaXYgaWQ9Imh0bWxfYmMyZmJhOWE1MWJkNDA4ZTkxODkyODUzZjUwYjUzNTQiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPk5ldyBBbWVyaWNhbiBSZXN0YXVyYW50PC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF9hY2FjMTc4ZDY0N2U0N2E0YTNhMDU4NWY5ODdhZTZjYS5zZXRDb250ZW50KGh0bWxfYmMyZmJhOWE1MWJkNDA4ZTkxODkyODUzZjUwYjUzNTQpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfMmM5MzY3OTdiNTI0NGYwNTk0ZGQzOGYzNmUxNzU4ZjQuYmluZFBvcHVwKHBvcHVwX2FjYWMxNzhkNjQ3ZTQ3YTRhM2EwNTg1Zjk4N2FlNmNhKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzA3ZGM1OWRhOWIwMTQ1ZGNhMjk2NTE4ODgwYzViODE5ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzE2NzUyODE2ODc2NjM1LC03NC4wMDg1ODM3NjI5NTIyMV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9iM2I4ZWQ0NDM2OTg0NjlkYjg2YzM4YzkwMTk4ZjIxZSk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF85MDZkNmQzODBhMGY0Njc1YmUyNDY4MThmNTYwNjIxNiA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF82NDA3MjhmZWI1NjI0OWJjOWExYjE5OGU3ZDlmNWZhNyA9ICQoJzxkaXYgaWQ9Imh0bWxfNjQwNzI4ZmViNTYyNDliYzlhMWIxOThlN2Q5ZjVmYTciIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkFzaWFuIFJlc3RhdXJhbnQ8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzkwNmQ2ZDM4MGEwZjQ2NzViZTI0NjgxOGY1NjA2MjE2LnNldENvbnRlbnQoaHRtbF82NDA3MjhmZWI1NjI0OWJjOWExYjE5OGU3ZDlmNWZhNyk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl8wN2RjNTlkYTliMDE0NWRjYTI5NjUxODg4MGM1YjgxOS5iaW5kUG9wdXAocG9wdXBfOTA2ZDZkMzgwYTBmNDY3NWJlMjQ2ODE4ZjU2MDYyMTYpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfY2YzZGExZWIxOWQwNDllNTgyZDBiZjQ5OTY2MTM3YzcgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43MTQzNDIyOTAxNTgwODYsLTc0LjAwODA5MzU2ODQwMDA0XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2IzYjhlZDQ0MzY5ODQ2OWRiODZjMzhjOTAxOThmMjFlKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2NmMGE4N2MwYjY0MDQzNjQ4OTViYmFmMTVmNzE4YjJhID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzU0YjhjYjRkNmUxZDRiZjVhZGUyYzE3NzRhMTY1MTc2ID0gJCgnPGRpdiBpZD0iaHRtbF81NGI4Y2I0ZDZlMWQ0YmY1YWRlMmMxNzc0YTE2NTE3NiIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+WW9nYSBTdHVkaW88L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2NmMGE4N2MwYjY0MDQzNjQ4OTViYmFmMTVmNzE4YjJhLnNldENvbnRlbnQoaHRtbF81NGI4Y2I0ZDZlMWQ0YmY1YWRlMmMxNzc0YTE2NTE3Nik7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9jZjNkYTFlYjE5ZDA0OWU1ODJkMGJmNDk5NjYxMzdjNy5iaW5kUG9wdXAocG9wdXBfY2YwYTg3YzBiNjQwNDM2NDg5NWJiYWYxNWY3MThiMmEpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfNjg5M2ExNmQyNDZjNGYwNWE0MTYzZDdkZDk2N2E4NGMgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43MTU5NDEyNTU2NjkzMSwtNzQuMDA4NzIwNTM1NjQ0OTRdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfYjNiOGVkNDQzNjk4NDY5ZGI4NmMzOGM5MDE5OGYyMWUpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfZmQxMTViNjJhM2I4NGZhNzk4ZTJiMTE0OWVjZGZmYTEgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfYzMzMWQyZTdjNWIwNDMwZDgxZWM2NzY5OTEzYWM2OWMgPSAkKCc8ZGl2IGlkPSJodG1sX2MzMzFkMmU3YzViMDQzMGQ4MWVjNjc2OTkxM2FjNjljIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5OYWlsIFNhbG9uPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF9mZDExNWI2MmEzYjg0ZmE3OThlMmIxMTQ5ZWNkZmZhMS5zZXRDb250ZW50KGh0bWxfYzMzMWQyZTdjNWIwNDMwZDgxZWM2NzY5OTEzYWM2OWMpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfNjg5M2ExNmQyNDZjNGYwNWE0MTYzZDdkZDk2N2E4NGMuYmluZFBvcHVwKHBvcHVwX2ZkMTE1YjYyYTNiODRmYTc5OGUyYjExNDllY2RmZmExKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzM2NzAwMTk1NDIyMzQyMTRiMzdlNWZiMTZkOTAzNWY3ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzE3MDEwMTE0MDk5MDYsLTc0LjAwODA0MjQ0NTYyMjI1XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2IzYjhlZDQ0MzY5ODQ2OWRiODZjMzhjOTAxOThmMjFlKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2NhMmQzN2U4ZjJhNDQ1MzliOTNjMjQ0NTdmMGUwNDIzID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzc2YzA0ODVmNWM5MzQ1YmZiMGJjY2YzZDI5Yzk1NGMwID0gJCgnPGRpdiBpZD0iaHRtbF83NmMwNDg1ZjVjOTM0NWJmYjBiY2NmM2QyOWM5NTRjMCIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+RnJlbmNoIFJlc3RhdXJhbnQ8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2NhMmQzN2U4ZjJhNDQ1MzliOTNjMjQ0NTdmMGUwNDIzLnNldENvbnRlbnQoaHRtbF83NmMwNDg1ZjVjOTM0NWJmYjBiY2NmM2QyOWM5NTRjMCk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl8zNjcwMDE5NTQyMjM0MjE0YjM3ZTVmYjE2ZDkwMzVmNy5iaW5kUG9wdXAocG9wdXBfY2EyZDM3ZThmMmE0NDUzOWI5M2MyNDQ1N2YwZTA0MjMpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfYWNhY2MxMjkzMjM3NDJmMTk0NmNlZjljNmVhNGNlNWYgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43MTY2ODQzOTIyNzgyMiwtNzQuMDA4MzQzNDI4NjkyMzhdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfYjNiOGVkNDQzNjk4NDY5ZGI4NmMzOGM5MDE5OGYyMWUpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfZGJiODVmNDNjNjJjNDhkMGJkZGM3MzI5NGVmNTI5YzEgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfZGFhMmY2YzJmNTViNDY1YTg2ZWFlMDczM2YyMzgyODkgPSAkKCc8ZGl2IGlkPSJodG1sX2RhYTJmNmMyZjU1YjQ2NWE4NmVhZTA3MzNmMjM4Mjg5IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5TdXNoaSBSZXN0YXVyYW50PC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF9kYmI4NWY0M2M2MmM0OGQwYmRkYzczMjk0ZWY1MjljMS5zZXRDb250ZW50KGh0bWxfZGFhMmY2YzJmNTViNDY1YTg2ZWFlMDczM2YyMzgyODkpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfYWNhY2MxMjkzMjM3NDJmMTk0NmNlZjljNmVhNGNlNWYuYmluZFBvcHVwKHBvcHVwX2RiYjg1ZjQzYzYyYzQ4ZDBiZGRjNzMyOTRlZjUyOWMxKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzMzNDJlZmIwMzMwZTQxOTJiMGVhZmM4ZGUyNDZkMzViID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzE1NTgsLTc0LjAwOTg1XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2IzYjhlZDQ0MzY5ODQ2OWRiODZjMzhjOTAxOThmMjFlKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzRmYmYyNmE3MjI2YzQwNzQ4NzU5Y2ZkODUxOWIzZDI1ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzYyNzkzYTk3MGYwNTQ5ZjZhMDU5NDc5MjQxNThiYWQ1ID0gJCgnPGRpdiBpZD0iaHRtbF82Mjc5M2E5NzBmMDU0OWY2YTA1OTQ3OTI0MTU4YmFkNSIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+QmFnZWwgU2hvcDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfNGZiZjI2YTcyMjZjNDA3NDg3NTljZmQ4NTE5YjNkMjUuc2V0Q29udGVudChodG1sXzYyNzkzYTk3MGYwNTQ5ZjZhMDU5NDc5MjQxNThiYWQ1KTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzMzNDJlZmIwMzMwZTQxOTJiMGVhZmM4ZGUyNDZkMzViLmJpbmRQb3B1cChwb3B1cF80ZmJmMjZhNzIyNmM0MDc0ODc1OWNmZDg1MTliM2QyNSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl81YzA1NzYyOGY5NjU0OGVmODg3NjUwOGEzYmNlNmQ3MyA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjcxNDc1NDE1MTQ2MTIzNiwtNzQuMDA3NTgwNjAwMjAzOV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9iM2I4ZWQ0NDM2OTg0NjlkYjg2YzM4YzkwMTk4ZjIxZSk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF8zMjE0NmM5ZTM2NzM0MjBkODE0MjY4Mjc2MjA1Nzk3ZSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF9hNDJmOTI1ZGNlMzU0NTQxODFhMzQ4OTAxMGM0MDEwMiA9ICQoJzxkaXYgaWQ9Imh0bWxfYTQyZjkyNWRjZTM1NDU0MTgxYTM0ODkwMTBjNDAxMDIiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkZyZW5jaCBSZXN0YXVyYW50PC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF8zMjE0NmM5ZTM2NzM0MjBkODE0MjY4Mjc2MjA1Nzk3ZS5zZXRDb250ZW50KGh0bWxfYTQyZjkyNWRjZTM1NDU0MTgxYTM0ODkwMTBjNDAxMDIpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfNWMwNTc2MjhmOTY1NDhlZjg4NzY1MDhhM2JjZTZkNzMuYmluZFBvcHVwKHBvcHVwXzMyMTQ2YzllMzY3MzQyMGQ4MTQyNjgyNzYyMDU3OTdlKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzFmYjNlNDFlZDBlMjQyNGY5Yjg0OTkzOGFjOGEwZjZiID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzE1NTAwOTI5NjU4NTksLTc0LjAwODk3Njc3MzkyMzk1XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2IzYjhlZDQ0MzY5ODQ2OWRiODZjMzhjOTAxOThmMjFlKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2YwMDEwOGVkNzI4YzRlOWM5MDg0ODJjODU5MWViMWEyID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzM1YTllOTY4MzEwZDQzMTU5YWRhNDRjMjg2Mjk5N2ExID0gJCgnPGRpdiBpZD0iaHRtbF8zNWE5ZTk2ODMxMGQ0MzE1OWFkYTQ0YzI4NjI5OTdhMSIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+Q29ja3RhaWwgQmFyPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF9mMDAxMDhlZDcyOGM0ZTljOTA4NDgyYzg1OTFlYjFhMi5zZXRDb250ZW50KGh0bWxfMzVhOWU5NjgzMTBkNDMxNTlhZGE0NGMyODYyOTk3YTEpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfMWZiM2U0MWVkMGUyNDI0ZjliODQ5OTM4YWM4YTBmNmIuYmluZFBvcHVwKHBvcHVwX2YwMDEwOGVkNzI4YzRlOWM5MDg0ODJjODU5MWViMWEyKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzE3ZDhmYjIyYzgzYjRjZGE5N2Q4NTY4M2I4ZWUwNTI3ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzE1NDkzLC03NC4wMDg5NTFdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfYjNiOGVkNDQzNjk4NDY5ZGI4NmMzOGM5MDE5OGYyMWUpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfMTE4NTI2ZTY4MjNlNGY5NzkyMDk5MmU2NGEzMzljYWEgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfNzQwMDFjNjc1MWU3NGMyOWI3ZmE0OTQxNTdlOTNjOWUgPSAkKCc8ZGl2IGlkPSJodG1sXzc0MDAxYzY3NTFlNzRjMjliN2ZhNDk0MTU3ZTkzYzllIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5TYWxhZCBQbGFjZTwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfMTE4NTI2ZTY4MjNlNGY5NzkyMDk5MmU2NGEzMzljYWEuc2V0Q29udGVudChodG1sXzc0MDAxYzY3NTFlNzRjMjliN2ZhNDk0MTU3ZTkzYzllKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzE3ZDhmYjIyYzgzYjRjZGE5N2Q4NTY4M2I4ZWUwNTI3LmJpbmRQb3B1cChwb3B1cF8xMTg1MjZlNjgyM2U0Zjk3OTIwOTkyZTY0YTMzOWNhYSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9jYjY3MGRlZjk2ZTY0N2JkOTUwZGRmMGJmMTA4N2VhOCA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjcxNTE0MzksLTc0LjAwOTE4MjZdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfYjNiOGVkNDQzNjk4NDY5ZGI4NmMzOGM5MDE5OGYyMWUpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfN2Y5YzFmNGYyZGY5NGMzMjhmMTc1NWRjYzBlZTkwNmEgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfZmI4YjQ1NzM2OWNiNGY4NDhlMWQzNmYxODk0NjEyNGQgPSAkKCc8ZGl2IGlkPSJodG1sX2ZiOGI0NTczNjljYjRmODQ4ZTFkMzZmMTg5NDYxMjRkIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Ib3RlbDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfN2Y5YzFmNGYyZGY5NGMzMjhmMTc1NWRjYzBlZTkwNmEuc2V0Q29udGVudChodG1sX2ZiOGI0NTczNjljYjRmODQ4ZTFkMzZmMTg5NDYxMjRkKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyX2NiNjcwZGVmOTZlNjQ3YmQ5NTBkZGYwYmYxMDg3ZWE4LmJpbmRQb3B1cChwb3B1cF83ZjljMWY0ZjJkZjk0YzMyOGYxNzU1ZGNjMGVlOTA2YSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9jNDc5NDZiNjYyZmU0OGIxYmRkYjk1ZmY5MWM0NmM5ZSA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjcxNTg4NTEyNjA4NjAxNSwtNzQuMDA4NzEzNjE5MDI0MThdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfYjNiOGVkNDQzNjk4NDY5ZGI4NmMzOGM5MDE5OGYyMWUpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfMDY2OTA2YzE0NDU3NGIzNGI4YjEwOWFjMGRhNGZjODEgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfNjRlYTRkYzIwMjZjNDk4MjliOGRmNTg2YzJlYjZjZmYgPSAkKCc8ZGl2IGlkPSJodG1sXzY0ZWE0ZGMyMDI2YzQ5ODI5YjhkZjU4NmMyZWI2Y2ZmIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Db2NrdGFpbCBCYXI8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzA2NjkwNmMxNDQ1NzRiMzRiOGIxMDlhYzBkYTRmYzgxLnNldENvbnRlbnQoaHRtbF82NGVhNGRjMjAyNmM0OTgyOWI4ZGY1ODZjMmViNmNmZik7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9jNDc5NDZiNjYyZmU0OGIxYmRkYjk1ZmY5MWM0NmM5ZS5iaW5kUG9wdXAocG9wdXBfMDY2OTA2YzE0NDU3NGIzNGI4YjEwOWFjMGRhNGZjODEpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfODkyOTFmNTRiNzhhNGY0NmE1ZTVmM2Y2YzU2MGIzZGYgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43MTUzMDA2NDgwNTY5OSwtNzQuMDA5MzQ3MDMyNDcyMzldLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfYjNiOGVkNDQzNjk4NDY5ZGI4NmMzOGM5MDE5OGYyMWUpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfOGM0NTE4YzVhNTMyNGM1OTkzNDlmNTZlYjRjMDY5M2MgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfMmQyZTQzZTAyNmNiNDkwNmIwMzIyNDgwY2JiNzZhMDIgPSAkKCc8ZGl2IGlkPSJodG1sXzJkMmU0M2UwMjZjYjQ5MDZiMDMyMjQ4MGNiYjc2YTAyIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Ib3RlbCBCYXI8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzhjNDUxOGM1YTUzMjRjNTk5MzQ5ZjU2ZWI0YzA2OTNjLnNldENvbnRlbnQoaHRtbF8yZDJlNDNlMDI2Y2I0OTA2YjAzMjI0ODBjYmI3NmEwMik7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl84OTI5MWY1NGI3OGE0ZjQ2YTVlNWYzZjZjNTYwYjNkZi5iaW5kUG9wdXAocG9wdXBfOGM0NTE4YzVhNTMyNGM1OTkzNDlmNTZlYjRjMDY5M2MpOwoKICAgICAgICAgICAgCiAgICAgICAgCjwvc2NyaXB0Pg==\" style=\"position:absolute;width:100%;height:100%;left:0;top:0;border:none !important;\" allowfullscreen webkitallowfullscreen mozallowfullscreen></iframe></div></div>" | |
], | |
"text/plain": [ | |
"<folium.folium.Map at 0x7f9b3b110780>" | |
] | |
}, | |
"execution_count": 50, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"venues_map = folium.Map(location=[latitude, longitude], zoom_start=15) # generate map centred around Ecco\n", | |
"\n", | |
"\n", | |
"# add Ecco as a red circle mark\n", | |
"folium.features.CircleMarker(\n", | |
" [latitude, longitude],\n", | |
" radius=10,\n", | |
" popup='Ecco',\n", | |
" fill=True,\n", | |
" color='red',\n", | |
" fill_color='red',\n", | |
" fill_opacity=0.6\n", | |
" ).add_to(venues_map)\n", | |
"\n", | |
"\n", | |
"# add popular spots to the map as blue circle markers\n", | |
"for lat, lng, label in zip(dataframe_filtered.lat, dataframe_filtered.lng, dataframe_filtered.categories):\n", | |
" folium.features.CircleMarker(\n", | |
" [lat, lng],\n", | |
" radius=5,\n", | |
" popup=label,\n", | |
" fill=True,\n", | |
" color='blue',\n", | |
" fill_color='blue',\n", | |
" fill_opacity=0.6\n", | |
" ).add_to(venues_map)\n", | |
"\n", | |
"# display map\n", | |
"venues_map" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
" " | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"<a id=\"item5\"></a>" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"## 5. Explore Trending Venues\n", | |
"> `https://api.foursquare.com/v2/venues/`**trending**`?client_id=`**CLIENT_ID**`&client_secret=`**CLIENT_SECRET**`&ll=`**LATITUDE**`,`**LONGITUDE**`&v=`**VERSION**" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"#### Now, instead of simply exploring the area around Ecco, you are interested in knowing the venues that are trending at the time you are done with your lunch, meaning the places with the highest foot traffic. So let's do that and get the trending venues around Ecco." | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 51, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"{'meta': {'code': 200, 'requestId': '5d49f1eb7ca06c0024219962'},\n", | |
" 'response': {'venues': []}}" | |
] | |
}, | |
"execution_count": 51, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"# define URL\n", | |
"url = 'https://api.foursquare.com/v2/venues/trending?client_id={}&client_secret={}&ll={},{}&v={}'.format(CLIENT_ID, CLIENT_SECRET, latitude, longitude, VERSION)\n", | |
"\n", | |
"# send GET request and get trending venues\n", | |
"results = requests.get(url).json()\n", | |
"results" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"### Check if any venues are trending at this time" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 52, | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [], | |
"source": [ | |
"if len(results['response']['venues']) == 0:\n", | |
" trending_venues_df = 'No trending venues are available at the moment!'\n", | |
" \n", | |
"else:\n", | |
" trending_venues = results['response']['venues']\n", | |
" trending_venues_df = json_normalize(trending_venues)\n", | |
"\n", | |
" # filter columns\n", | |
" columns_filtered = ['name', 'categories'] + ['location.distance', 'location.city', 'location.postalCode', 'location.state', 'location.country', 'location.lat', 'location.lng']\n", | |
" trending_venues_df = trending_venues_df.loc[:, columns_filtered]\n", | |
"\n", | |
" # filter the category for each row\n", | |
" trending_venues_df['categories'] = trending_venues_df.apply(get_category_type, axis=1)" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 53, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"'No trending venues are available at the moment!'" | |
] | |
}, | |
"execution_count": 53, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"# display trending venues\n", | |
"trending_venues_df" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"Now, depending on when you run the above code, you might get different venues since the venues with the highest foot traffic are fetched live. " | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"### Visualize trending venues" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 54, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [], | |
"source": [ | |
"if len(results['response']['venues']) == 0:\n", | |
" venues_map = 'Cannot generate visual as no trending venues are available at the moment!'\n", | |
"\n", | |
"else:\n", | |
" venues_map = folium.Map(location=[latitude, longitude], zoom_start=15) # generate map centred around Ecco\n", | |
"\n", | |
"\n", | |
" # add Ecco as a red circle mark\n", | |
" folium.features.CircleMarker(\n", | |
" [latitude, longitude],\n", | |
" radius=10,\n", | |
" popup='Ecco',\n", | |
" fill=True,\n", | |
" color='red',\n", | |
" fill_color='red',\n", | |
" fill_opacity=0.6\n", | |
" ).add_to(venues_map)\n", | |
"\n", | |
"\n", | |
" # add the trending venues as blue circle markers\n", | |
" for lat, lng, label in zip(trending_venues_df['location.lat'], trending_venues_df['location.lng'], trending_venues_df['name']):\n", | |
" folium.features.CircleMarker(\n", | |
" [lat, lng],\n", | |
" radius=5,\n", | |
" poup=label,\n", | |
" fill=True,\n", | |
" color='blue',\n", | |
" fill_color='blue',\n", | |
" fill_opacity=0.6\n", | |
" ).add_to(venues_map)" | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": 55, | |
"metadata": { | |
"button": false, | |
"collapsed": false, | |
"deletable": true, | |
"jupyter": { | |
"outputs_hidden": false | |
}, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"outputs": [ | |
{ | |
"data": { | |
"text/plain": [ | |
"'Cannot generate visual as no trending venues are available at the moment!'" | |
] | |
}, | |
"execution_count": 55, | |
"metadata": {}, | |
"output_type": "execute_result" | |
} | |
], | |
"source": [ | |
"# display map\n", | |
"venues_map" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"<a id=\"item6\"></a>" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
" " | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"### Thank you for completing this lab!\n", | |
"\n", | |
"This notebook was created by [Alex Aklson](https://www.linkedin.com/in/aklson/). I hope you found this lab interesting and educational. Feel free to contact me if you have any questions!" | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"This notebook is part of a course on **Coursera** called *Applied Data Science Capstone*. If you accessed this notebook outside the course, you can take this course online by clicking [here](http://cocl.us/DP0701EN_Coursera_Week2_LAB1)." | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": { | |
"button": false, | |
"deletable": true, | |
"new_sheet": false, | |
"run_control": { | |
"read_only": false | |
} | |
}, | |
"source": [ | |
"<hr>\n", | |
"Copyright © 2018 [Cognitive Class](https://cognitiveclass.ai/?utm_source=bducopyrightlink&utm_medium=dswb&utm_campaign=bdu). This notebook and its source code are released under the terms of the [MIT License](https://bigdatauniversity.com/mit-license/)." | |
] | |
} | |
], | |
"metadata": { | |
"kernelspec": { | |
"display_name": "Python", | |
"language": "python", | |
"name": "conda-env-python-py" | |
}, | |
"language_info": { | |
"codemirror_mode": { | |
"name": "ipython", | |
"version": 3 | |
}, | |
"file_extension": ".py", | |
"mimetype": "text/x-python", | |
"name": "python", | |
"nbconvert_exporter": "python", | |
"pygments_lexer": "ipython3", | |
"version": "3.6.7" | |
}, | |
"widgets": { | |
"state": {}, | |
"version": "1.1.2" | |
} | |
}, | |
"nbformat": 4, | |
"nbformat_minor": 4 | |
} |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment