Skip to content

Instantly share code, notes, and snippets.

View kstirman's full-sized avatar

kelly stirman kstirman

21 followers · 1 following
View GitHub Profile
@kstirman
kstirman / gist:425bba4e287f39c749ce
Created March 13, 2015 21:05
{
"_id" : ObjectId("5063114bd386d8fadbd6b004"),
"name" : "Brian D. Goodman",
"organizations" : ["MongoDB"],
"locations" : [
{ "type" : "work",
"address" : "229 W 34 St., 5th floor",
"city" : "New York",
"state" : "NY",
"zipcode" : "10036"
@kstirman
kstirman / gist:2735840891836fd11d3b
Created March 13, 2015 21:10
{ "_id" : ObjectId("5063114bd386d8fadbd6b004"),
"name" : "Brian D. Goodman",
"organizations" : ["MongoDB”],
"locations" : [
{ "type" : "work",
"address" : "229 W 34 St., 5th floor",
"city" : "New York",
"state" : "NY",
"zipcode" : "10036"
}
@kstirman
kstirman / gist:afd044cf75c1b4f9b74f
Created March 13, 2015 21:24
{
"_id" : ObjectId("5063114bd386d8fadbd6b004"),
"name" : "Brian D. Goodman",
"organizations" : ["MongoDB"],
"locations" : [
{ "type" : "work",
"address" : "229 W 34 St., 5th floor",
"city" : "New York",
"state" : "NY",
"zipcode" : "10036"
@kstirman
kstirman / view-raw-json.sql
Last active July 19, 2017 18:04
SELECT *
FROM Samples."samples.dremio.com"."SF_incidents2016.json"
@kstirman
kstirman / load-elastic.py
Created July 21, 2017 20:13
import pandas as pd
import elasticsearch
import json
es = elasticsearch.Elasticsearch() # Assume Elasticsearch is running on localhost
dataset_url = "https://data.cityofnewyork.us/api/views/43nn-pn8j/rows.csv?accessType=DOWNLOAD"
df = pd.read_csv(dataset_url, header=0, sep=',',
dtype={'PHONE': str, 'INSPECTION DATE': str, 'ZIPCODE': str})
@kstirman
kstirman / test-load.sh
Created July 21, 2017 20:20
$curl -s http://localhost:9200/restaurants/inspections/_count | jq '.'
{
"count": 410649,
"_shards": {
"total": 5,
"successful": 5,
"failed": 0
}
}
@kstirman
kstirman / count-boros.sql
Created July 21, 2017 20:56
SELECT BORO, COUNT(*) c
FROM production.restaurants.inspections
GROUP BY BORO
ORDER BY c DESC
@kstirman
kstirman / sql-pushdown-elastic.json
Created July 21, 2017 20:59
{
"size": 0,
"query": {
"match_all": {}
},
"aggregations": {
"BORO": {
"terms": {
"field": "BORO",
"missing": "NULL_STRING_TAG",
@kstirman
kstirman / find-vermin.sql
Created July 21, 2017 21:00
SELECT CUISINE_DESCRIPTION, COUNT(*) c
FROM production.restaurants.inspections
WHERE contains(VIOLATION_DESCRIPTION:(mice OR vermin))
GROUP BY CUISINE_DESCRIPTION
ORDER BY c DESC
@kstirman
kstirman / SQL-vermin-pushdown.json
Created July 21, 2017 21:01
{
"size": 0,
"query": {
"query_string": {
"query": "VIOLATION_DESCRIPTION : (mice OR vermin )"
}
},
"aggregations": {
"CUISINE_DESCRIPTION": {
"terms": {