David Erickson derickson
derickson
/ elasticsearch_sql.json
Created
August 7, 2018 18:46
View elasticsearch_sql.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ## 1) Pull all records from index named fedeastsql | |
| POST /_xpack/sql?format=txt | |
| { | |
| "query": "SELECT * FROM fedeastsql" | |
| } | |
| ## 2) List all columns and datatype of this index |
derickson
/ abac with covery query proposal
Created
October 11, 2017 16:55
View abac with covery query proposal
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| PUT my_index | |
| { | |
| "mappings": { | |
| "properties": { | |
| "securityTags": { | |
| "type": "keyword", | |
| "fields": { | |
| "length": { | |
| "type": "token_count", | |
| "analyzer": "standard" |
derickson
/ combinatorialSet.py
Created
August 2, 2017 14:36
View combinatorialSet.py
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/python | |
| # -*- coding: utf-8 -*- | |
| import json | |
| def prettyPrint(doc): | |
| print(json.dumps(doc, indent=4, sort_keys=True)) | |
derickson
/ bigBool.json
Created
August 2, 2017 14:28
View bigBool.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "bool": { | |
| "should": [ | |
| [ | |
| { | |
| "bool": { | |
| "must": [ | |
| [ | |
| { | |
| "term": { |
derickson
/ ingestBeer.py
Last active
July 18, 2018 13:58
View ingestBeer.py
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/python3 | |
| import json | |
| import moment | |
| from elasticsearch import helpers | |
| from elasticsearch import Elasticsearch | |
| esConnString = 'http://elastic:changeme@localhost:9200' | |
| esTo = Elasticsearch([esConnString],request_timeout=100) |
derickson
/ watcher examples .txt
Last active
September 1, 2016 15:03
View watcher examples .txt
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ### EXAMPLE SEARCH: Has Spotify run in the last 30 seconds? | |
| GET /topbeat-*/_search | |
| { | |
| "query": { | |
| "bool": { | |
| "must": [ | |
| {"term": { | |
| "proc.name": { | |
| "value": "Spotify" |
View spectator.html
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <html> | |
| <head> | |
| <script src="../dist/aframe.min.js"></script> | |
| <script> | |
| AFRAME.registerComponent('spectator',{ | |
| 'schema': { | |
| canvas: { | |
| type: 'string', | |
| default: '' |
derickson
/ logstash-bikehare-status.conf
Last active
March 10, 2021 14:26
Logstash config for http_poller pulling of DC Capital bikeshare data and doing an XML split of the contents.
View logstash-bikehare-status.conf
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ## Example of pulling data from DC Capital bikeshare to Elasticsearch in real time | |
| ## HTTP Poller -> XML Splitting -> Elasticsearch | |
| input { | |
| ## pull data from Capital Bikeshare every 60 seconds | |
| http_poller { | |
| urls => { | |
| bikeshare_dc => "https://www.capitalbikeshare.com/data/stations/bikeStations.xml" | |
| } | |
| request_timeout => 30 |
derickson
/ alias_filters.sense
Last active
August 29, 2015 14:26
Quick test for Elasticsearch in sense to prove Alias filters correctly work with searches, facet term counts, and global aggregation. proves that term suggester doesn't respect alias filter
View alias_filters.sense
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| DELETE /foo | |
| PUT /foo | |
| { | |
| "settings": { | |
| "number_of_replicas": 0, | |
| "number_of_shards": 1 | |
| }, | |
| "mappings": { | |
| "people": { |
derickson
/ videogame2ES.py
Last active
August 29, 2015 14:25
Experiment, pulling google spreadsheet data into ES
View videogame2ES.py
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ## Dependencies in order for this to work | |
| ## 1) google spreadsheet lib: https://github.com/burnash/gspread | |
| ## pip install gspread | |
| ## 2) oauth2 lib: http://gspread.readthedocs.org/en/latest/oauth2.html | |
| ## pip install oauth2client | |
| ## 3) create a "service account" in your google api console following the instructions from the oauth2 lib above |
NewerOlder