David Erickson derickson
derickson
/ elasticsearch_sql.json
Created
August 7, 2018 18:46
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ## 1) Pull all records from index named fedeastsql | |
| POST /_xpack/sql?format=txt | |
| { | |
| "query": "SELECT * FROM fedeastsql" | |
| } | |
| ## 2) List all columns and datatype of this index |
derickson
/ abac with covery query proposal
Created
October 11, 2017 16:55
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| PUT my_index | |
| { | |
| "mappings": { | |
| "properties": { | |
| "securityTags": { | |
| "type": "keyword", | |
| "fields": { | |
| "length": { | |
| "type": "token_count", | |
| "analyzer": "standard" |
derickson
/ combinatorialSet.py
Created
August 2, 2017 14:36
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/python | |
| # -*- coding: utf-8 -*- | |
| import json | |
| def prettyPrint(doc): | |
| print(json.dumps(doc, indent=4, sort_keys=True)) | |
derickson
/ bigBool.json
Created
August 2, 2017 14:28
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "bool": { | |
| "should": [ | |
| [ | |
| { | |
| "bool": { | |
| "must": [ | |
| [ | |
| { | |
| "term": { |
derickson
/ ingestBeer.py
Last active
July 18, 2018 13:58
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/python3 | |
| import json | |
| import moment | |
| from elasticsearch import helpers | |
| from elasticsearch import Elasticsearch | |
| esConnString = 'http://elastic:changeme@localhost:9200' | |
| esTo = Elasticsearch([esConnString],request_timeout=100) |
derickson
/ watcher examples .txt
Last active
September 1, 2016 15:03
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ### EXAMPLE SEARCH: Has Spotify run in the last 30 seconds? | |
| GET /topbeat-*/_search | |
| { | |
| "query": { | |
| "bool": { | |
| "must": [ | |
| {"term": { | |
| "proc.name": { | |
| "value": "Spotify" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <html> | |
| <head> | |
| <script src="../dist/aframe.min.js"></script> | |
| <script> | |
| AFRAME.registerComponent('spectator',{ | |
| 'schema': { | |
| canvas: { | |
| type: 'string', | |
| default: '' |
derickson
/ logstash-bikehare-status.conf
Last active
March 10, 2021 14:26
Logstash config for http_poller pulling of DC Capital bikeshare data and doing an XML split of the contents.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ## Example of pulling data from DC Capital bikeshare to Elasticsearch in real time | |
| ## HTTP Poller -> XML Splitting -> Elasticsearch | |
| input { | |
| ## pull data from Capital Bikeshare every 60 seconds | |
| http_poller { | |
| urls => { | |
| bikeshare_dc => "https://www.capitalbikeshare.com/data/stations/bikeStations.xml" | |
| } | |
| request_timeout => 30 |
derickson
/ alias_filters.sense
Last active
August 29, 2015 14:26
Quick test for Elasticsearch in sense to prove Alias filters correctly work with searches, facet term counts, and global aggregation. proves that term suggester doesn't respect alias filter
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| DELETE /foo | |
| PUT /foo | |
| { | |
| "settings": { | |
| "number_of_replicas": 0, | |
| "number_of_shards": 1 | |
| }, | |
| "mappings": { | |
| "people": { |
derickson
/ videogame2ES.py
Last active
August 29, 2015 14:25
Experiment, pulling google spreadsheet data into ES
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ## Dependencies in order for this to work | |
| ## 1) google spreadsheet lib: https://github.com/burnash/gspread | |
| ## pip install gspread | |
| ## 2) oauth2 lib: http://gspread.readthedocs.org/en/latest/oauth2.html | |
| ## pip install oauth2client | |
| ## 3) create a "service account" in your google api console following the instructions from the oauth2 lib above |
NewerOlder