Telvis Calhoun telvis07
telvis07
/ elasticsearch_multi_field_geo_point.sh
Created
December 6, 2012 19:17
multi-field with geo_point in a nested document
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| curl -XPOST localhost:9200/test -d ' | |
| { | |
| "mappings": { | |
| "type1": { | |
| "properties": { | |
| "message": { | |
| "index": "analyzed", | |
| "type": "string" | |
| }, | |
| "depart": { |
telvis07
/ multi_field_nested_test.sh
Created
December 11, 2012 16:53
multi-field in a nested document
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| curl -XDELETE localhost:9200/test | |
| curl -XPOST localhost:9200/test -d ' | |
| { | |
| "mappings": { | |
| "type1": { | |
| "properties": { | |
| "message": { | |
| "index": "analyzed", | |
| "type": "string" |
telvis07
/ terms-filter-lookup.sh
Created
April 26, 2013 18:45
Working example for https://github.com/elasticsearch/elasticsearch/issues/2674
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # index the information for user with id 2, specifically, its friends | |
| curl -XPUT localhost:9200/users/user/2 -d '{ | |
| "friends" : ["1", "3"] | |
| }' | |
| # index a tweet, from user with id 2 | |
| curl -XPUT localhost:9200/tweets/tweet/1 -d '{ | |
| "user" : "1", | |
| "tweet" : "hi i am user 1 " | |
| }' |
telvis07
/ kibana-filtered-query.json
Last active
August 29, 2015 13:56
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "facets": { | |
| "terms": { | |
| "facet_filter": { | |
| "fquery": { | |
| "query": { | |
| "filtered": { | |
| "filter": { | |
| "bool": { | |
| "must": [ |
telvis07
/ ngram_prune.R
Last active
July 1, 2016 14:18
NLP - prune ngrams by finding the minimum number of ngrams that cover X percent of the word instances
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| prune_ngram_df_by_cover_percentage <- function(df, percentage) { | |
| # assumes df contains columns (word, freq) | |
| # assumes df is sorted by freq in descending order | |
| # prune ngrams by finding the minimum number of ngrams that cover X percent of the word instances | |
| sums <- cumsum(df$freq) | |
| cover <- which(sums >= sum(df$freq) * percentage)[1] | |
| print(sprintf("%s of %s (%s%%) cover %s%% of word instances", | |
| cover, | |
| nrow(df), | |
| cover/nrow(df)*100, |