Skip to content

Instantly share code, notes, and snippets.

@dan-at-mimas
dan-at-mimas / aggregation output
Last active October 17, 2018 15:05
aggregation output
db.aggregate_test.find().pretty();
{
"_id" : ObjectId("5bc74df9962d74e77d000001"),
"@version" : "1",
"task_id" : "0.0.0.0Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko/results?terms=test",
"iso_timestamps" : [
{
"iso_timestamp" : ISODate("2018-10-08T14:14:08Z")
}
],
@dan-at-mimas
dan-at-mimas / aggregation logstash config
Last active October 17, 2018 15:04
aggregation logstash config
input {
beats {
port => 5044
}
file {
path => "/vagrant/logs-8/test.log"
start_position => "beginning"
sincedb_path => "/dev/null"
}
}
@dan-at-mimas
dan-at-mimas / aggregation test logs
Created October 17, 2018 13:20
aggregation test logs
0.0.0.0 - "" [08/Oct/2018:15:14:08 +0100] "GET /results?terms=test HTTP/1.1" 200 10947 "https://data.historicaltexts.jisc.ac.uk/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
0.0.0.0 - "" [08/Oct/2018:15:17:45 +0100] "GET /results?terms=test HTTP/1.1" 200 10947 "https://data.historicaltexts.jisc.ac.uk/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
0.0.0.0 - "" [08/Oct/2018:15:18:57 +0100] "GET /results?terms=test HTTP/1.1" 200 10947 "https://data.historicaltexts.jisc.ac.uk/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
0.0.0.0 - "" [08/Oct/2018:15:19:45 +0100] "GET /results?terms=test HTTP/1.1" 200 10947 "https://data.historicaltexts.jisc.ac.uk/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
0.0.0.0 - "" [08/Oct/2018:15:20:29 +0100] "GET /results?terms=test HTTP/1.1" 200 10947 "https://data.historicaltexts.jisc.ac.uk/" "Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko"
0.0.0.0 - "" [08/Oc