Skip to content

Instantly share code, notes, and snippets.

View andyb-elastic's full-sized avatar

Andy Bristol andyb-elastic

View GitHub Profile
@andyb-elastic
andyb-elastic / collection-median-above-0.01-error.json
Last active October 4, 2018 13:11
accuracy benchmarking results for MAD aggregation
{"size":100,"density":"SPARSE","distribution":"UNIFORM","compression":20.0,"seed":1538607917605,"iterations":10,"output":"/Users/andy/code/es/elasticsearch-feature-mad-agg/benchmark-1538607917604","tags":{"method":"collection_median"},"number_of_shards":4,"number_of_replicas":0,"results":[{"exact":98.59529675516688,"agg_median_of_measurements":113.75023773421944,"agg_mad_of_measurements":0.0,"absolute_error_from_agg_median_of_measurements":15.154940979052554,"relative_error_from_agg_median_of_measurements":0.15370855890505108,"agg_measurements":[113.75023773421944,113.75023773421944,113.75023773421944,113.75023773421944,113.75023773421944,113.75023773421944,113.75023773421944,113.75023773421944,113.75023773421944,113.75023773421944]},{"exact":99.56671366318966,"agg_median_of_measurements":129.11537267781182,"agg_mad_of_measurements":0.0,"absolute_error_from_agg_median_of_measurements":29.54865901462216,"relative_error_from_agg_median_of_measurements":0.29677246468712615,"agg_measurements":[129.11537267781182,
@andyb-elastic
andyb-elastic / collection_median.txt
Last active September 28, 2018 21:00
mad aggregation rally results
(esrally-venv) andy@andy-desktop:~$ esrally --track-path=/home/andy/src/elastic/rally-tracks/noaa --challenge=append-no-conflicts-simple-benchmark --track-params="
number_of_shards:4" --user-tag="method:collection_median,throughput:0.1"
____ ____
/ __ \____ _/ / /_ __
/ /_/ / __ `/ / / / / /
/ _, _/ /_/ / / / /_/ /
:clean
:compileJava
:processResources
:classes
:run
[2017-08-03T19:28:01,073][INFO ][App ] Starting test
[2017-08-03T19:28:01,078][INFO ][App ] Creating client
[2017-08-03T19:28:06,261][INFO ][o.e.p.PluginsService ] [_client_] no modules loaded
[2017-08-03T19:28:06,263][INFO ][o.e.p.PluginsService ] [_client_] loaded plugin [org.elasticsearch.index.reindex.ReindexPlugin]
[2017-08-03T19:28:06,263][INFO ][o.e.p.PluginsService ] [_client_] loaded plugin [org.elasticsearch.percolator.PercolatorPlugin]
import org.apache.logging.log4j.LogManager;
import org.apache.logging.log4j.Logger;
import org.elasticsearch.client.transport.TransportClient;
import org.elasticsearch.common.settings.Settings;
import org.elasticsearch.common.transport.InetSocketTransportAddress;
import org.elasticsearch.transport.client.PreBuiltTransportClient;
import java.net.InetAddress;
import java.util.concurrent.CountDownLatch;