Skip to content

Instantly share code, notes, and snippets.

@jakelandis

jakelandis/gist:de554f394e5455ee66797c2b956d63bf

Last active August 15, 2018 18:54
Show Gist options
  • Save jakelandis/de554f394e5455ee66797c2b956d63bf to your computer and use it in GitHub Desktop.
Save jakelandis/de554f394e5455ee66797c2b956d63bf to your computer and use it in GitHub Desktop.
Download ZIP
rally dissect benchmarks
Raw
gistfile1.txt
esrally --track=http_logs_for_ingest --track-repository=ingest --challenge=baseline --laps=1 --report-file=~/baseline1.out;\
> esrally --track=http_logs_for_ingest --track-repository=ingest --challenge=grok --laps=1; --report-file=~/grok1.out;\
> esrally --track=http_logs_for_ingest --track-repository=ingest --challenge=dissect --laps=1; --report-file=~/dissect1.out;\
> esrally --track=http_logs_for_ingest --track-repository=ingest --challenge=baseline --laps=2; --report-file=~/baseline2.out;\
> esrally --track=http_logs_for_ingest --track-repository=ingest --challenge=grok --laps=2; --report-file=~/grok2.out;\
> esrally --track=http_logs_for_ingest --track-repository=ingest --challenge=dissect --laps=2; --report-file=~/dissect2.out;\
> esrally --track=http_logs_for_ingest --track-repository=ingest --challenge=baseline --laps=3; --report-file=~/baseline3.out;\
> esrally --track=http_logs_for_ingest --track-repository=ingest --challenge=grok --laps=3; --report-file=~/grok3.out;\
> esrally --track=http_logs_for_ingest --track-repository=ingest --challenge=dissect --laps=3; --report-file=~/dissect3.out;\
> esrally --track=http_logs_for_ingest --track-repository=ingest --challenge=baseline --laps=4; --report-file=~/baseline4.out;\
> esrally --track=http_logs_for_ingest --track-repository=ingest --challenge=grok --laps=4; --report-file=~/grok4.out;\
> esrally --track=http_logs_for_ingest --track-repository=ingest --challenge=dissect --laps=4; --report-file=~/dissect4.out;\
>
____ ____
/ __ \____ _/ / /_ __
/ /_/ / __ `/ / / / / /
/ _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
/____/
[INFO] Preparing for race ...
[INFO] Racing on track [http_logs_for_ingest], challenge [baseline] and car ['defaults'] with version [7.0.0-alpha1].
[INFO] Downloading data for track http_logs_for_ingest (12.5 MB total size) [100.0%]
[INFO] Decompressing track data from [/home/jake/.rally/benchmarks/data/default/documents-181998.unparsed.json.bz2] to [/home/jake/.rally/benchmarks/data/default/documents-181998.unparsed.json] (resulting size: 0.28 GB) ... [OK]
[INFO] Preparing file offset table for [/home/jake/.rally/benchmarks/data/default/documents-181998.unparsed.json] ... [OK]
[INFO] Downloading data for track http_logs_for_ingest (45.0 MB total size) [100.0%]
[INFO] Decompressing track data from [/home/jake/.rally/benchmarks/data/default/documents-191998.unparsed.json.bz2] to [/home/jake/.rally/benchmarks/data/default/documents-191998.unparsed.json] (resulting size: 1.01 GB) ... [OK]
[INFO] Preparing file offset table for [/home/jake/.rally/benchmarks/data/default/documents-191998.unparsed.json] ... [OK]
[INFO] Downloading data for track http_logs_for_ingest (60.2 MB total size) [100.0%]
[INFO] Decompressing track data from [/home/jake/.rally/benchmarks/data/default/documents-201998.unparsed.json.bz2] to [/home/jake/.rally/benchmarks/data/default/documents-201998.unparsed.json] (resulting size: 1.36 GB) ... [OK]
[INFO] Preparing file offset table for [/home/jake/.rally/benchmarks/data/default/documents-201998.unparsed.json] ... [OK]
[INFO] Downloading data for track http_logs_for_ingest (81.6 MB total size) [100.0%]
[INFO] Decompressing track data from [/home/jake/.rally/benchmarks/data/default/documents-211998.unparsed.json.bz2] to [/home/jake/.rally/benchmarks/data/default/documents-211998.unparsed.json] (resulting size: 1.84 GB) ... [OK]
[INFO] Preparing file offset table for [/home/jake/.rally/benchmarks/data/default/documents-211998.unparsed.json] ... [OK]
[INFO] Downloading data for track http_logs_for_ingest (50.7 MB total size) [100.0%]
[INFO] Decompressing track data from [/home/jake/.rally/benchmarks/data/default/documents-221998.unparsed.json.bz2] to [/home/jake/.rally/benchmarks/data/default/documents-221998.unparsed.json] (resulting size: 1.12 GB) ... [OK]
[INFO] Preparing file offset table for [/home/jake/.rally/benchmarks/data/default/documents-221998.unparsed.json] ... [OK]
[INFO] Downloading data for track http_logs_for_ingest (57.9 MB total size) [100.0%]
[INFO] Decompressing track data from [/home/jake/.rally/benchmarks/data/default/documents-231998.unparsed.json.bz2] to [/home/jake/.rally/benchmarks/data/default/documents-231998.unparsed.json] (resulting size: 1.24 GB) ... [OK]
[INFO] Preparing file offset table for [/home/jake/.rally/benchmarks/data/default/documents-231998.unparsed.json] ... [OK]
[INFO] Downloading data for track http_logs_for_ingest (856.1 MB total size) [100.0%]
[INFO] Decompressing track data from [/home/jake/.rally/benchmarks/data/default/documents-241998.unparsed.json.bz2] to [/home/jake/.rally/benchmarks/data/default/documents-241998.unparsed.json] (resulting size: 19.15 GB) ... [OK]
[INFO] Preparing file offset table for [/home/jake/.rally/benchmarks/data/default/documents-241998.unparsed.json] ... [OK]
[INFO] Downloading data for track http_logs_for_ingest (12.5 MB total size) [100.0%]
[INFO] Decompressing track data from [/home/jake/.rally/benchmarks/data/manual/documents-181998.unparsed.json.bz2] to [/home/jake/.rally/benchmarks/data/manual/documents-181998.unparsed.json] (resulting size: 0.28 GB) ... [OK]
[INFO] Preparing file offset table for [/home/jake/.rally/benchmarks/data/manual/documents-181998.unparsed.json] ... [OK]
Running create-noop-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-noop [100% done]
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| All | Total indexing time | | 84.0058 | min |
| All | Min indexing time per shard | | 84.0058 | min |
| All | Median indexing time per shard | | 84.0058 | min |
| All | Max indexing time per shard | | 84.0058 | min |
| All | Total merge time | | 28.4305 | min |
| All | Min merge time per shard | | 28.4305 | min |
| All | Median merge time per shard | | 28.4305 | min |
| All | Max merge time per shard | | 28.4305 | min |
| All | Total merge throttle time | | 20.3884 | min |
| All | Min merge throttle time per shard | | 20.3884 | min |
| All | Median merge throttle time per shard | | 20.3884 | min |
| All | Max merge throttle time per shard | | 20.3884 | min |
| All | Total refresh time | | 1.18737 | min |
| All | Min refresh time per shard | | 1.18737 | min |
| All | Median refresh time per shard | | 1.18737 | min |
| All | Max refresh time per shard | | 1.18737 | min |
| All | Total flush time | | 1.64545 | min |
| All | Min flush time per shard | | 1.64545 | min |
| All | Median flush time per shard | | 1.64545 | min |
| All | Max flush time per shard | | 1.64545 | min |
| All | Median CPU usage | | 467.6 | % |
| All | Total Young Gen GC | | 99.453 | s |
| All | Total Old Gen GC | | 9.059 | s |
| All | Store size | | 6.93718 | GB |
| All | Translog size | | 0.568936 | GB |
| All | Index size | | 5.80064 | GB |
| All | Totally written | | 68.6081 | GB |
| All | Heap used for segments | | 92.1856 | MB |
| All | Heap used for doc values | | 0.00647736 | MB |
| All | Heap used for terms | | 86.2662 | MB |
| All | Heap used for norms | | 0 | MB |
| All | Heap used for points | | 1.16834 | MB |
| All | Heap used for stored fields | | 4.74451 | MB |
| All | Segment count | | 72 | |
| All | Min Throughput | process-noop | 188877 | docs/s |
| All | Median Throughput | process-noop | 195202 | docs/s |
| All | Max Throughput | process-noop | 196429 | docs/s |
| All | 50th percentile latency | process-noop | 172.51 | ms |
| All | 90th percentile latency | process-noop | 240.23 | ms |
| All | 99th percentile latency | process-noop | 674.176 | ms |
| All | 99.9th percentile latency | process-noop | 887.49 | ms |
| All | 99.99th percentile latency | process-noop | 958.493 | ms |
| All | 100th percentile latency | process-noop | 1050.22 | ms |
| All | 50th percentile service time | process-noop | 172.51 | ms |
| All | 90th percentile service time | process-noop | 240.23 | ms |
| All | 99th percentile service time | process-noop | 674.176 | ms |
| All | 99.9th percentile service time | process-noop | 887.49 | ms |
| All | 99.99th percentile service time | process-noop | 958.493 | ms |
| All | 100th percentile service time | process-noop | 1050.22 | ms |
| All | error rate | process-noop | 0.02 | % |
----------------------------------
[INFO] SUCCESS (took 1977 seconds)
----------------------------------
____ ____
/ __ \____ _/ / /_ __
/ /_/ / __ `/ / / / / /
/ _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
/____/
[INFO] Preparing for race ...
[INFO] Racing on track [http_logs_for_ingest], challenge [grok] and car ['defaults'] with version [7.0.0-alpha1].
Running create-grok-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-grok [100% done]
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| All | Total indexing time | | 104.23 | min |
| All | Min indexing time per shard | | 104.23 | min |
| All | Median indexing time per shard | | 104.23 | min |
| All | Max indexing time per shard | | 104.23 | min |
| All | Total merge time | | 34.0951 | min |
| All | Min merge time per shard | | 34.0951 | min |
| All | Median merge time per shard | | 34.0951 | min |
| All | Max merge time per shard | | 34.0951 | min |
| All | Total merge throttle time | | 24.6543 | min |
| All | Min merge throttle time per shard | | 24.6543 | min |
| All | Median merge throttle time per shard | | 24.6543 | min |
| All | Max merge throttle time per shard | | 24.6543 | min |
| All | Total refresh time | | 1.74228 | min |
| All | Min refresh time per shard | | 1.74228 | min |
| All | Median refresh time per shard | | 1.74228 | min |
| All | Max refresh time per shard | | 1.74228 | min |
| All | Total flush time | | 1.86952 | min |
| All | Min flush time per shard | | 1.86952 | min |
| All | Median flush time per shard | | 1.86952 | min |
| All | Max flush time per shard | | 1.86952 | min |
| All | Median CPU usage | | 540.45 | % |
| All | Total Young Gen GC | | 145.063 | s |
| All | Total Old Gen GC | | 16.334 | s |
| All | Store size | | 6.19864 | GB |
| All | Translog size | | 0.512553 | GB |
| All | Index size | | 5.81015 | GB |
| All | Totally written | | 100.324 | GB |
| All | Heap used for segments | | 85.216 | MB |
| All | Heap used for doc values | | 0.00428009 | MB |
| All | Heap used for terms | | 79.189 | MB |
| All | Heap used for norms | | 0 | MB |
| All | Heap used for points | | 1.17403 | MB |
| All | Heap used for stored fields | | 4.84872 | MB |
| All | Segment count | | 66 | |
| All | Min Throughput | process-grok | 138463 | docs/s |
| All | Median Throughput | process-grok | 147400 | docs/s |
| All | Max Throughput | process-grok | 147951 | docs/s |
| All | 50th percentile latency | process-grok | 232.821 | ms |
| All | 90th percentile latency | process-grok | 331.989 | ms |
| All | 99th percentile latency | process-grok | 727.074 | ms |
| All | 99.9th percentile latency | process-grok | 959.006 | ms |
| All | 99.99th percentile latency | process-grok | 1119.4 | ms |
| All | 100th percentile latency | process-grok | 1258.84 | ms |
| All | 50th percentile service time | process-grok | 232.821 | ms |
| All | 90th percentile service time | process-grok | 331.989 | ms |
| All | 99th percentile service time | process-grok | 727.074 | ms |
| All | 99.9th percentile service time | process-grok | 959.006 | ms |
| All | 99.99th percentile service time | process-grok | 1119.4 | ms |
| All | 100th percentile service time | process-grok | 1258.84 | ms |
| All | error rate | process-grok | 0.02 | % |
----------------------------------
[INFO] SUCCESS (took 1772 seconds)
----------------------------------
-bash: --report-file=~/grok1.out: No such file or directory
____ ____
/ __ \____ _/ / /_ __
/ /_/ / __ `/ / / / / /
/ _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
/____/
[INFO] Preparing for race ...
[INFO] Racing on track [http_logs_for_ingest], challenge [dissect] and car ['defaults'] with version [7.0.0-alpha1].
Running create-dissect-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-dissect [100% done]
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|----------------:|-----------:|-------:|
| All | Total indexing time | | 111.913 | min |
| All | Min indexing time per shard | | 111.913 | min |
| All | Median indexing time per shard | | 111.913 | min |
| All | Max indexing time per shard | | 111.913 | min |
| All | Total merge time | | 31.0119 | min |
| All | Min merge time per shard | | 31.0119 | min |
| All | Median merge time per shard | | 31.0119 | min |
| All | Max merge time per shard | | 31.0119 | min |
| All | Total merge throttle time | | 22.3339 | min |
| All | Min merge throttle time per shard | | 22.3339 | min |
| All | Median merge throttle time per shard | | 22.3339 | min |
| All | Max merge throttle time per shard | | 22.3339 | min |
| All | Total refresh time | | 1.56233 | min |
| All | Min refresh time per shard | | 1.56233 | min |
| All | Median refresh time per shard | | 1.56233 | min |
| All | Max refresh time per shard | | 1.56233 | min |
| All | Total flush time | | 1.701 | min |
| All | Min flush time per shard | | 1.701 | min |
| All | Median flush time per shard | | 1.701 | min |
| All | Max flush time per shard | | 1.701 | min |
| All | Median CPU usage | | 494.6 | % |
| All | Total Young Gen GC | | 136.722 | s |
| All | Total Old Gen GC | | 14.474 | s |
| All | Store size | | 6.73964 | GB |
| All | Translog size | | 0.509779 | GB |
| All | Index size | | 5.8439 | GB |
| All | Totally written | | 101.292 | GB |
| All | Heap used for segments | | 87.5367 | MB |
| All | Heap used for doc values | | 0.00376129 | MB |
| All | Heap used for terms | | 81.5288 | MB |
| All | Heap used for norms | | 0 | MB |
| All | Heap used for points | | 1.17022 | MB |
| All | Heap used for stored fields | | 4.83391 | MB |
| All | Segment count | | 58 | |
| All | Min Throughput | process-dissect | 154158 | docs/s |
| All | Median Throughput | process-dissect | 162775 | docs/s |
| All | Max Throughput | process-dissect | 163352 | docs/s |
| All | 50th percentile latency | process-dissect | 207.627 | ms |
| All | 90th percentile latency | process-dissect | 308.525 | ms |
| All | 99th percentile latency | process-dissect | 687.543 | ms |
| All | 99.9th percentile latency | process-dissect | 890.61 | ms |
| All | 99.99th percentile latency | process-dissect | 990.749 | ms |
| All | 100th percentile latency | process-dissect | 1040.17 | ms |
| All | 50th percentile service time | process-dissect | 207.627 | ms |
| All | 90th percentile service time | process-dissect | 308.525 | ms |
| All | 99th percentile service time | process-dissect | 687.543 | ms |
| All | 99.9th percentile service time | process-dissect | 890.61 | ms |
| All | 99.99th percentile service time | process-dissect | 990.749 | ms |
| All | 100th percentile service time | process-dissect | 1040.17 | ms |
| All | error rate | process-dissect | 0.02 | % |
----------------------------------
[INFO] SUCCESS (took 1620 seconds)
----------------------------------
-bash: --report-file=~/dissect1.out: No such file or directory
____ ____
/ __ \____ _/ / /_ __
/ /_/ / __ `/ / / / / /
/ _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
/____/
[INFO] Preparing for race ...
[INFO] Racing on track [http_logs_for_ingest], challenge [baseline] and car ['defaults'] with version [7.0.0-alpha1].
Lap [1/2]
*********
Running create-noop-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-noop [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 1 | Total indexing time | | 87.2223 | min |
| 1 | Min indexing time per shard | | 87.2223 | min |
| 1 | Median indexing time per shard | | 87.2223 | min |
| 1 | Max indexing time per shard | | 87.2223 | min |
| 1 | Total merge time | | 26.7936 | min |
| 1 | Min merge time per shard | | 26.7936 | min |
| 1 | Median merge time per shard | | 26.7936 | min |
| 1 | Max merge time per shard | | 26.7936 | min |
| 1 | Total merge throttle time | | 18.8569 | min |
| 1 | Min merge throttle time per shard | | 18.8569 | min |
| 1 | Median merge throttle time per shard | | 18.8569 | min |
| 1 | Max merge throttle time per shard | | 18.8569 | min |
| 1 | Total refresh time | | 1.21308 | min |
| 1 | Min refresh time per shard | | 1.21308 | min |
| 1 | Median refresh time per shard | | 1.21308 | min |
| 1 | Max refresh time per shard | | 1.21308 | min |
| 1 | Total flush time | | 1.65263 | min |
| 1 | Min flush time per shard | | 1.65263 | min |
| 1 | Median flush time per shard | | 1.65263 | min |
| 1 | Max flush time per shard | | 1.65263 | min |
| 1 | Median CPU usage | | 482.6 | % |
| 1 | Total Young Gen GC | | 101.802 | s |
| 1 | Total Old Gen GC | | 9.127 | s |
| 1 | Store size | | 6.97442 | GB |
| 1 | Translog size | | 0.541986 | GB |
| 1 | Totally written | | 68.3619 | GB |
| 1 | Heap used for segments | | 94.0247 | MB |
| 1 | Heap used for doc values | | 0.00440979 | MB |
| 1 | Heap used for terms | | 88.0719 | MB |
| 1 | Heap used for norms | | 0 | MB |
| 1 | Heap used for points | | 1.17633 | MB |
| 1 | Heap used for stored fields | | 4.77203 | MB |
| 1 | Segment count | | 68 | |
| 1 | Min Throughput | process-noop | 180582 | docs/s |
| 1 | Median Throughput | process-noop | 191756 | docs/s |
| 1 | Max Throughput | process-noop | 193228 | docs/s |
| 1 | 50th percentile latency | process-noop | 175.344 | ms |
| 1 | 90th percentile latency | process-noop | 245.376 | ms |
| 1 | 99th percentile latency | process-noop | 666.059 | ms |
| 1 | 99.9th percentile latency | process-noop | 864.04 | ms |
| 1 | 99.99th percentile latency | process-noop | 1019.36 | ms |
| 1 | 100th percentile latency | process-noop | 1125.18 | ms |
| 1 | 50th percentile service time | process-noop | 175.344 | ms |
| 1 | 90th percentile service time | process-noop | 245.376 | ms |
| 1 | 99th percentile service time | process-noop | 666.059 | ms |
| 1 | 99.9th percentile service time | process-noop | 864.04 | ms |
| 1 | 99.99th percentile service time | process-noop | 1019.36 | ms |
| 1 | 100th percentile service time | process-noop | 1125.18 | ms |
| 1 | error rate | process-noop | 0.02 | % |
[INFO] Lap time 00:23:16 (ETA: 00:23:16)
Lap [2/2]
*********
Running create-noop-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-noop [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 2 | Total indexing time | | 87.5386 | min |
| 2 | Min indexing time per shard | | 87.5386 | min |
| 2 | Median indexing time per shard | | 87.5386 | min |
| 2 | Max indexing time per shard | | 87.5386 | min |
| 2 | Total merge time | | 30.3724 | min |
| 2 | Min merge time per shard | | 30.3724 | min |
| 2 | Median merge time per shard | | 30.3724 | min |
| 2 | Max merge time per shard | | 30.3724 | min |
| 2 | Total merge throttle time | | 22.2854 | min |
| 2 | Min merge throttle time per shard | | 22.2854 | min |
| 2 | Median merge throttle time per shard | | 22.2854 | min |
| 2 | Max merge throttle time per shard | | 22.2854 | min |
| 2 | Total refresh time | | 1.18755 | min |
| 2 | Min refresh time per shard | | 1.18755 | min |
| 2 | Median refresh time per shard | | 1.18755 | min |
| 2 | Max refresh time per shard | | 1.18755 | min |
| 2 | Total flush time | | 1.62393 | min |
| 2 | Min flush time per shard | | 1.62393 | min |
| 2 | Median flush time per shard | | 1.62393 | min |
| 2 | Max flush time per shard | | 1.62393 | min |
| 2 | Median CPU usage | | 474.6 | % |
| 2 | Total Young Gen GC | | 105.001 | s |
| 2 | Total Old Gen GC | | 9.018 | s |
| 2 | Store size | | 6.61696 | GB |
| 2 | Translog size | | 0.587059 | GB |
| 2 | Totally written | | 69.0253 | GB |
| 2 | Heap used for segments | | 93.4068 | MB |
| 2 | Heap used for doc values | | 0.00408554 | MB |
| 2 | Heap used for terms | | 87.468 | MB |
| 2 | Heap used for norms | | 0 | MB |
| 2 | Heap used for points | | 1.16967 | MB |
| 2 | Heap used for stored fields | | 4.76498 | MB |
| 2 | Segment count | | 63 | |
| 2 | Min Throughput | process-noop | 182852 | docs/s |
| 2 | Median Throughput | process-noop | 186793 | docs/s |
| 2 | Max Throughput | process-noop | 192280 | docs/s |
| 2 | 50th percentile latency | process-noop | 182.579 | ms |
| 2 | 90th percentile latency | process-noop | 255.605 | ms |
| 2 | 99th percentile latency | process-noop | 662.263 | ms |
| 2 | 99.9th percentile latency | process-noop | 874.645 | ms |
| 2 | 99.99th percentile latency | process-noop | 954.126 | ms |
| 2 | 100th percentile latency | process-noop | 1064.16 | ms |
| 2 | 50th percentile service time | process-noop | 182.579 | ms |
| 2 | 90th percentile service time | process-noop | 255.605 | ms |
| 2 | 99th percentile service time | process-noop | 662.263 | ms |
| 2 | 99.9th percentile service time | process-noop | 874.645 | ms |
| 2 | 99.99th percentile service time | process-noop | 954.126 | ms |
| 2 | 100th percentile service time | process-noop | 1064.16 | ms |
| 2 | error rate | process-noop | 0.02 | % |
[INFO] Lap time 00:22:44
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| All | Total indexing time | | 174.761 | min |
| All | Min indexing time per shard | | 87.2223 | min |
| All | Median indexing time per shard | | 87.3804 | min |
| All | Max indexing time per shard | | 87.5386 | min |
| All | Total merge time | | 57.166 | min |
| All | Min merge time per shard | | 26.7936 | min |
| All | Median merge time per shard | | 28.583 | min |
| All | Max merge time per shard | | 30.3724 | min |
| All | Total merge throttle time | | 41.1424 | min |
| All | Min merge throttle time per shard | | 18.8569 | min |
| All | Median merge throttle time per shard | | 20.5712 | min |
| All | Max merge throttle time per shard | | 22.2854 | min |
| All | Total refresh time | | 2.40063 | min |
| All | Min refresh time per shard | | 1.18755 | min |
| All | Median refresh time per shard | | 1.20032 | min |
| All | Max refresh time per shard | | 1.21308 | min |
| All | Total flush time | | 3.27657 | min |
| All | Min flush time per shard | | 1.62393 | min |
| All | Median flush time per shard | | 1.63828 | min |
| All | Max flush time per shard | | 1.65263 | min |
| All | Median CPU usage | | 478.6 | % |
| All | Total Young Gen GC | | 206.803 | s |
| All | Total Old Gen GC | | 18.145 | s |
| All | Store size | | 6.79569 | GB |
| All | Translog size | | 0.564523 | GB |
| All | Index size | | 5.83167 | GB |
| All | Totally written | | 137.387 | GB |
| All | Heap used for segments | | 93.7157 | MB |
| All | Heap used for doc values | | 0.00424767 | MB |
| All | Heap used for terms | | 87.77 | MB |
| All | Heap used for norms | | 0 | MB |
| All | Heap used for points | | 1.173 | MB |
| All | Heap used for stored fields | | 4.76851 | MB |
| All | Segment count | | 65 | |
| All | Min Throughput | process-noop | 180582 | docs/s |
| All | Median Throughput | process-noop | 189111 | docs/s |
| All | Max Throughput | process-noop | 193228 | docs/s |
| All | 50th percentile latency | process-noop | 178.57 | ms |
| All | 90th percentile latency | process-noop | 250.709 | ms |
| All | 99th percentile latency | process-noop | 664.214 | ms |
| All | 99.9th percentile latency | process-noop | 872.608 | ms |
| All | 99.99th percentile latency | process-noop | 983.256 | ms |
| All | 100th percentile latency | process-noop | 1125.18 | ms |
| All | 50th percentile service time | process-noop | 178.57 | ms |
| All | 90th percentile service time | process-noop | 250.709 | ms |
| All | 99th percentile service time | process-noop | 664.214 | ms |
| All | 99.9th percentile service time | process-noop | 872.608 | ms |
| All | 99.99th percentile service time | process-noop | 983.256 | ms |
| All | 100th percentile service time | process-noop | 1125.18 | ms |
| All | error rate | process-noop | 0.02 | % |
----------------------------------
[INFO] SUCCESS (took 2767 seconds)
----------------------------------
-bash: --report-file=~/baseline2.out: No such file or directory
____ ____
/ __ \____ _/ / /_ __
/ /_/ / __ `/ / / / / /
/ _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
/____/
[INFO] Preparing for race ...
[INFO] Racing on track [http_logs_for_ingest], challenge [grok] and car ['defaults'] with version [7.0.0-alpha1].
Lap [1/2]
*********
Running create-grok-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-grok [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 1 | Total indexing time | | 99.4193 | min |
| 1 | Min indexing time per shard | | 99.4193 | min |
| 1 | Median indexing time per shard | | 99.4193 | min |
| 1 | Max indexing time per shard | | 99.4193 | min |
| 1 | Total merge time | | 31.8368 | min |
| 1 | Min merge time per shard | | 31.8368 | min |
| 1 | Median merge time per shard | | 31.8368 | min |
| 1 | Max merge time per shard | | 31.8368 | min |
| 1 | Total merge throttle time | | 23.0355 | min |
| 1 | Min merge throttle time per shard | | 23.0355 | min |
| 1 | Median merge throttle time per shard | | 23.0355 | min |
| 1 | Max merge throttle time per shard | | 23.0355 | min |
| 1 | Total refresh time | | 1.73532 | min |
| 1 | Min refresh time per shard | | 1.73532 | min |
| 1 | Median refresh time per shard | | 1.73532 | min |
| 1 | Max refresh time per shard | | 1.73532 | min |
| 1 | Total flush time | | 1.86007 | min |
| 1 | Min flush time per shard | | 1.86007 | min |
| 1 | Median flush time per shard | | 1.86007 | min |
| 1 | Max flush time per shard | | 1.86007 | min |
| 1 | Median CPU usage | | 539.6 | % |
| 1 | Total Young Gen GC | | 145.082 | s |
| 1 | Total Old Gen GC | | 15.698 | s |
| 1 | Store size | | 6.76661 | GB |
| 1 | Translog size | | 0.530722 | GB |
| 1 | Totally written | | 100.295 | GB |
| 1 | Heap used for segments | | 82.3001 | MB |
| 1 | Heap used for doc values | | 0.00350189 | MB |
| 1 | Heap used for terms | | 76.2719 | MB |
| 1 | Heap used for norms | | 0 | MB |
| 1 | Heap used for points | | 1.17035 | MB |
| 1 | Heap used for stored fields | | 4.85429 | MB |
| 1 | Segment count | | 54 | |
| 1 | Min Throughput | process-grok | 141121 | docs/s |
| 1 | Median Throughput | process-grok | 151231 | docs/s |
| 1 | Max Throughput | process-grok | 151712 | docs/s |
| 1 | 50th percentile latency | process-grok | 227.472 | ms |
| 1 | 90th percentile latency | process-grok | 321.958 | ms |
| 1 | 99th percentile latency | process-grok | 720.63 | ms |
| 1 | 99.9th percentile latency | process-grok | 975.799 | ms |
| 1 | 99.99th percentile latency | process-grok | 1097.46 | ms |
| 1 | 100th percentile latency | process-grok | 1227.46 | ms |
| 1 | 50th percentile service time | process-grok | 227.472 | ms |
| 1 | 90th percentile service time | process-grok | 321.958 | ms |
| 1 | 99th percentile service time | process-grok | 720.63 | ms |
| 1 | 99.9th percentile service time | process-grok | 975.799 | ms |
| 1 | 99.99th percentile service time | process-grok | 1097.46 | ms |
| 1 | 100th percentile service time | process-grok | 1227.46 | ms |
| 1 | error rate | process-grok | 0.02 | % |
[INFO] Lap time 00:28:57 (ETA: 00:28:57)
Lap [2/2]
*********
Running create-grok-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-grok [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 2 | Total indexing time | | 100.526 | min |
| 2 | Min indexing time per shard | | 100.526 | min |
| 2 | Median indexing time per shard | | 100.526 | min |
| 2 | Max indexing time per shard | | 100.526 | min |
| 2 | Total merge time | | 30.2661 | min |
| 2 | Min merge time per shard | | 30.2661 | min |
| 2 | Median merge time per shard | | 30.2661 | min |
| 2 | Max merge time per shard | | 30.2661 | min |
| 2 | Total merge throttle time | | 21.8872 | min |
| 2 | Min merge throttle time per shard | | 21.8872 | min |
| 2 | Median merge throttle time per shard | | 21.8872 | min |
| 2 | Max merge throttle time per shard | | 21.8872 | min |
| 2 | Total refresh time | | 1.73948 | min |
| 2 | Min refresh time per shard | | 1.73948 | min |
| 2 | Median refresh time per shard | | 1.73948 | min |
| 2 | Max refresh time per shard | | 1.73948 | min |
| 2 | Total flush time | | 1.8236 | min |
| 2 | Min flush time per shard | | 1.8236 | min |
| 2 | Median flush time per shard | | 1.8236 | min |
| 2 | Max flush time per shard | | 1.8236 | min |
| 2 | Median CPU usage | | 533.6 | % |
| 2 | Total Young Gen GC | | 150.262 | s |
| 2 | Total Old Gen GC | | 16.332 | s |
| 2 | Store size | | 8.74981 | GB |
| 2 | Translog size | | 0.533089 | GB |
| 2 | Totally written | | 101.803 | GB |
| 2 | Heap used for segments | | 85.2272 | MB |
| 2 | Heap used for doc values | | 0.00479889 | MB |
| 2 | Heap used for terms | | 79.2049 | MB |
| 2 | Heap used for norms | | 0 | MB |
| 2 | Heap used for points | | 1.17069 | MB |
| 2 | Heap used for stored fields | | 4.84686 | MB |
| 2 | Segment count | | 74 | |
| 2 | Min Throughput | process-grok | 146543 | docs/s |
| 2 | Median Throughput | process-grok | 148887 | docs/s |
| 2 | Max Throughput | process-grok | 152870 | docs/s |
| 2 | 50th percentile latency | process-grok | 237.743 | ms |
| 2 | 90th percentile latency | process-grok | 333.382 | ms |
| 2 | 99th percentile latency | process-grok | 734.906 | ms |
| 2 | 99.9th percentile latency | process-grok | 979.963 | ms |
| 2 | 99.99th percentile latency | process-grok | 1097.31 | ms |
| 2 | 100th percentile latency | process-grok | 1127.7 | ms |
| 2 | 50th percentile service time | process-grok | 237.743 | ms |
| 2 | 90th percentile service time | process-grok | 333.382 | ms |
| 2 | 99th percentile service time | process-grok | 734.906 | ms |
| 2 | 99.9th percentile service time | process-grok | 979.963 | ms |
| 2 | 99.99th percentile service time | process-grok | 1097.31 | ms |
| 2 | 100th percentile service time | process-grok | 1127.7 | ms |
| 2 | error rate | process-grok | 0.02 | % |
[INFO] Lap time 00:28:34
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| All | Total indexing time | | 199.945 | min |
| All | Min indexing time per shard | | 99.4193 | min |
| All | Median indexing time per shard | | 99.9726 | min |
| All | Max indexing time per shard | | 100.526 | min |
| All | Total merge time | | 62.1029 | min |
| All | Min merge time per shard | | 30.2661 | min |
| All | Median merge time per shard | | 31.0515 | min |
| All | Max merge time per shard | | 31.8368 | min |
| All | Total merge throttle time | | 44.9227 | min |
| All | Min merge throttle time per shard | | 21.8872 | min |
| All | Median merge throttle time per shard | | 22.4614 | min |
| All | Max merge throttle time per shard | | 23.0355 | min |
| All | Total refresh time | | 3.4748 | min |
| All | Min refresh time per shard | | 1.73532 | min |
| All | Median refresh time per shard | | 1.7374 | min |
| All | Max refresh time per shard | | 1.73948 | min |
| All | Total flush time | | 3.68367 | min |
| All | Min flush time per shard | | 1.8236 | min |
| All | Median flush time per shard | | 1.84183 | min |
| All | Max flush time per shard | | 1.86007 | min |
| All | Median CPU usage | | 536.5 | % |
| All | Total Young Gen GC | | 295.344 | s |
| All | Total Old Gen GC | | 32.03 | s |
| All | Store size | | 7.75821 | GB |
| All | Translog size | | 0.531906 | GB |
| All | Index size | | 5.77184 | GB |
| All | Totally written | | 202.098 | GB |
| All | Heap used for segments | | 83.7636 | MB |
| All | Heap used for doc values | | 0.00415039 | MB |
| All | Heap used for terms | | 77.7384 | MB |
| All | Heap used for norms | | 0 | MB |
| All | Heap used for points | | 1.17052 | MB |
| All | Heap used for stored fields | | 4.85057 | MB |
| All | Segment count | | 64 | |
| All | Min Throughput | process-grok | 141121 | docs/s |
| All | Median Throughput | process-grok | 149702 | docs/s |
| All | Max Throughput | process-grok | 152870 | docs/s |
| All | 50th percentile latency | process-grok | 231.835 | ms |
| All | 90th percentile latency | process-grok | 327.797 | ms |
| All | 99th percentile latency | process-grok | 730.723 | ms |
| All | 99.9th percentile latency | process-grok | 978.166 | ms |
| All | 99.99th percentile latency | process-grok | 1097.57 | ms |
| All | 100th percentile latency | process-grok | 1227.46 | ms |
| All | 50th percentile service time | process-grok | 231.835 | ms |
| All | 90th percentile service time | process-grok | 327.797 | ms |
| All | 99th percentile service time | process-grok | 730.723 | ms |
| All | 99.9th percentile service time | process-grok | 978.166 | ms |
| All | 99.99th percentile service time | process-grok | 1097.57 | ms |
| All | 100th percentile service time | process-grok | 1227.46 | ms |
| All | error rate | process-grok | 0.02 | % |
----------------------------------
[INFO] SUCCESS (took 3457 seconds)
----------------------------------
-bash: --report-file=~/grok2.out: No such file or directory
____ ____
/ __ \____ _/ / /_ __
/ /_/ / __ `/ / / / / /
/ _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
/____/
[INFO] Preparing for race ...
[INFO] Racing on track [http_logs_for_ingest], challenge [dissect] and car ['defaults'] with version [7.0.0-alpha1].
Lap [1/2]
*********
Running create-dissect-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-dissect [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|----------------:|-----------:|-------:|
| 1 | Total indexing time | | 107.568 | min |
| 1 | Min indexing time per shard | | 107.568 | min |
| 1 | Median indexing time per shard | | 107.568 | min |
| 1 | Max indexing time per shard | | 107.568 | min |
| 1 | Total merge time | | 28.6463 | min |
| 1 | Min merge time per shard | | 28.6463 | min |
| 1 | Median merge time per shard | | 28.6463 | min |
| 1 | Max merge time per shard | | 28.6463 | min |
| 1 | Total merge throttle time | | 20.1263 | min |
| 1 | Min merge throttle time per shard | | 20.1263 | min |
| 1 | Median merge throttle time per shard | | 20.1263 | min |
| 1 | Max merge throttle time per shard | | 20.1263 | min |
| 1 | Total refresh time | | 1.52617 | min |
| 1 | Min refresh time per shard | | 1.52617 | min |
| 1 | Median refresh time per shard | | 1.52617 | min |
| 1 | Max refresh time per shard | | 1.52617 | min |
| 1 | Total flush time | | 1.70815 | min |
| 1 | Min flush time per shard | | 1.70815 | min |
| 1 | Median flush time per shard | | 1.70815 | min |
| 1 | Max flush time per shard | | 1.70815 | min |
| 1 | Median CPU usage | | 498.6 | % |
| 1 | Total Young Gen GC | | 137.183 | s |
| 1 | Total Old Gen GC | | 14.655 | s |
| 1 | Store size | | 6.60832 | GB |
| 1 | Translog size | | 0.544298 | GB |
| 1 | Totally written | | 100.936 | GB |
| 1 | Heap used for segments | | 87.5945 | MB |
| 1 | Heap used for doc values | | 0.00382614 | MB |
| 1 | Heap used for terms | | 81.56 | MB |
| 1 | Heap used for norms | | 0 | MB |
| 1 | Heap used for points | | 1.17117 | MB |
| 1 | Heap used for stored fields | | 4.85954 | MB |
| 1 | Segment count | | 59 | |
| 1 | Min Throughput | process-dissect | 152393 | docs/s |
| 1 | Median Throughput | process-dissect | 162640 | docs/s |
| 1 | Max Throughput | process-dissect | 163223 | docs/s |
| 1 | 50th percentile latency | process-dissect | 208.127 | ms |
| 1 | 90th percentile latency | process-dissect | 306.394 | ms |
| 1 | 99th percentile latency | process-dissect | 679.747 | ms |
| 1 | 99.9th percentile latency | process-dissect | 885.123 | ms |
| 1 | 99.99th percentile latency | process-dissect | 978.575 | ms |
| 1 | 100th percentile latency | process-dissect | 1097.75 | ms |
| 1 | 50th percentile service time | process-dissect | 208.127 | ms |
| 1 | 90th percentile service time | process-dissect | 306.394 | ms |
| 1 | 99th percentile service time | process-dissect | 679.747 | ms |
| 1 | 99.9th percentile service time | process-dissect | 885.123 | ms |
| 1 | 99.99th percentile service time | process-dissect | 978.575 | ms |
| 1 | 100th percentile service time | process-dissect | 1097.75 | ms |
| 1 | error rate | process-dissect | 0.02 | % |
[INFO] Lap time 00:26:55 (ETA: 00:26:55)
Lap [2/2]
*********
Running create-dissect-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-dissect [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|----------------:|-----------:|-------:|
| 2 | Total indexing time | | 107.385 | min |
| 2 | Min indexing time per shard | | 107.385 | min |
| 2 | Median indexing time per shard | | 107.385 | min |
| 2 | Max indexing time per shard | | 107.385 | min |
| 2 | Total merge time | | 27.9585 | min |
| 2 | Min merge time per shard | | 27.9585 | min |
| 2 | Median merge time per shard | | 27.9585 | min |
| 2 | Max merge time per shard | | 27.9585 | min |
| 2 | Total merge throttle time | | 19.5119 | min |
| 2 | Min merge throttle time per shard | | 19.5119 | min |
| 2 | Median merge throttle time per shard | | 19.5119 | min |
| 2 | Max merge throttle time per shard | | 19.5119 | min |
| 2 | Total refresh time | | 1.5255 | min |
| 2 | Min refresh time per shard | | 1.5255 | min |
| 2 | Median refresh time per shard | | 1.5255 | min |
| 2 | Max refresh time per shard | | 1.5255 | min |
| 2 | Total flush time | | 1.67043 | min |
| 2 | Min flush time per shard | | 1.67043 | min |
| 2 | Median flush time per shard | | 1.67043 | min |
| 2 | Max flush time per shard | | 1.67043 | min |
| 2 | Median CPU usage | | 492.6 | % |
| 2 | Total Young Gen GC | | 142.325 | s |
| 2 | Total Old Gen GC | | 15.489 | s |
| 2 | Store size | | 8.05795 | GB |
| 2 | Translog size | | 0.521652 | GB |
| 2 | Totally written | | 101.938 | GB |
| 2 | Heap used for segments | | 86.3099 | MB |
| 2 | Heap used for doc values | | 0.00434494 | MB |
| 2 | Heap used for terms | | 80.2988 | MB |
| 2 | Heap used for norms | | 0 | MB |
| 2 | Heap used for points | | 1.17137 | MB |
| 2 | Heap used for stored fields | | 4.8353 | MB |
| 2 | Segment count | | 67 | |
| 2 | Min Throughput | process-dissect | 158886 | docs/s |
| 2 | Median Throughput | process-dissect | 160500 | docs/s |
| 2 | Max Throughput | process-dissect | 166008 | docs/s |
| 2 | 50th percentile latency | process-dissect | 217.352 | ms |
| 2 | 90th percentile latency | process-dissect | 315.199 | ms |
| 2 | 99th percentile latency | process-dissect | 680.645 | ms |
| 2 | 99.9th percentile latency | process-dissect | 911.924 | ms |
| 2 | 99.99th percentile latency | process-dissect | 1005.92 | ms |
| 2 | 100th percentile latency | process-dissect | 1043.8 | ms |
| 2 | 50th percentile service time | process-dissect | 217.352 | ms |
| 2 | 90th percentile service time | process-dissect | 315.199 | ms |
| 2 | 99th percentile service time | process-dissect | 680.645 | ms |
| 2 | 99.9th percentile service time | process-dissect | 911.924 | ms |
| 2 | 99.99th percentile service time | process-dissect | 1005.92 | ms |
| 2 | 100th percentile service time | process-dissect | 1043.8 | ms |
| 2 | error rate | process-dissect | 0.02 | % |
[INFO] Lap time 00:26:24
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|----------------:|-----------:|-------:|
| All | Total indexing time | | 214.953 | min |
| All | Min indexing time per shard | | 107.385 | min |
| All | Median indexing time per shard | | 107.477 | min |
| All | Max indexing time per shard | | 107.568 | min |
| All | Total merge time | | 56.6048 | min |
| All | Min merge time per shard | | 27.9585 | min |
| All | Median merge time per shard | | 28.3024 | min |
| All | Max merge time per shard | | 28.6463 | min |
| All | Total merge throttle time | | 39.6382 | min |
| All | Min merge throttle time per shard | | 19.5119 | min |
| All | Median merge throttle time per shard | | 19.8191 | min |
| All | Max merge throttle time per shard | | 20.1263 | min |
| All | Total refresh time | | 3.05167 | min |
| All | Min refresh time per shard | | 1.5255 | min |
| All | Median refresh time per shard | | 1.52583 | min |
| All | Max refresh time per shard | | 1.52617 | min |
| All | Total flush time | | 3.37858 | min |
| All | Min flush time per shard | | 1.67043 | min |
| All | Median flush time per shard | | 1.68929 | min |
| All | Max flush time per shard | | 1.70815 | min |
| All | Median CPU usage | | 495.6 | % |
| All | Total Young Gen GC | | 279.508 | s |
| All | Total Old Gen GC | | 30.144 | s |
| All | Store size | | 7.33314 | GB |
| All | Translog size | | 0.532975 | GB |
| All | Index size | | 5.80419 | GB |
| All | Totally written | | 202.874 | GB |
| All | Heap used for segments | | 86.9522 | MB |
| All | Heap used for doc values | | 0.00408554 | MB |
| All | Heap used for terms | | 80.9294 | MB |
| All | Heap used for norms | | 0 | MB |
| All | Heap used for points | | 1.17127 | MB |
| All | Heap used for stored fields | | 4.84742 | MB |
| All | Segment count | | 63 | |
| All | Min Throughput | process-dissect | 152393 | docs/s |
| All | Median Throughput | process-dissect | 161537 | docs/s |
| All | Max Throughput | process-dissect | 166008 | docs/s |
| All | 50th percentile latency | process-dissect | 212.064 | ms |
| All | 90th percentile latency | process-dissect | 310.921 | ms |
| All | 99th percentile latency | process-dissect | 680.527 | ms |
| All | 99.9th percentile latency | process-dissect | 899.003 | ms |
| All | 99.99th percentile latency | process-dissect | 996.505 | ms |
| All | 100th percentile latency | process-dissect | 1097.75 | ms |
| All | 50th percentile service time | process-dissect | 212.064 | ms |
| All | 90th percentile service time | process-dissect | 310.921 | ms |
| All | 99th percentile service time | process-dissect | 680.527 | ms |
| All | 99.9th percentile service time | process-dissect | 899.003 | ms |
| All | 99.99th percentile service time | process-dissect | 996.505 | ms |
| All | 100th percentile service time | process-dissect | 1097.75 | ms |
| All | error rate | process-dissect | 0.02 | % |
----------------------------------
[INFO] SUCCESS (took 3210 seconds)
----------------------------------
-bash: --report-file=~/dissect2.out: No such file or directory
____ ____
/ __ \____ _/ / /_ __
/ /_/ / __ `/ / / / / /
/ _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
/____/
[INFO] Preparing for race ...
[INFO] Racing on track [http_logs_for_ingest], challenge [baseline] and car ['defaults'] with version [7.0.0-alpha1].
Lap [1/3]
*********
Running create-noop-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-noop [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 1 | Total indexing time | | 84.3422 | min |
| 1 | Min indexing time per shard | | 84.3422 | min |
| 1 | Median indexing time per shard | | 84.3422 | min |
| 1 | Max indexing time per shard | | 84.3422 | min |
| 1 | Total merge time | | 28.7153 | min |
| 1 | Min merge time per shard | | 28.7153 | min |
| 1 | Median merge time per shard | | 28.7153 | min |
| 1 | Max merge time per shard | | 28.7153 | min |
| 1 | Total merge throttle time | | 20.4715 | min |
| 1 | Min merge throttle time per shard | | 20.4715 | min |
| 1 | Median merge throttle time per shard | | 20.4715 | min |
| 1 | Max merge throttle time per shard | | 20.4715 | min |
| 1 | Total refresh time | | 1.30237 | min |
| 1 | Min refresh time per shard | | 1.30237 | min |
| 1 | Median refresh time per shard | | 1.30237 | min |
| 1 | Max refresh time per shard | | 1.30237 | min |
| 1 | Total flush time | | 1.7243 | min |
| 1 | Min flush time per shard | | 1.7243 | min |
| 1 | Median flush time per shard | | 1.7243 | min |
| 1 | Max flush time per shard | | 1.7243 | min |
| 1 | Median CPU usage | | 481.6 | % |
| 1 | Total Young Gen GC | | 102.415 | s |
| 1 | Total Old Gen GC | | 9.465 | s |
| 1 | Store size | | 5.83989 | GB |
| 1 | Translog size | | 0.563353 | GB |
| 1 | Totally written | | 68.7303 | GB |
| 1 | Heap used for segments | | 94.8878 | MB |
| 1 | Heap used for doc values | | 0.00317764 | MB |
| 1 | Heap used for terms | | 88.9246 | MB |
| 1 | Heap used for norms | | 0 | MB |
| 1 | Heap used for points | | 1.16924 | MB |
| 1 | Heap used for stored fields | | 4.79081 | MB |
| 1 | Segment count | | 49 | |
| 1 | Min Throughput | process-noop | 185724 | docs/s |
| 1 | Median Throughput | process-noop | 192512 | docs/s |
| 1 | Max Throughput | process-noop | 193586 | docs/s |
| 1 | 50th percentile latency | process-noop | 173.851 | ms |
| 1 | 90th percentile latency | process-noop | 245.208 | ms |
| 1 | 99th percentile latency | process-noop | 690.132 | ms |
| 1 | 99.9th percentile latency | process-noop | 920.825 | ms |
| 1 | 99.99th percentile latency | process-noop | 1047.31 | ms |
| 1 | 100th percentile latency | process-noop | 1171.43 | ms |
| 1 | 50th percentile service time | process-noop | 173.851 | ms |
| 1 | 90th percentile service time | process-noop | 245.208 | ms |
| 1 | 99th percentile service time | process-noop | 690.132 | ms |
| 1 | 99.9th percentile service time | process-noop | 920.825 | ms |
| 1 | 99.99th percentile service time | process-noop | 1047.31 | ms |
| 1 | 100th percentile service time | process-noop | 1171.43 | ms |
| 1 | error rate | process-noop | 0.02 | % |
[INFO] Lap time 00:22:59 (ETA: 00:45:58)
Lap [2/3]
*********
Running create-noop-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-noop [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 2 | Total indexing time | | 83.1338 | min |
| 2 | Min indexing time per shard | | 83.1338 | min |
| 2 | Median indexing time per shard | | 83.1338 | min |
| 2 | Max indexing time per shard | | 83.1338 | min |
| 2 | Total merge time | | 27.1815 | min |
| 2 | Min merge time per shard | | 27.1815 | min |
| 2 | Median merge time per shard | | 27.1815 | min |
| 2 | Max merge time per shard | | 27.1815 | min |
| 2 | Total merge throttle time | | 19.1141 | min |
| 2 | Min merge throttle time per shard | | 19.1141 | min |
| 2 | Median merge throttle time per shard | | 19.1141 | min |
| 2 | Max merge throttle time per shard | | 19.1141 | min |
| 2 | Total refresh time | | 1.24078 | min |
| 2 | Min refresh time per shard | | 1.24078 | min |
| 2 | Median refresh time per shard | | 1.24078 | min |
| 2 | Max refresh time per shard | | 1.24078 | min |
| 2 | Total flush time | | 1.77375 | min |
| 2 | Min flush time per shard | | 1.77375 | min |
| 2 | Median flush time per shard | | 1.77375 | min |
| 2 | Max flush time per shard | | 1.77375 | min |
| 2 | Median CPU usage | | 473.6 | % |
| 2 | Total Young Gen GC | | 104.321 | s |
| 2 | Total Old Gen GC | | 9.223 | s |
| 2 | Store size | | 6.3564 | GB |
| 2 | Translog size | | 0.543935 | GB |
| 2 | Totally written | | 68.7038 | GB |
| 2 | Heap used for segments | | 94.5974 | MB |
| 2 | Heap used for doc values | | 0.00440979 | MB |
| 2 | Heap used for terms | | 88.6144 | MB |
| 2 | Heap used for norms | | 0 | MB |
| 2 | Heap used for points | | 1.17388 | MB |
| 2 | Heap used for stored fields | | 4.80474 | MB |
| 2 | Segment count | | 68 | |
| 2 | Min Throughput | process-noop | 185457 | docs/s |
| 2 | Median Throughput | process-noop | 189049 | docs/s |
| 2 | Max Throughput | process-noop | 194646 | docs/s |
| 2 | 50th percentile latency | process-noop | 179.155 | ms |
| 2 | 90th percentile latency | process-noop | 252.997 | ms |
| 2 | 99th percentile latency | process-noop | 689.36 | ms |
| 2 | 99.9th percentile latency | process-noop | 929.109 | ms |
| 2 | 99.99th percentile latency | process-noop | 1030.24 | ms |
| 2 | 100th percentile latency | process-noop | 1096.8 | ms |
| 2 | 50th percentile service time | process-noop | 179.155 | ms |
| 2 | 90th percentile service time | process-noop | 252.997 | ms |
| 2 | 99th percentile service time | process-noop | 689.36 | ms |
| 2 | 99.9th percentile service time | process-noop | 929.109 | ms |
| 2 | 99.99th percentile service time | process-noop | 1030.24 | ms |
| 2 | 100th percentile service time | process-noop | 1096.8 | ms |
| 2 | error rate | process-noop | 0.02 | % |
[INFO] Lap time 00:22:24 (ETA: 00:22:41)
Lap [3/3]
*********
Running create-noop-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-noop [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 3 | Total indexing time | | 83.3158 | min |
| 3 | Min indexing time per shard | | 83.3158 | min |
| 3 | Median indexing time per shard | | 83.3158 | min |
| 3 | Max indexing time per shard | | 83.3158 | min |
| 3 | Total merge time | | 28.1961 | min |
| 3 | Min merge time per shard | | 28.1961 | min |
| 3 | Median merge time per shard | | 28.1961 | min |
| 3 | Max merge time per shard | | 28.1961 | min |
| 3 | Total merge throttle time | | 20.0136 | min |
| 3 | Min merge throttle time per shard | | 20.0136 | min |
| 3 | Median merge throttle time per shard | | 20.0136 | min |
| 3 | Max merge throttle time per shard | | 20.0136 | min |
| 3 | Total refresh time | | 1.23605 | min |
| 3 | Min refresh time per shard | | 1.23605 | min |
| 3 | Median refresh time per shard | | 1.23605 | min |
| 3 | Max refresh time per shard | | 1.23605 | min |
| 3 | Total flush time | | 1.73865 | min |
| 3 | Min flush time per shard | | 1.73865 | min |
| 3 | Median flush time per shard | | 1.73865 | min |
| 3 | Max flush time per shard | | 1.73865 | min |
| 3 | Median CPU usage | | 471.6 | % |
| 3 | Total Young Gen GC | | 106.677 | s |
| 3 | Total Old Gen GC | | 9.31 | s |
| 3 | Store size | | 5.93992 | GB |
| 3 | Translog size | | 0.502306 | GB |
| 3 | Totally written | | 68.5271 | GB |
| 3 | Heap used for segments | | 93.5331 | MB |
| 3 | Heap used for doc values | | 0.00330734 | MB |
| 3 | Heap used for terms | | 87.542 | MB |
| 3 | Heap used for norms | | 0 | MB |
| 3 | Heap used for points | | 1.17369 | MB |
| 3 | Heap used for stored fields | | 4.81416 | MB |
| 3 | Segment count | | 51 | |
| 3 | Min Throughput | process-noop | 184968 | docs/s |
| 3 | Median Throughput | process-noop | 187577 | docs/s |
| 3 | Max Throughput | process-noop | 194192 | docs/s |
| 3 | 50th percentile latency | process-noop | 176.606 | ms |
| 3 | 90th percentile latency | process-noop | 265.076 | ms |
| 3 | 99th percentile latency | process-noop | 697.038 | ms |
| 3 | 99.9th percentile latency | process-noop | 932.162 | ms |
| 3 | 99.99th percentile latency | process-noop | 1075.85 | ms |
| 3 | 100th percentile latency | process-noop | 1161.37 | ms |
| 3 | 50th percentile service time | process-noop | 176.606 | ms |
| 3 | 90th percentile service time | process-noop | 265.076 | ms |
| 3 | 99th percentile service time | process-noop | 697.038 | ms |
| 3 | 99.9th percentile service time | process-noop | 932.162 | ms |
| 3 | 99.99th percentile service time | process-noop | 1075.85 | ms |
| 3 | 100th percentile service time | process-noop | 1161.37 | ms |
| 3 | error rate | process-noop | 0.02 | % |
[INFO] Lap time 00:22:35
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| All | Total indexing time | | 250.792 | min |
| All | Min indexing time per shard | | 83.1338 | min |
| All | Median indexing time per shard | | 83.3158 | min |
| All | Max indexing time per shard | | 84.3422 | min |
| All | Total merge time | | 84.093 | min |
| All | Min merge time per shard | | 27.1815 | min |
| All | Median merge time per shard | | 28.1961 | min |
| All | Max merge time per shard | | 28.7153 | min |
| All | Total merge throttle time | | 59.5992 | min |
| All | Min merge throttle time per shard | | 19.1141 | min |
| All | Median merge throttle time per shard | | 20.0136 | min |
| All | Max merge throttle time per shard | | 20.4715 | min |
| All | Total refresh time | | 3.7792 | min |
| All | Min refresh time per shard | | 1.23605 | min |
| All | Median refresh time per shard | | 1.24078 | min |
| All | Max refresh time per shard | | 1.30237 | min |
| All | Total flush time | | 5.2367 | min |
| All | Min flush time per shard | | 1.7243 | min |
| All | Median flush time per shard | | 1.73865 | min |
| All | Max flush time per shard | | 1.77375 | min |
| All | Median CPU usage | | 475.6 | % |
| All | Total Young Gen GC | | 313.413 | s |
| All | Total Old Gen GC | | 27.998 | s |
| All | Store size | | 5.93992 | GB |
| All | Translog size | | 0.543935 | GB |
| All | Index size | | 5.79219 | GB |
| All | Totally written | | 205.961 | GB |
| All | Heap used for segments | | 94.5974 | MB |
| All | Heap used for doc values | | 0.00330734 | MB |
| All | Heap used for terms | | 88.6144 | MB |
| All | Heap used for norms | | 0 | MB |
| All | Heap used for points | | 1.17369 | MB |
| All | Heap used for stored fields | | 4.80474 | MB |
| All | Segment count | | 51 | |
| All | Min Throughput | process-noop | 184968 | docs/s |
| All | Median Throughput | process-noop | 189351 | docs/s |
| All | Max Throughput | process-noop | 194646 | docs/s |
| All | 50th percentile latency | process-noop | 176.21 | ms |
| All | 90th percentile latency | process-noop | 255.435 | ms |
| All | 99th percentile latency | process-noop | 693.15 | ms |
| All | 99.9th percentile latency | process-noop | 927.308 | ms |
| All | 99.99th percentile latency | process-noop | 1056.47 | ms |
| All | 100th percentile latency | process-noop | 1171.43 | ms |
| All | 50th percentile service time | process-noop | 176.21 | ms |
| All | 90th percentile service time | process-noop | 255.435 | ms |
| All | 99th percentile service time | process-noop | 693.15 | ms |
| All | 99.9th percentile service time | process-noop | 927.308 | ms |
| All | 99.99th percentile service time | process-noop | 1056.47 | ms |
| All | 100th percentile service time | process-noop | 1171.43 | ms |
| All | error rate | process-noop | 0.02 | % |
----------------------------------
[INFO] SUCCESS (took 4085 seconds)
----------------------------------
-bash: --report-file=~/baseline3.out: No such file or directory
____ ____
/ __ \____ _/ / /_ __
/ /_/ / __ `/ / / / / /
/ _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
/____/
[INFO] Preparing for race ...
[INFO] Racing on track [http_logs_for_ingest], challenge [grok] and car ['defaults'] with version [7.0.0-alpha1].
Lap [1/3]
*********
Running create-grok-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-grok [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 1 | Total indexing time | | 101.7 | min |
| 1 | Min indexing time per shard | | 101.7 | min |
| 1 | Median indexing time per shard | | 101.7 | min |
| 1 | Max indexing time per shard | | 101.7 | min |
| 1 | Total merge time | | 34.008 | min |
| 1 | Min merge time per shard | | 34.008 | min |
| 1 | Median merge time per shard | | 34.008 | min |
| 1 | Max merge time per shard | | 34.008 | min |
| 1 | Total merge throttle time | | 25.5063 | min |
| 1 | Min merge throttle time per shard | | 25.5063 | min |
| 1 | Median merge throttle time per shard | | 25.5063 | min |
| 1 | Max merge throttle time per shard | | 25.5063 | min |
| 1 | Total refresh time | | 1.72493 | min |
| 1 | Min refresh time per shard | | 1.72493 | min |
| 1 | Median refresh time per shard | | 1.72493 | min |
| 1 | Max refresh time per shard | | 1.72493 | min |
| 1 | Total flush time | | 1.77337 | min |
| 1 | Min flush time per shard | | 1.77337 | min |
| 1 | Median flush time per shard | | 1.77337 | min |
| 1 | Max flush time per shard | | 1.77337 | min |
| 1 | Median CPU usage | | 548.6 | % |
| 1 | Total Young Gen GC | | 142.947 | s |
| 1 | Total Old Gen GC | | 15.715 | s |
| 1 | Store size | | 6.72019 | GB |
| 1 | Translog size | | 0.597765 | GB |
| 1 | Totally written | | 100.184 | GB |
| 1 | Heap used for segments | | 82.3703 | MB |
| 1 | Heap used for doc values | | 0.00473404 | MB |
| 1 | Heap used for terms | | 76.4027 | MB |
| 1 | Heap used for norms | | 0 | MB |
| 1 | Heap used for points | | 1.1679 | MB |
| 1 | Heap used for stored fields | | 4.79489 | MB |
| 1 | Segment count | | 73 | |
| 1 | Min Throughput | process-grok | 137543 | docs/s |
| 1 | Median Throughput | process-grok | 147246 | docs/s |
| 1 | Max Throughput | process-grok | 147606 | docs/s |
| 1 | 50th percentile latency | process-grok | 234.044 | ms |
| 1 | 90th percentile latency | process-grok | 328.348 | ms |
| 1 | 99th percentile latency | process-grok | 723.33 | ms |
| 1 | 99.9th percentile latency | process-grok | 1002.69 | ms |
| 1 | 99.99th percentile latency | process-grok | 1120.81 | ms |
| 1 | 100th percentile latency | process-grok | 1187.51 | ms |
| 1 | 50th percentile service time | process-grok | 234.044 | ms |
| 1 | 90th percentile service time | process-grok | 328.348 | ms |
| 1 | 99th percentile service time | process-grok | 723.33 | ms |
| 1 | 99.9th percentile service time | process-grok | 1002.69 | ms |
| 1 | 99.99th percentile service time | process-grok | 1120.81 | ms |
| 1 | 100th percentile service time | process-grok | 1187.51 | ms |
| 1 | error rate | process-grok | 0.02 | % |
[INFO] Lap time 00:29:49 (ETA: 00:59:39)
Lap [2/3]
*********
Running create-grok-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-grok [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 2 | Total indexing time | | 100.978 | min |
| 2 | Min indexing time per shard | | 100.978 | min |
| 2 | Median indexing time per shard | | 100.978 | min |
| 2 | Max indexing time per shard | | 100.978 | min |
| 2 | Total merge time | | 30.0465 | min |
| 2 | Min merge time per shard | | 30.0465 | min |
| 2 | Median merge time per shard | | 30.0465 | min |
| 2 | Max merge time per shard | | 30.0465 | min |
| 2 | Total merge throttle time | | 21.5109 | min |
| 2 | Min merge throttle time per shard | | 21.5109 | min |
| 2 | Median merge throttle time per shard | | 21.5109 | min |
| 2 | Max merge throttle time per shard | | 21.5109 | min |
| 2 | Total refresh time | | 1.67245 | min |
| 2 | Min refresh time per shard | | 1.67245 | min |
| 2 | Median refresh time per shard | | 1.67245 | min |
| 2 | Max refresh time per shard | | 1.67245 | min |
| 2 | Total flush time | | 1.70925 | min |
| 2 | Min flush time per shard | | 1.70925 | min |
| 2 | Median flush time per shard | | 1.70925 | min |
| 2 | Max flush time per shard | | 1.70925 | min |
| 2 | Median CPU usage | | 538.6 | % |
| 2 | Total Young Gen GC | | 146.202 | s |
| 2 | Total Old Gen GC | | 15.757 | s |
| 2 | Store size | | 7.17149 | GB |
| 2 | Translog size | | 0.571325 | GB |
| 2 | Totally written | | 100.283 | GB |
| 2 | Heap used for segments | | 83.014 | MB |
| 2 | Heap used for doc values | | 0.00428009 | MB |
| 2 | Heap used for terms | | 76.9826 | MB |
| 2 | Heap used for norms | | 0 | MB |
| 2 | Heap used for points | | 1.1714 | MB |
| 2 | Heap used for stored fields | | 4.85577 | MB |
| 2 | Segment count | | 66 | |
| 2 | Min Throughput | process-grok | 143101 | docs/s |
| 2 | Median Throughput | process-grok | 145416 | docs/s |
| 2 | Max Throughput | process-grok | 148995 | docs/s |
| 2 | 50th percentile latency | process-grok | 240.595 | ms |
| 2 | 90th percentile latency | process-grok | 334.752 | ms |
| 2 | 99th percentile latency | process-grok | 732.404 | ms |
| 2 | 99.9th percentile latency | process-grok | 993.322 | ms |
| 2 | 99.99th percentile latency | process-grok | 1109.24 | ms |
| 2 | 100th percentile latency | process-grok | 1173.46 | ms |
| 2 | 50th percentile service time | process-grok | 240.595 | ms |
| 2 | 90th percentile service time | process-grok | 334.752 | ms |
| 2 | 99th percentile service time | process-grok | 732.404 | ms |
| 2 | 99.9th percentile service time | process-grok | 993.322 | ms |
| 2 | 99.99th percentile service time | process-grok | 1109.24 | ms |
| 2 | 100th percentile service time | process-grok | 1173.46 | ms |
| 2 | error rate | process-grok | 0.02 | % |
[INFO] Lap time 00:28:59 (ETA: 00:29:24)
Lap [3/3]
*********
Running create-grok-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-grok [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 3 | Total indexing time | | 100.008 | min |
| 3 | Min indexing time per shard | | 100.008 | min |
| 3 | Median indexing time per shard | | 100.008 | min |
| 3 | Max indexing time per shard | | 100.008 | min |
| 3 | Total merge time | | 34.8152 | min |
| 3 | Min merge time per shard | | 34.8152 | min |
| 3 | Median merge time per shard | | 34.8152 | min |
| 3 | Max merge time per shard | | 34.8152 | min |
| 3 | Total merge throttle time | | 26.0437 | min |
| 3 | Min merge throttle time per shard | | 26.0437 | min |
| 3 | Median merge throttle time per shard | | 26.0437 | min |
| 3 | Max merge throttle time per shard | | 26.0437 | min |
| 3 | Total refresh time | | 1.69862 | min |
| 3 | Min refresh time per shard | | 1.69862 | min |
| 3 | Median refresh time per shard | | 1.69862 | min |
| 3 | Max refresh time per shard | | 1.69862 | min |
| 3 | Total flush time | | 1.65 | min |
| 3 | Min flush time per shard | | 1.65 | min |
| 3 | Median flush time per shard | | 1.65 | min |
| 3 | Max flush time per shard | | 1.65 | min |
| 3 | Median CPU usage | | 535.7 | % |
| 3 | Total Young Gen GC | | 147.002 | s |
| 3 | Total Old Gen GC | | 16.031 | s |
| 3 | Store size | | 6.14259 | GB |
| 3 | Translog size | | 0.53333 | GB |
| 3 | Totally written | | 100.296 | GB |
| 3 | Heap used for segments | | 83.8954 | MB |
| 3 | Heap used for doc values | | 0.00552368 | MB |
| 3 | Heap used for terms | | 77.8633 | MB |
| 3 | Heap used for norms | | 0 | MB |
| 3 | Heap used for points | | 1.17292 | MB |
| 3 | Heap used for stored fields | | 4.85363 | MB |
| 3 | Segment count | | 66 | |
| 3 | Min Throughput | process-grok | 142101 | docs/s |
| 3 | Median Throughput | process-grok | 144504 | docs/s |
| 3 | Max Throughput | process-grok | 148843 | docs/s |
| 3 | 50th percentile latency | process-grok | 237.548 | ms |
| 3 | 90th percentile latency | process-grok | 341.335 | ms |
| 3 | 99th percentile latency | process-grok | 728.033 | ms |
| 3 | 99.9th percentile latency | process-grok | 996.121 | ms |
| 3 | 99.99th percentile latency | process-grok | 1110.39 | ms |
| 3 | 100th percentile latency | process-grok | 1175.11 | ms |
| 3 | 50th percentile service time | process-grok | 237.548 | ms |
| 3 | 90th percentile service time | process-grok | 341.335 | ms |
| 3 | 99th percentile service time | process-grok | 728.033 | ms |
| 3 | 99.9th percentile service time | process-grok | 996.121 | ms |
| 3 | 99.99th percentile service time | process-grok | 1110.39 | ms |
| 3 | 100th percentile service time | process-grok | 1175.11 | ms |
| 3 | error rate | process-grok | 0.02 | % |
[INFO] Lap time 00:29:10
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| All | Total indexing time | | 302.687 | min |
| All | Min indexing time per shard | | 100.008 | min |
| All | Median indexing time per shard | | 100.978 | min |
| All | Max indexing time per shard | | 101.7 | min |
| All | Total merge time | | 98.8698 | min |
| All | Min merge time per shard | | 30.0465 | min |
| All | Median merge time per shard | | 34.008 | min |
| All | Max merge time per shard | | 34.8152 | min |
| All | Total merge throttle time | | 73.0609 | min |
| All | Min merge throttle time per shard | | 21.5109 | min |
| All | Median merge throttle time per shard | | 25.5063 | min |
| All | Max merge throttle time per shard | | 26.0437 | min |
| All | Total refresh time | | 5.096 | min |
| All | Min refresh time per shard | | 1.67245 | min |
| All | Median refresh time per shard | | 1.69862 | min |
| All | Max refresh time per shard | | 1.72493 | min |
| All | Total flush time | | 5.13262 | min |
| All | Min flush time per shard | | 1.65 | min |
| All | Median flush time per shard | | 1.70925 | min |
| All | Max flush time per shard | | 1.77337 | min |
| All | Median CPU usage | | 540.6 | % |
| All | Total Young Gen GC | | 436.151 | s |
| All | Total Old Gen GC | | 47.503 | s |
| All | Store size | | 6.72019 | GB |
| All | Translog size | | 0.571325 | GB |
| All | Index size | | 5.79583 | GB |
| All | Totally written | | 300.762 | GB |
| All | Heap used for segments | | 83.014 | MB |
| All | Heap used for doc values | | 0.00473404 | MB |
| All | Heap used for terms | | 76.9826 | MB |
| All | Heap used for norms | | 0 | MB |
| All | Heap used for points | | 1.1714 | MB |
| All | Heap used for stored fields | | 4.85363 | MB |
| All | Segment count | | 66 | |
| All | Min Throughput | process-grok | 137543 | docs/s |
| All | Median Throughput | process-grok | 145398 | docs/s |
| All | Max Throughput | process-grok | 148995 | docs/s |
| All | 50th percentile latency | process-grok | 237.027 | ms |
| All | 90th percentile latency | process-grok | 335.169 | ms |
| All | 99th percentile latency | process-grok | 728.001 | ms |
| All | 99.9th percentile latency | process-grok | 996.738 | ms |
| All | 99.99th percentile latency | process-grok | 1114.6 | ms |
| All | 100th percentile latency | process-grok | 1187.51 | ms |
| All | 50th percentile service time | process-grok | 237.027 | ms |
| All | 90th percentile service time | process-grok | 335.169 | ms |
| All | 99th percentile service time | process-grok | 728.001 | ms |
| All | 99.9th percentile service time | process-grok | 996.738 | ms |
| All | 99.99th percentile service time | process-grok | 1114.6 | ms |
| All | 100th percentile service time | process-grok | 1187.51 | ms |
| All | error rate | process-grok | 0.02 | % |
----------------------------------
[INFO] SUCCESS (took 5286 seconds)
----------------------------------
-bash: --report-file=~/grok3.out: No such file or directory
____ ____
/ __ \____ _/ / /_ __
/ /_/ / __ `/ / / / / /
/ _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
/____/
[INFO] Preparing for race ...
[INFO] Racing on track [http_logs_for_ingest], challenge [dissect] and car ['defaults'] with version [7.0.0-alpha1].
Lap [1/3]
*********
Running create-dissect-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-dissect [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|----------------:|-----------:|-------:|
| 1 | Total indexing time | | 109.617 | min |
| 1 | Min indexing time per shard | | 109.617 | min |
| 1 | Median indexing time per shard | | 109.617 | min |
| 1 | Max indexing time per shard | | 109.617 | min |
| 1 | Total merge time | | 30.2687 | min |
| 1 | Min merge time per shard | | 30.2687 | min |
| 1 | Median merge time per shard | | 30.2687 | min |
| 1 | Max merge time per shard | | 30.2687 | min |
| 1 | Total merge throttle time | | 21.8448 | min |
| 1 | Min merge throttle time per shard | | 21.8448 | min |
| 1 | Median merge throttle time per shard | | 21.8448 | min |
| 1 | Max merge throttle time per shard | | 21.8448 | min |
| 1 | Total refresh time | | 1.43342 | min |
| 1 | Min refresh time per shard | | 1.43342 | min |
| 1 | Median refresh time per shard | | 1.43342 | min |
| 1 | Max refresh time per shard | | 1.43342 | min |
| 1 | Total flush time | | 1.63853 | min |
| 1 | Min flush time per shard | | 1.63853 | min |
| 1 | Median flush time per shard | | 1.63853 | min |
| 1 | Max flush time per shard | | 1.63853 | min |
| 1 | Median CPU usage | | 491.6 | % |
| 1 | Total Young Gen GC | | 135.613 | s |
| 1 | Total Old Gen GC | | 14.409 | s |
| 1 | Store size | | 6.26868 | GB |
| 1 | Translog size | | 0.546475 | GB |
| 1 | Totally written | | 100.717 | GB |
| 1 | Heap used for segments | | 84.0237 | MB |
| 1 | Heap used for doc values | | 0.00460434 | MB |
| 1 | Heap used for terms | | 78.0324 | MB |
| 1 | Heap used for norms | | 0 | MB |
| 1 | Heap used for points | | 1.16874 | MB |
| 1 | Heap used for stored fields | | 4.81795 | MB |
| 1 | Segment count | | 71 | |
| 1 | Min Throughput | process-dissect | 156754 | docs/s |
| 1 | Median Throughput | process-dissect | 164198 | docs/s |
| 1 | Max Throughput | process-dissect | 165058 | docs/s |
| 1 | 50th percentile latency | process-dissect | 206.168 | ms |
| 1 | 90th percentile latency | process-dissect | 303.645 | ms |
| 1 | 99th percentile latency | process-dissect | 681.093 | ms |
| 1 | 99.9th percentile latency | process-dissect | 884.353 | ms |
| 1 | 99.99th percentile latency | process-dissect | 984.114 | ms |
| 1 | 100th percentile latency | process-dissect | 1073.05 | ms |
| 1 | 50th percentile service time | process-dissect | 206.168 | ms |
| 1 | 90th percentile service time | process-dissect | 303.645 | ms |
| 1 | 99th percentile service time | process-dissect | 681.093 | ms |
| 1 | 99.9th percentile service time | process-dissect | 884.353 | ms |
| 1 | 99.99th percentile service time | process-dissect | 984.114 | ms |
| 1 | 100th percentile service time | process-dissect | 1073.05 | ms |
| 1 | error rate | process-dissect | 0.02 | % |
[INFO] Lap time 00:26:59 (ETA: 00:53:59)
Lap [2/3]
*********
Running create-dissect-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-dissect [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|----------------:|-----------:|-------:|
| 2 | Total indexing time | | 112.344 | min |
| 2 | Min indexing time per shard | | 112.344 | min |
| 2 | Median indexing time per shard | | 112.344 | min |
| 2 | Max indexing time per shard | | 112.344 | min |
| 2 | Total merge time | | 28.2551 | min |
| 2 | Min merge time per shard | | 28.2551 | min |
| 2 | Median merge time per shard | | 28.2551 | min |
| 2 | Max merge time per shard | | 28.2551 | min |
| 2 | Total merge throttle time | | 19.8671 | min |
| 2 | Min merge throttle time per shard | | 19.8671 | min |
| 2 | Median merge throttle time per shard | | 19.8671 | min |
| 2 | Max merge throttle time per shard | | 19.8671 | min |
| 2 | Total refresh time | | 1.4255 | min |
| 2 | Min refresh time per shard | | 1.4255 | min |
| 2 | Median refresh time per shard | | 1.4255 | min |
| 2 | Max refresh time per shard | | 1.4255 | min |
| 2 | Total flush time | | 1.62643 | min |
| 2 | Min flush time per shard | | 1.62643 | min |
| 2 | Median flush time per shard | | 1.62643 | min |
| 2 | Max flush time per shard | | 1.62643 | min |
| 2 | Median CPU usage | | 486.8 | % |
| 2 | Total Young Gen GC | | 142.122 | s |
| 2 | Total Old Gen GC | | 15.686 | s |
| 2 | Store size | | 8.40493 | GB |
| 2 | Translog size | | 0.511943 | GB |
| 2 | Totally written | | 102.743 | GB |
| 2 | Heap used for segments | | 89.2447 | MB |
| 2 | Heap used for doc values | | 0.00453949 | MB |
| 2 | Heap used for terms | | 83.227 | MB |
| 2 | Heap used for norms | | 0 | MB |
| 2 | Heap used for points | | 1.17415 | MB |
| 2 | Heap used for stored fields | | 4.839 | MB |
| 2 | Segment count | | 70 | |
| 2 | Min Throughput | process-dissect | 158233 | docs/s |
| 2 | Median Throughput | process-dissect | 161719 | docs/s |
| 2 | Max Throughput | process-dissect | 166715 | docs/s |
| 2 | 50th percentile latency | process-dissect | 218.93 | ms |
| 2 | 90th percentile latency | process-dissect | 317.391 | ms |
| 2 | 99th percentile latency | process-dissect | 690.22 | ms |
| 2 | 99.9th percentile latency | process-dissect | 912.733 | ms |
| 2 | 99.99th percentile latency | process-dissect | 1030.11 | ms |
| 2 | 100th percentile latency | process-dissect | 1117.64 | ms |
| 2 | 50th percentile service time | process-dissect | 218.93 | ms |
| 2 | 90th percentile service time | process-dissect | 317.391 | ms |
| 2 | 99th percentile service time | process-dissect | 690.22 | ms |
| 2 | 99.9th percentile service time | process-dissect | 912.733 | ms |
| 2 | 99.99th percentile service time | process-dissect | 1030.11 | ms |
| 2 | 100th percentile service time | process-dissect | 1117.64 | ms |
| 2 | error rate | process-dissect | 0.02 | % |
[INFO] Lap time 00:26:34 (ETA: 00:26:47)
Lap [3/3]
*********
Running create-dissect-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-dissect [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|----------------:|-----------:|-------:|
| 3 | Total indexing time | | 107.676 | min |
| 3 | Min indexing time per shard | | 107.676 | min |
| 3 | Median indexing time per shard | | 107.676 | min |
| 3 | Max indexing time per shard | | 107.676 | min |
| 3 | Total merge time | | 29.6779 | min |
| 3 | Min merge time per shard | | 29.6779 | min |
| 3 | Median merge time per shard | | 29.6779 | min |
| 3 | Max merge time per shard | | 29.6779 | min |
| 3 | Total merge throttle time | | 21.6075 | min |
| 3 | Min merge throttle time per shard | | 21.6075 | min |
| 3 | Median merge throttle time per shard | | 21.6075 | min |
| 3 | Max merge throttle time per shard | | 21.6075 | min |
| 3 | Total refresh time | | 1.51032 | min |
| 3 | Min refresh time per shard | | 1.51032 | min |
| 3 | Median refresh time per shard | | 1.51032 | min |
| 3 | Max refresh time per shard | | 1.51032 | min |
| 3 | Total flush time | | 1.44565 | min |
| 3 | Min flush time per shard | | 1.44565 | min |
| 3 | Median flush time per shard | | 1.44565 | min |
| 3 | Max flush time per shard | | 1.44565 | min |
| 3 | Median CPU usage | | 483.6 | % |
| 3 | Total Young Gen GC | | 139.878 | s |
| 3 | Total Old Gen GC | | 15.145 | s |
| 3 | Store size | | 7.88624 | GB |
| 3 | Translog size | | 0.599201 | GB |
| 3 | Totally written | | 102.067 | GB |
| 3 | Heap used for segments | | 89.0315 | MB |
| 3 | Heap used for doc values | | 0.00499344 | MB |
| 3 | Heap used for terms | | 83.0199 | MB |
| 3 | Heap used for norms | | 0 | MB |
| 3 | Heap used for points | | 1.17181 | MB |
| 3 | Heap used for stored fields | | 4.83474 | MB |
| 3 | Segment count | | 77 | |
| 3 | Min Throughput | process-dissect | 157658 | docs/s |
| 3 | Median Throughput | process-dissect | 161221 | docs/s |
| 3 | Max Throughput | process-dissect | 167015 | docs/s |
| 3 | 50th percentile latency | process-dissect | 210.072 | ms |
| 3 | 90th percentile latency | process-dissect | 314.303 | ms |
| 3 | 99th percentile latency | process-dissect | 677.233 | ms |
| 3 | 99.9th percentile latency | process-dissect | 893.662 | ms |
| 3 | 99.99th percentile latency | process-dissect | 1020.63 | ms |
| 3 | 100th percentile latency | process-dissect | 1034.35 | ms |
| 3 | 50th percentile service time | process-dissect | 210.072 | ms |
| 3 | 90th percentile service time | process-dissect | 314.303 | ms |
| 3 | 99th percentile service time | process-dissect | 677.233 | ms |
| 3 | 99.9th percentile service time | process-dissect | 893.662 | ms |
| 3 | 99.99th percentile service time | process-dissect | 1020.63 | ms |
| 3 | 100th percentile service time | process-dissect | 1034.35 | ms |
| 3 | error rate | process-dissect | 0.02 | % |
[INFO] Lap time 00:26:09
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|----------------:|-----------:|-------:|
| All | Total indexing time | | 329.636 | min |
| All | Min indexing time per shard | | 107.676 | min |
| All | Median indexing time per shard | | 109.617 | min |
| All | Max indexing time per shard | | 112.344 | min |
| All | Total merge time | | 88.2017 | min |
| All | Min merge time per shard | | 28.2551 | min |
| All | Median merge time per shard | | 29.6779 | min |
| All | Max merge time per shard | | 30.2687 | min |
| All | Total merge throttle time | | 63.3194 | min |
| All | Min merge throttle time per shard | | 19.8671 | min |
| All | Median merge throttle time per shard | | 21.6075 | min |
| All | Max merge throttle time per shard | | 21.8448 | min |
| All | Total refresh time | | 4.36923 | min |
| All | Min refresh time per shard | | 1.4255 | min |
| All | Median refresh time per shard | | 1.43342 | min |
| All | Max refresh time per shard | | 1.51032 | min |
| All | Total flush time | | 4.71062 | min |
| All | Min flush time per shard | | 1.44565 | min |
| All | Median flush time per shard | | 1.62643 | min |
| All | Max flush time per shard | | 1.63853 | min |
| All | Median CPU usage | | 486.8 | % |
| All | Total Young Gen GC | | 417.613 | s |
| All | Total Old Gen GC | | 45.24 | s |
| All | Store size | | 7.88624 | GB |
| All | Translog size | | 0.546475 | GB |
| All | Index size | | 5.8333 | GB |
| All | Totally written | | 305.527 | GB |
| All | Heap used for segments | | 89.0315 | MB |
| All | Heap used for doc values | | 0.00460434 | MB |
| All | Heap used for terms | | 83.0199 | MB |
| All | Heap used for norms | | 0 | MB |
| All | Heap used for points | | 1.17181 | MB |
| All | Heap used for stored fields | | 4.83474 | MB |
| All | Segment count | | 71 | |
| All | Min Throughput | process-dissect | 156754 | docs/s |
| All | Median Throughput | process-dissect | 162094 | docs/s |
| All | Max Throughput | process-dissect | 167015 | docs/s |
| All | 50th percentile latency | process-dissect | 211.24 | ms |
| All | 90th percentile latency | process-dissect | 311.952 | ms |
| All | 99th percentile latency | process-dissect | 682.463 | ms |
| All | 99.9th percentile latency | process-dissect | 895.362 | ms |
| All | 99.99th percentile latency | process-dissect | 1016.04 | ms |
| All | 100th percentile latency | process-dissect | 1117.64 | ms |
| All | 50th percentile service time | process-dissect | 211.24 | ms |
| All | 90th percentile service time | process-dissect | 311.952 | ms |
| All | 99th percentile service time | process-dissect | 682.463 | ms |
| All | 99.9th percentile service time | process-dissect | 895.362 | ms |
| All | 99.99th percentile service time | process-dissect | 1016.04 | ms |
| All | 100th percentile service time | process-dissect | 1117.64 | ms |
| All | error rate | process-dissect | 0.02 | % |
----------------------------------
[INFO] SUCCESS (took 4791 seconds)
----------------------------------
-bash: --report-file=~/dissect3.out: No such file or directory
____ ____
/ __ \____ _/ / /_ __
/ /_/ / __ `/ / / / / /
/ _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
/____/
[INFO] Preparing for race ...
[INFO] Racing on track [http_logs_for_ingest], challenge [baseline] and car ['defaults'] with version [7.0.0-alpha1].
Lap [1/4]
*********
Running create-noop-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-noop [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 1 | Total indexing time | | 81.9395 | min |
| 1 | Min indexing time per shard | | 81.9395 | min |
| 1 | Median indexing time per shard | | 81.9395 | min |
| 1 | Max indexing time per shard | | 81.9395 | min |
| 1 | Total merge time | | 28.2016 | min |
| 1 | Min merge time per shard | | 28.2016 | min |
| 1 | Median merge time per shard | | 28.2016 | min |
| 1 | Max merge time per shard | | 28.2016 | min |
| 1 | Total merge throttle time | | 20.3665 | min |
| 1 | Min merge throttle time per shard | | 20.3665 | min |
| 1 | Median merge throttle time per shard | | 20.3665 | min |
| 1 | Max merge throttle time per shard | | 20.3665 | min |
| 1 | Total refresh time | | 1.107 | min |
| 1 | Min refresh time per shard | | 1.107 | min |
| 1 | Median refresh time per shard | | 1.107 | min |
| 1 | Max refresh time per shard | | 1.107 | min |
| 1 | Total flush time | | 1.59975 | min |
| 1 | Min flush time per shard | | 1.59975 | min |
| 1 | Median flush time per shard | | 1.59975 | min |
| 1 | Max flush time per shard | | 1.59975 | min |
| 1 | Median CPU usage | | 482.6 | % |
| 1 | Total Young Gen GC | | 100.524 | s |
| 1 | Total Old Gen GC | | 9.053 | s |
| 1 | Store size | | 6.37713 | GB |
| 1 | Translog size | | 0.554704 | GB |
| 1 | Totally written | | 68.31 | GB |
| 1 | Heap used for segments | | 93.1017 | MB |
| 1 | Heap used for doc values | | 0.00402069 | MB |
| 1 | Heap used for terms | | 87.1576 | MB |
| 1 | Heap used for norms | | 0 | MB |
| 1 | Heap used for points | | 1.1718 | MB |
| 1 | Heap used for stored fields | | 4.76826 | MB |
| 1 | Segment count | | 62 | |
| 1 | Min Throughput | process-noop | 185723 | docs/s |
| 1 | Median Throughput | process-noop | 194836 | docs/s |
| 1 | Max Throughput | process-noop | 195707 | docs/s |
| 1 | 50th percentile latency | process-noop | 172.732 | ms |
| 1 | 90th percentile latency | process-noop | 240.672 | ms |
| 1 | 99th percentile latency | process-noop | 646.109 | ms |
| 1 | 99.9th percentile latency | process-noop | 850.277 | ms |
| 1 | 99.99th percentile latency | process-noop | 986.115 | ms |
| 1 | 100th percentile latency | process-noop | 1037.54 | ms |
| 1 | 50th percentile service time | process-noop | 172.732 | ms |
| 1 | 90th percentile service time | process-noop | 240.672 | ms |
| 1 | 99th percentile service time | process-noop | 646.109 | ms |
| 1 | 99.9th percentile service time | process-noop | 850.277 | ms |
| 1 | 99.99th percentile service time | process-noop | 986.115 | ms |
| 1 | 100th percentile service time | process-noop | 1037.54 | ms |
| 1 | error rate | process-noop | 0.02 | % |
[INFO] Lap time 00:22:45 (ETA: 01:08:15)
Lap [2/4]
*********
Running create-noop-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-noop [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 2 | Total indexing time | | 80.3659 | min |
| 2 | Min indexing time per shard | | 80.3659 | min |
| 2 | Median indexing time per shard | | 80.3659 | min |
| 2 | Max indexing time per shard | | 80.3659 | min |
| 2 | Total merge time | | 28.9801 | min |
| 2 | Min merge time per shard | | 28.9801 | min |
| 2 | Median merge time per shard | | 28.9801 | min |
| 2 | Max merge time per shard | | 28.9801 | min |
| 2 | Total merge throttle time | | 20.9226 | min |
| 2 | Min merge throttle time per shard | | 20.9226 | min |
| 2 | Median merge throttle time per shard | | 20.9226 | min |
| 2 | Max merge throttle time per shard | | 20.9226 | min |
| 2 | Total refresh time | | 1.09745 | min |
| 2 | Min refresh time per shard | | 1.09745 | min |
| 2 | Median refresh time per shard | | 1.09745 | min |
| 2 | Max refresh time per shard | | 1.09745 | min |
| 2 | Total flush time | | 1.59065 | min |
| 2 | Min flush time per shard | | 1.59065 | min |
| 2 | Median flush time per shard | | 1.59065 | min |
| 2 | Max flush time per shard | | 1.59065 | min |
| 2 | Median CPU usage | | 474.3 | % |
| 2 | Total Young Gen GC | | 102.453 | s |
| 2 | Total Old Gen GC | | 9.087 | s |
| 2 | Store size | | 6.27468 | GB |
| 2 | Translog size | | 0.578113 | GB |
| 2 | Totally written | | 68.6915 | GB |
| 2 | Heap used for segments | | 94.0829 | MB |
| 2 | Heap used for doc values | | 0.00453949 | MB |
| 2 | Heap used for terms | | 88.1545 | MB |
| 2 | Heap used for norms | | 0 | MB |
| 2 | Heap used for points | | 1.16762 | MB |
| 2 | Heap used for stored fields | | 4.7562 | MB |
| 2 | Segment count | | 70 | |
| 2 | Min Throughput | process-noop | 188544 | docs/s |
| 2 | Median Throughput | process-noop | 191318 | docs/s |
| 2 | Max Throughput | process-noop | 197339 | docs/s |
| 2 | 50th percentile latency | process-noop | 176.976 | ms |
| 2 | 90th percentile latency | process-noop | 250.169 | ms |
| 2 | 99th percentile latency | process-noop | 652.467 | ms |
| 2 | 99.9th percentile latency | process-noop | 851.118 | ms |
| 2 | 99.99th percentile latency | process-noop | 952.053 | ms |
| 2 | 100th percentile latency | process-noop | 989.657 | ms |
| 2 | 50th percentile service time | process-noop | 176.976 | ms |
| 2 | 90th percentile service time | process-noop | 250.169 | ms |
| 2 | 99th percentile service time | process-noop | 652.467 | ms |
| 2 | 99.9th percentile service time | process-noop | 851.118 | ms |
| 2 | 99.99th percentile service time | process-noop | 952.053 | ms |
| 2 | 100th percentile service time | process-noop | 989.657 | ms |
| 2 | error rate | process-noop | 0.02 | % |
[INFO] Lap time 00:22:09 (ETA: 00:44:54)
Lap [3/4]
*********
Running create-noop-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-noop [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 3 | Total indexing time | | 80.7857 | min |
| 3 | Min indexing time per shard | | 80.7857 | min |
| 3 | Median indexing time per shard | | 80.7857 | min |
| 3 | Max indexing time per shard | | 80.7857 | min |
| 3 | Total merge time | | 29.1094 | min |
| 3 | Min merge time per shard | | 29.1094 | min |
| 3 | Median merge time per shard | | 29.1094 | min |
| 3 | Max merge time per shard | | 29.1094 | min |
| 3 | Total merge throttle time | | 21.1343 | min |
| 3 | Min merge throttle time per shard | | 21.1343 | min |
| 3 | Median merge throttle time per shard | | 21.1343 | min |
| 3 | Max merge throttle time per shard | | 21.1343 | min |
| 3 | Total refresh time | | 1.17357 | min |
| 3 | Min refresh time per shard | | 1.17357 | min |
| 3 | Median refresh time per shard | | 1.17357 | min |
| 3 | Max refresh time per shard | | 1.17357 | min |
| 3 | Total flush time | | 1.58342 | min |
| 3 | Min flush time per shard | | 1.58342 | min |
| 3 | Median flush time per shard | | 1.58342 | min |
| 3 | Max flush time per shard | | 1.58342 | min |
| 3 | Median CPU usage | | 471.7 | % |
| 3 | Total Young Gen GC | | 105.37 | s |
| 3 | Total Old Gen GC | | 9.286 | s |
| 3 | Store size | | 6.33351 | GB |
| 3 | Translog size | | 0.51492 | GB |
| 3 | Totally written | | 68.8769 | GB |
| 3 | Heap used for segments | | 95.9357 | MB |
| 3 | Heap used for doc values | | 0.00440979 | MB |
| 3 | Heap used for terms | | 89.9647 | MB |
| 3 | Heap used for norms | | 0 | MB |
| 3 | Heap used for points | | 1.17271 | MB |
| 3 | Heap used for stored fields | | 4.79381 | MB |
| 3 | Segment count | | 68 | |
| 3 | Min Throughput | process-noop | 187456 | docs/s |
| 3 | Median Throughput | process-noop | 189398 | docs/s |
| 3 | Max Throughput | process-noop | 197865 | docs/s |
| 3 | 50th percentile latency | process-noop | 175.726 | ms |
| 3 | 90th percentile latency | process-noop | 263.161 | ms |
| 3 | 99th percentile latency | process-noop | 649.914 | ms |
| 3 | 99.9th percentile latency | process-noop | 873.185 | ms |
| 3 | 99.99th percentile latency | process-noop | 978.019 | ms |
| 3 | 100th percentile latency | process-noop | 1040.08 | ms |
| 3 | 50th percentile service time | process-noop | 175.726 | ms |
| 3 | 90th percentile service time | process-noop | 263.161 | ms |
| 3 | 99th percentile service time | process-noop | 649.914 | ms |
| 3 | 99.9th percentile service time | process-noop | 873.185 | ms |
| 3 | 99.99th percentile service time | process-noop | 978.019 | ms |
| 3 | 100th percentile service time | process-noop | 1040.08 | ms |
| 3 | error rate | process-noop | 0.02 | % |
[INFO] Lap time 00:22:25 (ETA: 00:22:26)
Lap [4/4]
*********
Running create-noop-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-noop [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 4 | Total indexing time | | 80.6689 | min |
| 4 | Min indexing time per shard | | 80.6689 | min |
| 4 | Median indexing time per shard | | 80.6689 | min |
| 4 | Max indexing time per shard | | 80.6689 | min |
| 4 | Total merge time | | 27.6918 | min |
| 4 | Min merge time per shard | | 27.6918 | min |
| 4 | Median merge time per shard | | 27.6918 | min |
| 4 | Max merge time per shard | | 27.6918 | min |
| 4 | Total merge throttle time | | 19.8605 | min |
| 4 | Min merge throttle time per shard | | 19.8605 | min |
| 4 | Median merge throttle time per shard | | 19.8605 | min |
| 4 | Max merge throttle time per shard | | 19.8605 | min |
| 4 | Total refresh time | | 1.12632 | min |
| 4 | Min refresh time per shard | | 1.12632 | min |
| 4 | Median refresh time per shard | | 1.12632 | min |
| 4 | Max refresh time per shard | | 1.12632 | min |
| 4 | Total flush time | | 1.60367 | min |
| 4 | Min flush time per shard | | 1.60367 | min |
| 4 | Median flush time per shard | | 1.60367 | min |
| 4 | Max flush time per shard | | 1.60367 | min |
| 4 | Median CPU usage | | 471.55 | % |
| 4 | Total Young Gen GC | | 105.528 | s |
| 4 | Total Old Gen GC | | 9.008 | s |
| 4 | Store size | | 6.89627 | GB |
| 4 | Translog size | | 0.545143 | GB |
| 4 | Totally written | | 68.1243 | GB |
| 4 | Heap used for segments | | 93.6354 | MB |
| 4 | Heap used for doc values | | 0.00447464 | MB |
| 4 | Heap used for terms | | 87.6861 | MB |
| 4 | Heap used for norms | | 0 | MB |
| 4 | Heap used for points | | 1.16875 | MB |
| 4 | Heap used for stored fields | | 4.77607 | MB |
| 4 | Segment count | | 69 | |
| 4 | Min Throughput | process-noop | 187310 | docs/s |
| 4 | Median Throughput | process-noop | 188367 | docs/s |
| 4 | Max Throughput | process-noop | 196537 | docs/s |
| 4 | 50th percentile latency | process-noop | 174.665 | ms |
| 4 | 90th percentile latency | process-noop | 277.094 | ms |
| 4 | 99th percentile latency | process-noop | 664.76 | ms |
| 4 | 99.9th percentile latency | process-noop | 875.213 | ms |
| 4 | 99.99th percentile latency | process-noop | 1022.08 | ms |
| 4 | 100th percentile latency | process-noop | 1094.86 | ms |
| 4 | 50th percentile service time | process-noop | 174.665 | ms |
| 4 | 90th percentile service time | process-noop | 277.094 | ms |
| 4 | 99th percentile service time | process-noop | 664.76 | ms |
| 4 | 99.9th percentile service time | process-noop | 875.213 | ms |
| 4 | 99.99th percentile service time | process-noop | 1022.08 | ms |
| 4 | 100th percentile service time | process-noop | 1094.86 | ms |
| 4 | error rate | process-noop | 0.02 | % |
[INFO] Lap time 00:22:31
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| All | Total indexing time | | 323.76 | min |
| All | Min indexing time per shard | | 80.3659 | min |
| All | Median indexing time per shard | | 80.7273 | min |
| All | Max indexing time per shard | | 81.9395 | min |
| All | Total merge time | | 113.983 | min |
| All | Min merge time per shard | | 27.6918 | min |
| All | Median merge time per shard | | 28.5909 | min |
| All | Max merge time per shard | | 29.1094 | min |
| All | Total merge throttle time | | 82.2839 | min |
| All | Min merge throttle time per shard | | 19.8605 | min |
| All | Median merge throttle time per shard | | 20.6446 | min |
| All | Max merge throttle time per shard | | 21.1343 | min |
| All | Total refresh time | | 4.50433 | min |
| All | Min refresh time per shard | | 1.09745 | min |
| All | Median refresh time per shard | | 1.11666 | min |
| All | Max refresh time per shard | | 1.17357 | min |
| All | Total flush time | | 6.37748 | min |
| All | Min flush time per shard | | 1.58342 | min |
| All | Median flush time per shard | | 1.5952 | min |
| All | Max flush time per shard | | 1.60367 | min |
| All | Median CPU usage | | 475.2 | % |
| All | Total Young Gen GC | | 413.875 | s |
| All | Total Old Gen GC | | 36.434 | s |
| All | Store size | | 6.35532 | GB |
| All | Translog size | | 0.549923 | GB |
| All | Index size | | 5.82812 | GB |
| All | Totally written | | 274.003 | GB |
| All | Heap used for segments | | 93.8592 | MB |
| All | Heap used for doc values | | 0.00444221 | MB |
| All | Heap used for terms | | 87.9203 | MB |
| All | Heap used for norms | | 0 | MB |
| All | Heap used for points | | 1.17027 | MB |
| All | Heap used for stored fields | | 4.77217 | MB |
| All | Segment count | | 68 | |
| All | Min Throughput | process-noop | 185723 | docs/s |
| All | Median Throughput | process-noop | 190759 | docs/s |
| All | Max Throughput | process-noop | 197865 | docs/s |
| All | 50th percentile latency | process-noop | 174.872 | ms |
| All | 90th percentile latency | process-noop | 258.185 | ms |
| All | 99th percentile latency | process-noop | 653.456 | ms |
| All | 99.9th percentile latency | process-noop | 865.066 | ms |
| All | 99.99th percentile latency | process-noop | 981.193 | ms |
| All | 100th percentile latency | process-noop | 1094.86 | ms |
| All | 50th percentile service time | process-noop | 174.872 | ms |
| All | 90th percentile service time | process-noop | 258.185 | ms |
| All | 99th percentile service time | process-noop | 653.456 | ms |
| All | 99.9th percentile service time | process-noop | 865.066 | ms |
| All | 99.99th percentile service time | process-noop | 981.193 | ms |
| All | 100th percentile service time | process-noop | 1094.86 | ms |
| All | error rate | process-noop | 0.02 | % |
----------------------------------
[INFO] SUCCESS (took 5399 seconds)
----------------------------------
-bash: --report-file=~/baseline4.out: No such file or directory
____ ____
/ __ \____ _/ / /_ __
/ /_/ / __ `/ / / / / /
/ _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
/____/
[INFO] Preparing for race ...
[INFO] Racing on track [http_logs_for_ingest], challenge [grok] and car ['defaults'] with version [7.0.0-alpha1].
Lap [1/4]
*********
Running create-grok-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-grok [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 1 | Total indexing time | | 100.135 | min |
| 1 | Min indexing time per shard | | 100.135 | min |
| 1 | Median indexing time per shard | | 100.135 | min |
| 1 | Max indexing time per shard | | 100.135 | min |
| 1 | Total merge time | | 33.4833 | min |
| 1 | Min merge time per shard | | 33.4833 | min |
| 1 | Median merge time per shard | | 33.4833 | min |
| 1 | Max merge time per shard | | 33.4833 | min |
| 1 | Total merge throttle time | | 24.1493 | min |
| 1 | Min merge throttle time per shard | | 24.1493 | min |
| 1 | Median merge throttle time per shard | | 24.1493 | min |
| 1 | Max merge throttle time per shard | | 24.1493 | min |
| 1 | Total refresh time | | 1.76217 | min |
| 1 | Min refresh time per shard | | 1.76217 | min |
| 1 | Median refresh time per shard | | 1.76217 | min |
| 1 | Max refresh time per shard | | 1.76217 | min |
| 1 | Total flush time | | 1.79493 | min |
| 1 | Min flush time per shard | | 1.79493 | min |
| 1 | Median flush time per shard | | 1.79493 | min |
| 1 | Max flush time per shard | | 1.79493 | min |
| 1 | Median CPU usage | | 543.6 | % |
| 1 | Total Young Gen GC | | 143.918 | s |
| 1 | Total Old Gen GC | | 15.994 | s |
| 1 | Store size | | 5.58727 | GB |
| 1 | Translog size | | 0.589153 | GB |
| 1 | Totally written | | 99.5926 | GB |
| 1 | Heap used for segments | | 82.2753 | MB |
| 1 | Heap used for doc values | | 0.00367737 | MB |
| 1 | Heap used for terms | | 76.258 | MB |
| 1 | Heap used for norms | | 0 | MB |
| 1 | Heap used for points | | 1.16571 | MB |
| 1 | Heap used for stored fields | | 4.84791 | MB |
| 1 | Segment count | | 56 | |
| 1 | Min Throughput | process-grok | 140433 | docs/s |
| 1 | Median Throughput | process-grok | 149457 | docs/s |
| 1 | Max Throughput | process-grok | 150128 | docs/s |
| 1 | 50th percentile latency | process-grok | 229.821 | ms |
| 1 | 90th percentile latency | process-grok | 325.7 | ms |
| 1 | 99th percentile latency | process-grok | 708.828 | ms |
| 1 | 99.9th percentile latency | process-grok | 966.974 | ms |
| 1 | 99.99th percentile latency | process-grok | 1072.04 | ms |
| 1 | 100th percentile latency | process-grok | 1193.74 | ms |
| 1 | 50th percentile service time | process-grok | 229.821 | ms |
| 1 | 90th percentile service time | process-grok | 325.7 | ms |
| 1 | 99th percentile service time | process-grok | 708.828 | ms |
| 1 | 99.9th percentile service time | process-grok | 966.974 | ms |
| 1 | 99.99th percentile service time | process-grok | 1072.04 | ms |
| 1 | 100th percentile service time | process-grok | 1193.74 | ms |
| 1 | error rate | process-grok | 0.02 | % |
[INFO] Lap time 00:29:10 (ETA: 01:27:31)
Lap [2/4]
*********
Running create-grok-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-grok [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 2 | Total indexing time | | 101.595 | min |
| 2 | Min indexing time per shard | | 101.595 | min |
| 2 | Median indexing time per shard | | 101.595 | min |
| 2 | Max indexing time per shard | | 101.595 | min |
| 2 | Total merge time | | 30.9372 | min |
| 2 | Min merge time per shard | | 30.9372 | min |
| 2 | Median merge time per shard | | 30.9372 | min |
| 2 | Max merge time per shard | | 30.9372 | min |
| 2 | Total merge throttle time | | 21.9352 | min |
| 2 | Min merge throttle time per shard | | 21.9352 | min |
| 2 | Median merge throttle time per shard | | 21.9352 | min |
| 2 | Max merge throttle time per shard | | 21.9352 | min |
| 2 | Total refresh time | | 1.70098 | min |
| 2 | Min refresh time per shard | | 1.70098 | min |
| 2 | Median refresh time per shard | | 1.70098 | min |
| 2 | Max refresh time per shard | | 1.70098 | min |
| 2 | Total flush time | | 1.78233 | min |
| 2 | Min flush time per shard | | 1.78233 | min |
| 2 | Median flush time per shard | | 1.78233 | min |
| 2 | Max flush time per shard | | 1.78233 | min |
| 2 | Median CPU usage | | 534.6 | % |
| 2 | Total Young Gen GC | | 148.113 | s |
| 2 | Total Old Gen GC | | 16.161 | s |
| 2 | Store size | | 8.01378 | GB |
| 2 | Translog size | | 0.502678 | GB |
| 2 | Totally written | | 101.71 | GB |
| 2 | Heap used for segments | | 83.7847 | MB |
| 2 | Heap used for doc values | | 0.00363159 | MB |
| 2 | Heap used for terms | | 77.7387 | MB |
| 2 | Heap used for norms | | 0 | MB |
| 2 | Heap used for points | | 1.1715 | MB |
| 2 | Heap used for stored fields | | 4.87086 | MB |
| 2 | Segment count | | 56 | |
| 2 | Min Throughput | process-grok | 144096 | docs/s |
| 2 | Median Throughput | process-grok | 147215 | docs/s |
| 2 | Max Throughput | process-grok | 150086 | docs/s |
| 2 | 50th percentile latency | process-grok | 239.618 | ms |
| 2 | 90th percentile latency | process-grok | 337.643 | ms |
| 2 | 99th percentile latency | process-grok | 719.817 | ms |
| 2 | 99.9th percentile latency | process-grok | 994.942 | ms |
| 2 | 99.99th percentile latency | process-grok | 1133.27 | ms |
| 2 | 100th percentile latency | process-grok | 1314.32 | ms |
| 2 | 50th percentile service time | process-grok | 239.618 | ms |
| 2 | 90th percentile service time | process-grok | 337.643 | ms |
| 2 | 99th percentile service time | process-grok | 719.817 | ms |
| 2 | 99.9th percentile service time | process-grok | 994.942 | ms |
| 2 | 99.99th percentile service time | process-grok | 1133.27 | ms |
| 2 | 100th percentile service time | process-grok | 1314.32 | ms |
| 2 | error rate | process-grok | 0.02 | % |
[INFO] Lap time 00:28:54 (ETA: 00:58:05)
Lap [3/4]
*********
Running create-grok-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-grok [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 3 | Total indexing time | | 100.665 | min |
| 3 | Min indexing time per shard | | 100.665 | min |
| 3 | Median indexing time per shard | | 100.665 | min |
| 3 | Max indexing time per shard | | 100.665 | min |
| 3 | Total merge time | | 29.5158 | min |
| 3 | Min merge time per shard | | 29.5158 | min |
| 3 | Median merge time per shard | | 29.5158 | min |
| 3 | Max merge time per shard | | 29.5158 | min |
| 3 | Total merge throttle time | | 20.7029 | min |
| 3 | Min merge throttle time per shard | | 20.7029 | min |
| 3 | Median merge throttle time per shard | | 20.7029 | min |
| 3 | Max merge throttle time per shard | | 20.7029 | min |
| 3 | Total refresh time | | 1.7233 | min |
| 3 | Min refresh time per shard | | 1.7233 | min |
| 3 | Median refresh time per shard | | 1.7233 | min |
| 3 | Max refresh time per shard | | 1.7233 | min |
| 3 | Total flush time | | 1.7657 | min |
| 3 | Min flush time per shard | | 1.7657 | min |
| 3 | Median flush time per shard | | 1.7657 | min |
| 3 | Max flush time per shard | | 1.7657 | min |
| 3 | Median CPU usage | | 532.6 | % |
| 3 | Total Young Gen GC | | 149.161 | s |
| 3 | Total Old Gen GC | | 16.166 | s |
| 3 | Store size | | 8.1647 | GB |
| 3 | Translog size | | 0.512087 | GB |
| 3 | Totally written | | 101.124 | GB |
| 3 | Heap used for segments | | 83.7776 | MB |
| 3 | Heap used for doc values | | 0.00434494 | MB |
| 3 | Heap used for terms | | 77.739 | MB |
| 3 | Heap used for norms | | 0 | MB |
| 3 | Heap used for points | | 1.17091 | MB |
| 3 | Heap used for stored fields | | 4.86327 | MB |
| 3 | Segment count | | 67 | |
| 3 | Min Throughput | process-grok | 144502 | docs/s |
| 3 | Median Throughput | process-grok | 146607 | docs/s |
| 3 | Max Throughput | process-grok | 151666 | docs/s |
| 3 | 50th percentile latency | process-grok | 236.737 | ms |
| 3 | 90th percentile latency | process-grok | 342.454 | ms |
| 3 | 99th percentile latency | process-grok | 732.641 | ms |
| 3 | 99.9th percentile latency | process-grok | 978.982 | ms |
| 3 | 99.99th percentile latency | process-grok | 1084.16 | ms |
| 3 | 100th percentile latency | process-grok | 1151.44 | ms |
| 3 | 50th percentile service time | process-grok | 236.737 | ms |
| 3 | 90th percentile service time | process-grok | 342.454 | ms |
| 3 | 99th percentile service time | process-grok | 732.641 | ms |
| 3 | 99.9th percentile service time | process-grok | 978.982 | ms |
| 3 | 99.99th percentile service time | process-grok | 1084.16 | ms |
| 3 | 100th percentile service time | process-grok | 1151.44 | ms |
| 3 | error rate | process-grok | 0.02 | % |
[INFO] Lap time 00:29:01 (ETA: 00:29:02)
Lap [4/4]
*********
Running create-grok-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-grok [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| 4 | Total indexing time | | 98.7986 | min |
| 4 | Min indexing time per shard | | 98.7986 | min |
| 4 | Median indexing time per shard | | 98.7986 | min |
| 4 | Max indexing time per shard | | 98.7986 | min |
| 4 | Total merge time | | 30.5286 | min |
| 4 | Min merge time per shard | | 30.5286 | min |
| 4 | Median merge time per shard | | 30.5286 | min |
| 4 | Max merge time per shard | | 30.5286 | min |
| 4 | Total merge throttle time | | 21.3185 | min |
| 4 | Min merge throttle time per shard | | 21.3185 | min |
| 4 | Median merge throttle time per shard | | 21.3185 | min |
| 4 | Max merge throttle time per shard | | 21.3185 | min |
| 4 | Total refresh time | | 1.7008 | min |
| 4 | Min refresh time per shard | | 1.7008 | min |
| 4 | Median refresh time per shard | | 1.7008 | min |
| 4 | Max refresh time per shard | | 1.7008 | min |
| 4 | Total flush time | | 1.85307 | min |
| 4 | Min flush time per shard | | 1.85307 | min |
| 4 | Median flush time per shard | | 1.85307 | min |
| 4 | Max flush time per shard | | 1.85307 | min |
| 4 | Median CPU usage | | 529.9 | % |
| 4 | Total Young Gen GC | | 147.656 | s |
| 4 | Total Old Gen GC | | 15.568 | s |
| 4 | Store size | | 6.48226 | GB |
| 4 | Translog size | | 0.508095 | GB |
| 4 | Totally written | | 100.329 | GB |
| 4 | Heap used for segments | | 81.2709 | MB |
| 4 | Heap used for doc values | | 0.00350189 | MB |
| 4 | Heap used for terms | | 75.2252 | MB |
| 4 | Heap used for norms | | 0 | MB |
| 4 | Heap used for points | | 1.17022 | MB |
| 4 | Heap used for stored fields | | 4.87205 | MB |
| 4 | Segment count | | 54 | |
| 4 | Min Throughput | process-grok | 145837 | docs/s |
| 4 | Median Throughput | process-grok | 146680 | docs/s |
| 4 | Max Throughput | process-grok | 151740 | docs/s |
| 4 | 50th percentile latency | process-grok | 231.845 | ms |
| 4 | 90th percentile latency | process-grok | 346.117 | ms |
| 4 | 99th percentile latency | process-grok | 715.126 | ms |
| 4 | 99.9th percentile latency | process-grok | 976.391 | ms |
| 4 | 99.99th percentile latency | process-grok | 1105.88 | ms |
| 4 | 100th percentile latency | process-grok | 1218.99 | ms |
| 4 | 50th percentile service time | process-grok | 231.845 | ms |
| 4 | 90th percentile service time | process-grok | 346.117 | ms |
| 4 | 99th percentile service time | process-grok | 715.126 | ms |
| 4 | 99.9th percentile service time | process-grok | 976.391 | ms |
| 4 | 99.99th percentile service time | process-grok | 1105.88 | ms |
| 4 | 100th percentile service time | process-grok | 1218.99 | ms |
| 4 | error rate | process-grok | 0.02 | % |
[INFO] Lap time 00:28:46
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|-------------:|-----------:|-------:|
| All | Total indexing time | | 401.194 | min |
| All | Min indexing time per shard | | 98.7986 | min |
| All | Median indexing time per shard | | 100.4 | min |
| All | Max indexing time per shard | | 101.595 | min |
| All | Total merge time | | 124.465 | min |
| All | Min merge time per shard | | 29.5158 | min |
| All | Median merge time per shard | | 30.7329 | min |
| All | Max merge time per shard | | 33.4833 | min |
| All | Total merge throttle time | | 88.1058 | min |
| All | Min merge throttle time per shard | | 20.7029 | min |
| All | Median merge throttle time per shard | | 21.6268 | min |
| All | Max merge throttle time per shard | | 24.1493 | min |
| All | Total refresh time | | 6.88725 | min |
| All | Min refresh time per shard | | 1.7008 | min |
| All | Median refresh time per shard | | 1.71214 | min |
| All | Max refresh time per shard | | 1.76217 | min |
| All | Total flush time | | 7.19603 | min |
| All | Min flush time per shard | | 1.7657 | min |
| All | Median flush time per shard | | 1.78863 | min |
| All | Max flush time per shard | | 1.85307 | min |
| All | Median CPU usage | | 535.5 | % |
| All | Total Young Gen GC | | 588.848 | s |
| All | Total Old Gen GC | | 63.889 | s |
| All | Store size | | 7.24802 | GB |
| All | Translog size | | 0.510091 | GB |
| All | Index size | | 5.78037 | GB |
| All | Totally written | | 402.755 | GB |
| All | Heap used for segments | | 83.0264 | MB |
| All | Heap used for doc values | | 0.00365448 | MB |
| All | Heap used for terms | | 76.9984 | MB |
| All | Heap used for norms | | 0 | MB |
| All | Heap used for points | | 1.17057 | MB |
| All | Heap used for stored fields | | 4.86707 | MB |
| All | Segment count | | 56 | |
| All | Min Throughput | process-grok | 140433 | docs/s |
| All | Median Throughput | process-grok | 147156 | docs/s |
| All | Max Throughput | process-grok | 151740 | docs/s |
| All | 50th percentile latency | process-grok | 234.17 | ms |
| All | 90th percentile latency | process-grok | 338.706 | ms |
| All | 99th percentile latency | process-grok | 720.07 | ms |
| All | 99.9th percentile latency | process-grok | 976.71 | ms |
| All | 99.99th percentile latency | process-grok | 1120.77 | ms |
| All | 100th percentile latency | process-grok | 1314.32 | ms |
| All | 50th percentile service time | process-grok | 234.17 | ms |
| All | 90th percentile service time | process-grok | 338.706 | ms |
| All | 99th percentile service time | process-grok | 720.07 | ms |
| All | 99.9th percentile service time | process-grok | 976.71 | ms |
| All | 99.99th percentile service time | process-grok | 1120.77 | ms |
| All | 100th percentile service time | process-grok | 1314.32 | ms |
| All | error rate | process-grok | 0.02 | % |
----------------------------------
[INFO] SUCCESS (took 6959 seconds)
----------------------------------
-bash: --report-file=~/grok4.out: No such file or directory
____ ____
/ __ \____ _/ / /_ __
/ /_/ / __ `/ / / / / /
/ _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
/____/
[INFO] Preparing for race ...
[INFO] Racing on track [http_logs_for_ingest], challenge [dissect] and car ['defaults'] with version [7.0.0-alpha1].
Lap [1/4]
*********
Running create-dissect-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-dissect [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|----------------:|-----------:|-------:|
| 1 | Total indexing time | | 113.944 | min |
| 1 | Min indexing time per shard | | 113.944 | min |
| 1 | Median indexing time per shard | | 113.944 | min |
| 1 | Max indexing time per shard | | 113.944 | min |
| 1 | Total merge time | | 27.2336 | min |
| 1 | Min merge time per shard | | 27.2336 | min |
| 1 | Median merge time per shard | | 27.2336 | min |
| 1 | Max merge time per shard | | 27.2336 | min |
| 1 | Total merge throttle time | | 18.5083 | min |
| 1 | Min merge throttle time per shard | | 18.5083 | min |
| 1 | Median merge throttle time per shard | | 18.5083 | min |
| 1 | Max merge throttle time per shard | | 18.5083 | min |
| 1 | Total refresh time | | 1.5234 | min |
| 1 | Min refresh time per shard | | 1.5234 | min |
| 1 | Median refresh time per shard | | 1.5234 | min |
| 1 | Max refresh time per shard | | 1.5234 | min |
| 1 | Total flush time | | 1.67702 | min |
| 1 | Min flush time per shard | | 1.67702 | min |
| 1 | Median flush time per shard | | 1.67702 | min |
| 1 | Max flush time per shard | | 1.67702 | min |
| 1 | Median CPU usage | | 493.6 | % |
| 1 | Total Young Gen GC | | 141.928 | s |
| 1 | Total Old Gen GC | | 15.779 | s |
| 1 | Store size | | 8.1696 | GB |
| 1 | Translog size | | 0.511152 | GB |
| 1 | Totally written | | 101.81 | GB |
| 1 | Heap used for segments | | 86.6859 | MB |
| 1 | Heap used for doc values | | 0.00402069 | MB |
| 1 | Heap used for terms | | 80.6735 | MB |
| 1 | Heap used for norms | | 0 | MB |
| 1 | Heap used for points | | 1.16952 | MB |
| 1 | Heap used for stored fields | | 4.83883 | MB |
| 1 | Segment count | | 62 | |
| 1 | Min Throughput | process-dissect | 154383 | docs/s |
| 1 | Median Throughput | process-dissect | 162295 | docs/s |
| 1 | Max Throughput | process-dissect | 163366 | docs/s |
| 1 | 50th percentile latency | process-dissect | 211.601 | ms |
| 1 | 90th percentile latency | process-dissect | 312.617 | ms |
| 1 | 99th percentile latency | process-dissect | 691.751 | ms |
| 1 | 99.9th percentile latency | process-dissect | 908.018 | ms |
| 1 | 99.99th percentile latency | process-dissect | 1002.64 | ms |
| 1 | 100th percentile latency | process-dissect | 1077.5 | ms |
| 1 | 50th percentile service time | process-dissect | 211.601 | ms |
| 1 | 90th percentile service time | process-dissect | 312.617 | ms |
| 1 | 99th percentile service time | process-dissect | 691.751 | ms |
| 1 | 99.9th percentile service time | process-dissect | 908.018 | ms |
| 1 | 99.99th percentile service time | process-dissect | 1002.64 | ms |
| 1 | 100th percentile service time | process-dissect | 1077.5 | ms |
| 1 | error rate | process-dissect | 0.02 | % |
[INFO] Lap time 00:27:14 (ETA: 01:21:43)
Lap [2/4]
*********
Running create-dissect-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-dissect [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|----------------:|-----------:|-------:|
| 2 | Total indexing time | | 111.932 | min |
| 2 | Min indexing time per shard | | 111.932 | min |
| 2 | Median indexing time per shard | | 111.932 | min |
| 2 | Max indexing time per shard | | 111.932 | min |
| 2 | Total merge time | | 30.7486 | min |
| 2 | Min merge time per shard | | 30.7486 | min |
| 2 | Median merge time per shard | | 30.7486 | min |
| 2 | Max merge time per shard | | 30.7486 | min |
| 2 | Total merge throttle time | | 21.8348 | min |
| 2 | Min merge throttle time per shard | | 21.8348 | min |
| 2 | Median merge throttle time per shard | | 21.8348 | min |
| 2 | Max merge throttle time per shard | | 21.8348 | min |
| 2 | Total refresh time | | 1.49098 | min |
| 2 | Min refresh time per shard | | 1.49098 | min |
| 2 | Median refresh time per shard | | 1.49098 | min |
| 2 | Max refresh time per shard | | 1.49098 | min |
| 2 | Total flush time | | 1.70218 | min |
| 2 | Min flush time per shard | | 1.70218 | min |
| 2 | Median flush time per shard | | 1.70218 | min |
| 2 | Max flush time per shard | | 1.70218 | min |
| 2 | Median CPU usage | | 484.6 | % |
| 2 | Total Young Gen GC | | 144.813 | s |
| 2 | Total Old Gen GC | | 15.865 | s |
| 2 | Store size | | 6.74441 | GB |
| 2 | Translog size | | 0.596212 | GB |
| 2 | Totally written | | 101.195 | GB |
| 2 | Heap used for segments | | 86.6794 | MB |
| 2 | Heap used for doc values | | 0.00466919 | MB |
| 2 | Heap used for terms | | 80.6599 | MB |
| 2 | Heap used for norms | | 0 | MB |
| 2 | Heap used for points | | 1.16964 | MB |
| 2 | Heap used for stored fields | | 4.84522 | MB |
| 2 | Segment count | | 72 | |
| 2 | Min Throughput | process-dissect | 157366 | docs/s |
| 2 | Median Throughput | process-dissect | 160086 | docs/s |
| 2 | Max Throughput | process-dissect | 165284 | docs/s |
| 2 | 50th percentile latency | process-dissect | 215.63 | ms |
| 2 | 90th percentile latency | process-dissect | 315.519 | ms |
| 2 | 99th percentile latency | process-dissect | 695.354 | ms |
| 2 | 99.9th percentile latency | process-dissect | 896.274 | ms |
| 2 | 99.99th percentile latency | process-dissect | 1026.39 | ms |
| 2 | 100th percentile latency | process-dissect | 1125.58 | ms |
| 2 | 50th percentile service time | process-dissect | 215.63 | ms |
| 2 | 90th percentile service time | process-dissect | 315.519 | ms |
| 2 | 99th percentile service time | process-dissect | 695.354 | ms |
| 2 | 99.9th percentile service time | process-dissect | 896.274 | ms |
| 2 | 99.99th percentile service time | process-dissect | 1026.39 | ms |
| 2 | 100th percentile service time | process-dissect | 1125.58 | ms |
| 2 | error rate | process-dissect | 0.02 | % |
[INFO] Lap time 00:26:19 (ETA: 00:53:34)
Lap [3/4]
*********
Running create-dissect-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-dissect [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|----------------:|-----------:|-------:|
| 3 | Total indexing time | | 112.984 | min |
| 3 | Min indexing time per shard | | 112.984 | min |
| 3 | Median indexing time per shard | | 112.984 | min |
| 3 | Max indexing time per shard | | 112.984 | min |
| 3 | Total merge time | | 29.3458 | min |
| 3 | Min merge time per shard | | 29.3458 | min |
| 3 | Median merge time per shard | | 29.3458 | min |
| 3 | Max merge time per shard | | 29.3458 | min |
| 3 | Total merge throttle time | | 20.5464 | min |
| 3 | Min merge throttle time per shard | | 20.5464 | min |
| 3 | Median merge throttle time per shard | | 20.5464 | min |
| 3 | Max merge throttle time per shard | | 20.5464 | min |
| 3 | Total refresh time | | 1.49 | min |
| 3 | Min refresh time per shard | | 1.49 | min |
| 3 | Median refresh time per shard | | 1.49 | min |
| 3 | Max refresh time per shard | | 1.49 | min |
| 3 | Total flush time | | 1.70653 | min |
| 3 | Min flush time per shard | | 1.70653 | min |
| 3 | Median flush time per shard | | 1.70653 | min |
| 3 | Max flush time per shard | | 1.70653 | min |
| 3 | Median CPU usage | | 481.6 | % |
| 3 | Total Young Gen GC | | 146.181 | s |
| 3 | Total Old Gen GC | | 15.733 | s |
| 3 | Store size | | 7.73285 | GB |
| 3 | Translog size | | 0.610039 | GB |
| 3 | Totally written | | 101.953 | GB |
| 3 | Heap used for segments | | 85.7983 | MB |
| 3 | Heap used for doc values | | 0.00479889 | MB |
| 3 | Heap used for terms | | 79.8079 | MB |
| 3 | Heap used for norms | | 0 | MB |
| 3 | Heap used for points | | 1.16904 | MB |
| 3 | Heap used for stored fields | | 4.8166 | MB |
| 3 | Segment count | | 74 | |
| 3 | Min Throughput | process-dissect | 157048 | docs/s |
| 3 | Median Throughput | process-dissect | 159142 | docs/s |
| 3 | Max Throughput | process-dissect | 165028 | docs/s |
| 3 | 50th percentile latency | process-dissect | 215.319 | ms |
| 3 | 90th percentile latency | process-dissect | 324.162 | ms |
| 3 | 99th percentile latency | process-dissect | 689.713 | ms |
| 3 | 99.9th percentile latency | process-dissect | 915.516 | ms |
| 3 | 99.99th percentile latency | process-dissect | 1024.34 | ms |
| 3 | 100th percentile latency | process-dissect | 1057.43 | ms |
| 3 | 50th percentile service time | process-dissect | 215.319 | ms |
| 3 | 90th percentile service time | process-dissect | 324.162 | ms |
| 3 | 99th percentile service time | process-dissect | 689.713 | ms |
| 3 | 99.9th percentile service time | process-dissect | 915.516 | ms |
| 3 | 99.99th percentile service time | process-dissect | 1024.34 | ms |
| 3 | 100th percentile service time | process-dissect | 1057.43 | ms |
| 3 | error rate | process-dissect | 0.02 | % |
[INFO] Lap time 00:26:46 (ETA: 00:26:46)
Lap [4/4]
*********
Running create-dissect-pipeline [100% done]
Running delete-logs-index [100% done]
Running create-logs-index [100% done]
Running wait-for-green [100% done]
Running process-dissect [100% done]
--------------------------------------------------
__ _____
/ / ____ _____ / ___/_________ ________
/ / / __ `/ __ \ \__ \/ ___/ __ \/ ___/ _ \
/ /___/ /_/ / /_/ / ___/ / /__/ /_/ / / / __/
/_____/\__,_/ .___/ /____/\___/\____/_/ \___/
/_/
--------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|----------------:|-----------:|-------:|
| 4 | Total indexing time | | 112.85 | min |
| 4 | Min indexing time per shard | | 112.85 | min |
| 4 | Median indexing time per shard | | 112.85 | min |
| 4 | Max indexing time per shard | | 112.85 | min |
| 4 | Total merge time | | 29.3804 | min |
| 4 | Min merge time per shard | | 29.3804 | min |
| 4 | Median merge time per shard | | 29.3804 | min |
| 4 | Max merge time per shard | | 29.3804 | min |
| 4 | Total merge throttle time | | 20.6197 | min |
| 4 | Min merge throttle time per shard | | 20.6197 | min |
| 4 | Median merge throttle time per shard | | 20.6197 | min |
| 4 | Max merge throttle time per shard | | 20.6197 | min |
| 4 | Total refresh time | | 1.48623 | min |
| 4 | Min refresh time per shard | | 1.48623 | min |
| 4 | Median refresh time per shard | | 1.48623 | min |
| 4 | Max refresh time per shard | | 1.48623 | min |
| 4 | Total flush time | | 1.6996 | min |
| 4 | Min flush time per shard | | 1.6996 | min |
| 4 | Median flush time per shard | | 1.6996 | min |
| 4 | Max flush time per shard | | 1.6996 | min |
| 4 | Median CPU usage | | 480.6 | % |
| 4 | Total Young Gen GC | | 147.699 | s |
| 4 | Total Old Gen GC | | 16.118 | s |
| 4 | Store size | | 7.82429 | GB |
| 4 | Translog size | | 0.557112 | GB |
| 4 | Totally written | | 102.05 | GB |
| 4 | Heap used for segments | | 90.4083 | MB |
| 4 | Heap used for doc values | | 0.00421524 | MB |
| 4 | Heap used for terms | | 84.3994 | MB |
| 4 | Heap used for norms | | 0 | MB |
| 4 | Heap used for points | | 1.16656 | MB |
| 4 | Heap used for stored fields | | 4.83813 | MB |
| 4 | Segment count | | 65 | |
| 4 | Min Throughput | process-dissect | 156866 | docs/s |
| 4 | Median Throughput | process-dissect | 158793 | docs/s |
| 4 | Max Throughput | process-dissect | 166168 | docs/s |
| 4 | 50th percentile latency | process-dissect | 213.159 | ms |
| 4 | 90th percentile latency | process-dissect | 332.121 | ms |
| 4 | 99th percentile latency | process-dissect | 700.863 | ms |
| 4 | 99.9th percentile latency | process-dissect | 945.266 | ms |
| 4 | 99.99th percentile latency | process-dissect | 1072.46 | ms |
| 4 | 100th percentile latency | process-dissect | 1414.05 | ms |
| 4 | 50th percentile service time | process-dissect | 213.159 | ms |
| 4 | 90th percentile service time | process-dissect | 332.121 | ms |
| 4 | 99th percentile service time | process-dissect | 700.863 | ms |
| 4 | 99.9th percentile service time | process-dissect | 945.266 | ms |
| 4 | 99.99th percentile service time | process-dissect | 1072.46 | ms |
| 4 | 100th percentile service time | process-dissect | 1414.05 | ms |
| 4 | error rate | process-dissect | 0.02 | % |
[INFO] Lap time 00:26:45
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------------:|----------------:|-----------:|-------:|
| All | Total indexing time | | 451.71 | min |
| All | Min indexing time per shard | | 111.932 | min |
| All | Median indexing time per shard | | 112.917 | min |
| All | Max indexing time per shard | | 113.944 | min |
| All | Total merge time | | 116.708 | min |
| All | Min merge time per shard | | 27.2336 | min |
| All | Median merge time per shard | | 29.3631 | min |
| All | Max merge time per shard | | 30.7486 | min |
| All | Total merge throttle time | | 81.5093 | min |
| All | Min merge throttle time per shard | | 18.5083 | min |
| All | Median merge throttle time per shard | | 20.5831 | min |
| All | Max merge throttle time per shard | | 21.8348 | min |
| All | Total refresh time | | 5.99062 | min |
| All | Min refresh time per shard | | 1.48623 | min |
| All | Median refresh time per shard | | 1.49049 | min |
| All | Max refresh time per shard | | 1.5234 | min |
| All | Total flush time | | 6.78533 | min |
| All | Min flush time per shard | | 1.67702 | min |
| All | Median flush time per shard | | 1.70089 | min |
| All | Max flush time per shard | | 1.70653 | min |
| All | Median CPU usage | | 484.7 | % |
| All | Total Young Gen GC | | 580.621 | s |
| All | Total Old Gen GC | | 63.495 | s |
| All | Store size | | 7.77857 | GB |
| All | Translog size | | 0.576662 | GB |
| All | Index size | | 5.85761 | GB |
| All | Totally written | | 407.008 | GB |
| All | Heap used for segments | | 86.6826 | MB |
| All | Heap used for doc values | | 0.00444221 | MB |
| All | Heap used for terms | | 80.6667 | MB |
| All | Heap used for norms | | 0 | MB |
| All | Heap used for points | | 1.16928 | MB |
| All | Heap used for stored fields | | 4.83848 | MB |
| All | Segment count | | 68 | |
| All | Min Throughput | process-dissect | 154383 | docs/s |
| All | Median Throughput | process-dissect | 159998 | docs/s |
| All | Max Throughput | process-dissect | 166168 | docs/s |
| All | 50th percentile latency | process-dissect | 213.784 | ms |
| All | 90th percentile latency | process-dissect | 321.565 | ms |
| All | 99th percentile latency | process-dissect | 695.109 | ms |
| All | 99.9th percentile latency | process-dissect | 916.248 | ms |
| All | 99.99th percentile latency | process-dissect | 1033.16 | ms |
| All | 100th percentile latency | process-dissect | 1414.05 | ms |
| All | 50th percentile service time | process-dissect | 213.784 | ms |
| All | 90th percentile service time | process-dissect | 321.565 | ms |
| All | 99th percentile service time | process-dissect | 695.109 | ms |
| All | 99.9th percentile service time | process-dissect | 916.248 | ms |
| All | 99.99th percentile service time | process-dissect | 1033.16 | ms |
| All | 100th percentile service time | process-dissect | 1414.05 | ms |
| All | error rate | process-dissect | 0.02 | % |
----------------------------------
[INFO] SUCCESS (took 6434 seconds)
------------
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment