Skip to content

Instantly share code, notes, and snippets.

@atris

atris/gist:e0fa10e79fb5ef62bd571406acf98433

Created August 5, 2019 10:35
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save atris/e0fa10e79fb5ef62bd571406acf98433 to your computer and use it in GitHub Desktop.
Save atris/e0fa10e79fb5ef62bd571406acf98433 to your computer and use it in GitHub Desktop.
Download ZIP
AsyncCaching
Raw
gistfile1.txt
WARNING: Gnuplot module not present; will not make charts
JAVA:
openjdk version "11.0.1" 2018-10-16
OpenJDK Runtime Environment 18.9 (build 11.0.1+13)
OpenJDK 64-Bit Server VM 18.9 (build 11.0.1+13, mixed mode)
OS:
Linux dev-dsk-atris-1a-b1c2cfe0.eu-west-1.amazon.com 4.9.137-0.1.ac.218.74.329.metal1.x86_64 #1 SMP Wed Dec 5 15:11:05 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
LOGS:
/local/home/atris/analytical_luceneutil/logs
Compile:
/local/home/atris/analytical_luceneutil/patch/lucene/core...
[RUN: ant jar, cwd=/local/home/atris/analytical_luceneutil/patch/lucene/core]
/local/home/atris/analytical_luceneutil/patch/lucene/benchmark
Skip compile: all .class are up to date
/local/home/atris/analytical_luceneutil/trunk/lucene/core...
[RUN: ant jar, cwd=/local/home/atris/analytical_luceneutil/trunk/lucene/core]
/local/home/atris/analytical_luceneutil/trunk/lucene/misc...
[RUN: ant compile, cwd=/local/home/atris/analytical_luceneutil/trunk/lucene/misc]
/local/home/atris/analytical_luceneutil/trunk/lucene/benchmark
Skip compile: all .class are up to date
Create indices:
/local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M: already exists
tasks file: /local/home/atris/analytical_luceneutil/util/tasks/wikimedium.10M.nostopwords.tasks
Search:
iter 0
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.0 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -5592207 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.0 -topN 10 -pk
22.5 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.0 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -5592207 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.0 -topN 10 -pk
22.9 s
Report after iter 0:
||Task ('Wildcard', None)||P50 Base 2.045201||P50 Cmp 2.089539||Pct Diff 2.16790427933||P90 Base 18.845334||P90 Cmp 35.346911||Pct Diff 87.5631973411||P99 Base 83.02344||P99 Cmp 48.300884||Pct Diff -41.8225937157||P999 Base 83.02344||P999 Cmp 48.300884||Pct Diff -41.8225937157||P100 Base 249.902876||P100 Cmp 87.512667||Pct Diff -64.9813285862
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 4.295828||P50 Cmp 4.727759||Pct Diff 10.0546623375||P90 Base 9.037488||P90 Cmp 55.639159||Pct Diff 515.648496573||P99 Base 82.149576||P99 Cmp 81.261365||Pct Diff -1.08121191033||P999 Base 82.149576||P999 Cmp 81.261365||Pct Diff -1.08121191033||P100 Base 86.642014||P100 Cmp 168.84768||Pct Diff 94.8796804285
||Task ('MedSloppyPhrase', None)||P50 Base 9.18549||P50 Cmp 8.683321||Pct Diff -5.46698107559||P90 Base 29.233836||P90 Cmp 30.984274||Pct Diff 5.98771232075||P99 Base 34.303039||P99 Cmp 35.978633||Pct Diff 4.88468091705||P999 Base 34.303039||P999 Cmp 35.978633||Pct Diff 4.88468091705||P100 Base 181.426025||P100 Cmp 261.742214||Pct Diff 44.2693869306
||Task ('OrHighHigh', None)||P50 Base 20.997779||P50 Cmp 16.938239||Pct Diff -19.3331875719||P90 Base 26.989668||P90 Cmp 29.711731||Pct Diff 10.0855742279||P99 Base 71.1345||P99 Cmp 72.914457||Pct Diff 2.50224152837||P999 Base 71.1345||P999 Cmp 72.914457||Pct Diff 2.50224152837||P100 Base 288.85441||P100 Cmp 203.02949||Pct Diff -29.7121723016
||Task ('MedPhrase', None)||P50 Base 6.935508||P50 Cmp 6.676061||Pct Diff -3.74085070625||P90 Base 8.834132||P90 Cmp 7.366097||Pct Diff -16.6177616545||P99 Base 61.645788||P99 Cmp 59.423887||Pct Diff -3.60430302229||P999 Base 61.645788||P999 Cmp 59.423887||Pct Diff -3.60430302229||P100 Base 65.592528||P100 Cmp 63.493249||Pct Diff -3.20048496987
||Task ('LowSpanNear', None)||P50 Base 23.256239||P50 Cmp 23.17936||Pct Diff -0.330573658105||P90 Base 33.890598||P90 Cmp 34.205568||Pct Diff 0.929372801271||P99 Base 34.958863||P99 Cmp 34.857876||Pct Diff -0.288873811485||P999 Base 34.958863||P999 Cmp 34.857876||Pct Diff -0.288873811485||P100 Base 96.937787||P100 Cmp 121.889403||Pct Diff 25.7398242442
||Task ('Fuzzy2', None)||P50 Base 25.45292||P50 Cmp 25.25128||Pct Diff -0.792207730979||P90 Base 79.376572||P90 Cmp 106.649481||Pct Diff 34.3588899254||P99 Base 108.933154||P99 Cmp 122.051216||Pct Diff 12.0423044026||P999 Base 108.933154||P999 Cmp 122.051216||Pct Diff 12.0423044026||P100 Base 212.373308||P100 Cmp 209.138442||Pct Diff -1.52319800942
||Task ('OrNotHighHigh', None)||P50 Base 1.903331||P50 Cmp 2.16024||Pct Diff 13.4978624317||P90 Base 4.890325||P90 Cmp 4.723459||Pct Diff -3.4121658581||P99 Base 102.556452||P99 Cmp 102.641448||Pct Diff 0.0828772820651||P999 Base 102.556452||P999 Cmp 102.641448||Pct Diff 0.0828772820651||P100 Base 226.783706||P100 Cmp 308.709148||Pct Diff 36.1249242483
||Task ('OrHighNotLow', None)||P50 Base 1.434646||P50 Cmp 1.52378||Pct Diff 6.21296124619||P90 Base 3.905319||P90 Cmp 4.569729||Pct Diff 17.0129507986||P99 Base 6.321682||P99 Cmp 7.281513||Pct Diff 15.1831585328||P999 Base 6.321682||P999 Cmp 7.281513||Pct Diff 15.1831585328||P100 Base 7.720665||P100 Cmp 15.035781||Pct Diff 94.7472270847
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 93.940495||P50 Cmp 93.939183||Pct Diff -0.00139662879145||P90 Base 102.50354||P90 Cmp 98.604983||Pct Diff -3.80333888956||P99 Base 103.572854||P99 Cmp 106.785928||Pct Diff 3.10223564951||P999 Base 103.572854||P999 Cmp 106.785928||Pct Diff 3.10223564951||P100 Base 283.457123||P100 Cmp 244.054099||Pct Diff -13.9008762888
||Task ('Fuzzy1', None)||P50 Base 26.559456||P50 Cmp 29.050383||Pct Diff 9.37868230434||P90 Base 159.424881||P90 Cmp 171.063113||Pct Diff 7.30013529068||P99 Base 339.7673||P99 Cmp 179.733118||Pct Diff -47.1011136151||P999 Base 339.7673||P999 Cmp 179.733118||Pct Diff -47.1011136151||P100 Base 417.349072||P100 Cmp 395.168736||Pct Diff -5.31457657105
||Task ('HighSloppyPhrase', None)||P50 Base 9.489382||P50 Cmp 9.980939||Pct Diff 5.18007389733||P90 Base 14.424659||P90 Cmp 15.315198||Pct Diff 6.17372653315||P99 Base 37.046395||P99 Cmp 31.348423||Pct Diff -15.380638251||P999 Base 37.046395||P999 Cmp 31.348423||Pct Diff -15.380638251||P100 Base 51.797966||P100 Cmp 33.660774||Pct Diff -35.0152590934
||Task ('OrNotHighMed', None)||P50 Base 1.605631||P50 Cmp 1.549948||Pct Diff -3.46798236955||P90 Base 16.030506||P90 Cmp 11.175798||Pct Diff -30.2841844169||P99 Base 63.933462||P99 Cmp 63.33348||Pct Diff -0.938447537848||P999 Base 63.933462||P999 Cmp 63.33348||Pct Diff -0.938447537848||P100 Base 176.946354||P100 Cmp 141.426012||Pct Diff -20.0740739761
||Task ('LowPhrase', None)||P50 Base 5.294719||P50 Cmp 5.398776||Pct Diff 1.96529787511||P90 Base 14.581045||P90 Cmp 14.201875||Pct Diff -2.6004309019||P99 Base 28.226324||P99 Cmp 17.160324||Pct Diff -39.2045382884||P999 Base 28.226324||P999 Cmp 17.160324||Pct Diff -39.2045382884||P100 Base 170.879755||P100 Cmp 141.494236||Pct Diff -17.1966064675
||Task ('AndHighLow', None)||P50 Base 1.407978||P50 Cmp 1.356986||Pct Diff -3.62164749733||P90 Base 4.452746||P90 Cmp 6.676942||Pct Diff 49.9511088214||P99 Base 69.005964||P99 Cmp 69.618355||Pct Diff 0.887446482162||P999 Base 69.005964||P999 Cmp 69.618355||Pct Diff 0.887446482162||P100 Base 302.690572||P100 Cmp 288.210249||Pct Diff -4.7838698458
||Task ('LowTerm', None)||P50 Base 0.94373||P50 Cmp 0.984236||Pct Diff 4.29211744885||P90 Base 1.776916||P90 Cmp 1.95572||Pct Diff 10.0626028467||P99 Base 2.130259||P99 Cmp 2.967897||Pct Diff 39.3209464201||P999 Base 2.130259||P999 Cmp 2.967897||Pct Diff 39.3209464201||P100 Base 3.471183||P100 Cmp 11.055948||Pct Diff 218.50663016
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 126.336025||P50 Cmp 125.101777||Pct Diff -0.976956493605||P90 Base 135.381181||P90 Cmp 137.867944||Pct Diff 1.8368601763||P99 Base 144.330923||P99 Cmp 144.977097||Pct Diff 0.447703088547||P999 Base 144.330923||P999 Cmp 144.977097||Pct Diff 0.447703088547||P100 Base 295.783063||P100 Cmp 302.394898||Pct Diff 2.23536632995
||Task ('AndHighHigh', None)||P50 Base 5.089657||P50 Cmp 5.20707||Pct Diff 2.30689415809||P90 Base 6.822905||P90 Cmp 8.306661||Pct Diff 21.7466900096||P99 Base 7.038109||P99 Cmp 9.130519||Pct Diff 29.7297185934||P999 Base 7.038109||P999 Cmp 9.130519||Pct Diff 29.7297185934||P100 Base 111.532214||P100 Cmp 36.808683||Pct Diff -66.9972632302
||Task ('HighTermMonthSort', 'Month')||P50 Base 2.42148||P50 Cmp 2.464948||Pct Diff 1.79510051704||P90 Base 4.411412||P90 Cmp 4.012971||Pct Diff -9.03205141574||P99 Base 4.993632||P99 Cmp 4.667476||Pct Diff -6.53143844||P999 Base 4.993632||P999 Cmp 4.667476||Pct Diff -6.53143844||P100 Base 98.675367||P100 Cmp 94.641052||Pct Diff -4.08847225265
||Task Respell||P50 Base 17.339473||P50 Cmp 16.495659||Pct Diff -4.86643394525||P90 Base 202.898846||P90 Cmp 190.452875||Pct Diff -6.13407678031||P99 Base 232.699615||P99 Cmp 206.63496||Pct Diff -11.2009875908||P999 Base 232.699615||P999 Cmp 206.63496||Pct Diff -11.2009875908||P100 Base 259.083639||P100 Cmp 261.411887||Pct Diff 0.89864725113
||Task ('MedTerm', None)||P50 Base 1.044861||P50 Cmp 1.046421||Pct Diff 0.149302155981||P90 Base 10.095498||P90 Cmp 2.086543||Pct Diff -79.3319457842||P99 Base 31.02937||P99 Cmp 4.311224||Pct Diff -86.1059892611||P999 Base 31.02937||P999 Cmp 4.311224||Pct Diff -86.1059892611||P100 Base 37.048313||P100 Cmp 30.992555||Pct Diff -16.3455701748
||Task ('HighIntervalsOrdered', None)||P50 Base 18.204528||P50 Cmp 18.50288||Pct Diff 1.63888896213||P90 Base 28.38481||P90 Cmp 28.186101||Pct Diff -0.70005400776||P99 Base 28.553312||P99 Cmp 30.147999||Pct Diff 5.58494580243||P999 Base 28.553312||P999 Cmp 30.147999||Pct Diff 5.58494580243||P100 Base 85.526627||P100 Cmp 248.898567||Pct Diff 191.018804004
||Task ('HighSpanNear', None)||P50 Base 19.317909||P50 Cmp 18.448229||Pct Diff -4.50193651911||P90 Base 26.886654||P90 Cmp 27.011485||Pct Diff 0.464286110127||P99 Base 27.066426||P99 Cmp 28.519568||Pct Diff 5.36879896888||P999 Base 27.066426||P999 Cmp 28.519568||Pct Diff 5.36879896888||P100 Base 27.949757||P100 Cmp 28.532982||Pct Diff 2.08669077159
||Task ('LowSloppyPhrase', None)||P50 Base 17.995202||P50 Cmp 17.321666||Pct Diff -3.74286434795||P90 Base 27.136218||P90 Cmp 23.990793||Pct Diff -11.5912431128||P99 Base 27.177319||P99 Cmp 25.467183||Pct Diff -6.29251178161||P999 Base 27.177319||P999 Cmp 25.467183||Pct Diff -6.29251178161||P100 Base 37.041781||P100 Cmp 26.387058||Pct Diff -28.7640677968
||Task ('OrHighNotHigh', None)||P50 Base 1.721541||P50 Cmp 1.683098||Pct Diff -2.23305747583||P90 Base 2.334157||P90 Cmp 2.147467||Pct Diff -7.99817664364||P99 Base 3.127609||P99 Cmp 3.205909||Pct Diff 2.50350986968||P999 Base 3.127609||P999 Cmp 3.205909||Pct Diff 2.50350986968||P100 Base 10.177133||P100 Cmp 5.218394||Pct Diff -48.7243214764
||Task ('OrNotHighLow', None)||P50 Base 1.467553||P50 Cmp 1.4717||Pct Diff 0.282579232232||P90 Base 11.130311||P90 Cmp 9.27055||Pct Diff -16.7089760565||P99 Base 12.92663||P99 Cmp 12.305485||Pct Diff -4.80515803423||P999 Base 12.92663||P999 Cmp 12.305485||Pct Diff -4.80515803423||P100 Base 41.801941||P100 Cmp 42.736573||Pct Diff 2.23585789952
||Task ('MedSpanNear', None)||P50 Base 8.050703||P50 Cmp 8.0656||Pct Diff 0.18503974125||P90 Base 12.37128||P90 Cmp 11.972162||Pct Diff -3.22616576458||P99 Base 13.276762||P99 Cmp 13.410559||Pct Diff 1.00775324586||P999 Base 13.276762||P999 Cmp 13.410559||Pct Diff 1.00775324586||P100 Base 389.340697||P100 Cmp 524.654134||Pct Diff 34.7545062827
||Task ('BrowseDateTaxoFacets', None)||P50 Base 429.062505||P50 Cmp 428.859358||Pct Diff -0.0473467146704||P90 Base 436.499827||P90 Cmp 441.680746||Pct Diff 1.18692349447||P99 Base 458.955056||P99 Cmp 443.442175||Pct Diff -3.38004360061||P999 Base 458.955056||P999 Cmp 443.442175||Pct Diff -3.38004360061||P100 Base 516.629721||P100 Cmp 518.247598||Pct Diff 0.313159877227
||Task ('HighPhrase', None)||P50 Base 4.346807||P50 Cmp 4.173837||Pct Diff -3.9792426947||P90 Base 5.762266||P90 Cmp 6.035056||Pct Diff 4.7340751017||P99 Base 7.09179||P99 Cmp 8.179865||Pct Diff 15.3427413953||P999 Base 7.09179||P999 Cmp 8.179865||Pct Diff 15.3427413953||P100 Base 25.682734||P100 Cmp 26.872466||Pct Diff 4.63241958586
||Task ('OrHighLow', None)||P50 Base 2.360377||P50 Cmp 2.373989||Pct Diff 0.576687537626||P90 Base 2.920517||P90 Cmp 4.037781||Pct Diff 38.2556923997||P99 Base 4.226431||P99 Cmp 4.511819||Pct Diff 6.75245851642||P999 Base 4.226431||P999 Cmp 4.511819||Pct Diff 6.75245851642||P100 Base 48.928035||P100 Cmp 13.15068||Pct Diff -73.1224031376
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.168513||P50 Cmp 0.182987||Pct Diff 8.58924830725||P90 Base 0.204691||P90 Cmp 0.247465||Pct Diff 20.8968640536||P99 Base 15.455504||P99 Cmp 15.315246||Pct Diff -0.907495478633||P999 Base 15.455504||P999 Cmp 15.315246||Pct Diff -0.907495478633||P100 Base 16.866213||P100 Cmp 19.937509||Pct Diff 18.2097546142
||Task ('OrHighMed', None)||P50 Base 3.574777||P50 Cmp 3.231059||Pct Diff -9.6150892769||P90 Base 24.188598||P90 Cmp 4.638494||Pct Diff -80.8236343421||P99 Base 46.693976||P99 Cmp 8.113618||Pct Diff -82.6238442406||P999 Base 46.693976||P999 Cmp 8.113618||Pct Diff -82.6238442406||P100 Base 269.409786||P100 Cmp 23.431229||Pct Diff -91.3027550529
||Task ('IntNRQ', None)||P50 Base 4.011057||P50 Cmp 4.923845||Pct Diff 22.7567945307||P90 Base 13.346714||P90 Cmp 12.29044||Pct Diff -7.91411279211||P99 Base 85.073004||P99 Cmp 67.905295||Pct Diff -20.1799727208||P999 Base 85.073004||P999 Cmp 67.905295||Pct Diff -20.1799727208||P100 Base 191.744926||P100 Cmp 194.853114||Pct Diff 1.62100143396
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.170601||P50 Cmp 0.172844||Pct Diff 1.31476368837||P90 Base 0.212197||P90 Cmp 0.260394||Pct Diff 22.7133277096||P99 Base 0.227793||P99 Cmp 4.692225||Pct Diff 1959.86356034||P999 Base 0.227793||P999 Cmp 4.692225||Pct Diff 1959.86356034||P100 Base 10.00639||P100 Cmp 9.966375||Pct Diff -0.399894467435
||Task ('AndHighMed', None)||P50 Base 3.367039||P50 Cmp 3.095126||Pct Diff -8.07573063454||P90 Base 6.445771||P90 Cmp 4.890087||Pct Diff -24.1349560821||P99 Base 6.646047||P99 Cmp 6.78425||Pct Diff 2.07947671751||P999 Base 6.646047||P999 Cmp 6.78425||Pct Diff 2.07947671751||P100 Base 42.892862||P100 Cmp 96.998233||Pct Diff 126.140734092
||Task ('OrHighNotMed', None)||P50 Base 1.75091||P50 Cmp 1.851148||Pct Diff 5.72490876173||P90 Base 3.059898||P90 Cmp 3.291761||Pct Diff 7.57747480472||P99 Base 5.304103||P99 Cmp 4.755972||Pct Diff -10.3340941909||P999 Base 5.304103||P999 Cmp 4.755972||Pct Diff -10.3340941909||P100 Base 21.934264||P100 Cmp 16.361938||Pct Diff -25.4046636805
||Task ('Prefix3', None)||P50 Base 15.061956||P50 Cmp 14.031055||Pct Diff -6.84440321031||P90 Base 28.636916||P90 Cmp 25.283538||Pct Diff -11.7099830163||P99 Base 425.912794||P99 Cmp 443.836014||Pct Diff 4.20819009255||P999 Base 425.912794||P999 Cmp 443.836014||Pct Diff 4.20819009255||P100 Base 497.136127||P100 Cmp 551.753833||Pct Diff 10.9864689033
||Task PKLookup||P50 Base 11.334723||P50 Cmp 10.857995||Pct Diff -4.20590781089||P90 Base 89.284901||P90 Cmp 32.062856||Pct Diff -64.0892741764||P99 Base 334.811782||P99 Cmp 73.551516||Pct Diff -78.0319809654||P999 Base 334.811782||P999 Cmp 73.551516||Pct Diff -78.0319809654||P100 Base 363.062965||P100 Cmp 418.731587||Pct Diff 15.3330489107
||Task ('HighTerm', None)||P50 Base 1.148459||P50 Cmp 1.212344||Pct Diff 5.56267137094||P90 Base 1.54||P90 Cmp 1.915795||Pct Diff 24.4022727273||P99 Base 2.138094||P99 Cmp 3.134936||Pct Diff 46.622926775||P999 Base 2.138094||P999 Cmp 3.134936||Pct Diff 46.622926775||P100 Base 2.722231||P100 Cmp 153.54749||Pct Diff 5540.50185308
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
Fuzzy1 59.87 (0.0%) 38.89 (0.0%) -35.0% ( -35% - -35%)
OrNotHighHigh 547.83 (0.0%) 497.54 (0.0%) -9.2% ( -9% - -9%)
BrowseMonthTaxoFacets 6484.56 (0.0%) 5913.63 (0.0%) -8.8% ( -8% - -8%)
OrHighNotMed 610.95 (0.0%) 569.04 (0.0%) -6.9% ( -6% - -6%)
HighTerm 919.71 (0.0%) 863.97 (0.0%) -6.1% ( -6% - -6%)
BrowseDayOfYearTaxoFacets 5935.04 (0.0%) 5618.62 (0.0%) -5.3% ( -5% - -5%)
HighTermDayOfYearSort 250.48 (0.0%) 238.68 (0.0%) -4.7% ( -4% - -4%)
HighSloppyPhrase 105.89 (0.0%) 101.20 (0.0%) -4.4% ( -4% - -4%)
Fuzzy2 43.90 (0.0%) 42.02 (0.0%) -4.3% ( -4% - -4%)
OrHighNotLow 707.19 (0.0%) 680.63 (0.0%) -3.8% ( -3% - -3%)
LowTerm 1088.42 (0.0%) 1049.62 (0.0%) -3.6% ( -3% - -3%)
OrHighNotHigh 620.65 (0.0%) 600.08 (0.0%) -3.3% ( -3% - -3%)
AndHighHigh 199.47 (0.0%) 194.60 (0.0%) -2.4% ( -2% - -2%)
OrNotHighLow 762.81 (0.0%) 744.66 (0.0%) -2.4% ( -2% - -2%)
HighTermMonthSort 413.74 (0.0%) 405.95 (0.0%) -1.9% ( -1% - -1%)
MedTerm 981.62 (0.0%) 963.66 (0.0%) -1.8% ( -1% - -1%)
IntNRQ 250.40 (0.0%) 247.22 (0.0%) -1.3% ( -1% - -1%)
BrowseMonthSSDVFacets 10.69 (0.0%) 10.65 (0.0%) -0.4% ( 0% - 0%)
LowSpanNear 43.55 (0.0%) 43.41 (0.0%) -0.3% ( 0% - 0%)
OrHighMed 313.28 (0.0%) 312.42 (0.0%) -0.3% ( 0% - 0%)
BrowseDateTaxoFacets 2.33 (0.0%) 2.34 (0.0%) 0.2% ( 0% - 0%)
Wildcard 547.82 (0.0%) 551.16 (0.0%) 0.6% ( 0% - 0%)
MedSpanNear 124.77 (0.0%) 125.60 (0.0%) 0.7% ( 0% - 0%)
BrowseDayOfYearSSDVFacets 7.92 (0.0%) 8.00 (0.0%) 1.0% ( 0% - 0%)
AndHighLow 755.31 (0.0%) 763.28 (0.0%) 1.1% ( 1% - 1%)
HighIntervalsOrdered 55.20 (0.0%) 55.85 (0.0%) 1.2% ( 1% - 1%)
OrHighLow 432.06 (0.0%) 437.20 (0.0%) 1.2% ( 1% - 1%)
OrNotHighMed 655.93 (0.0%) 669.78 (0.0%) 2.1% ( 2% - 2%)
HighPhrase 232.75 (0.0%) 239.79 (0.0%) 3.0% ( 3% - 3%)
MedPhrase 145.17 (0.0%) 150.09 (0.0%) 3.4% ( 3% - 3%)
LowSloppyPhrase 55.84 (0.0%) 58.08 (0.0%) 4.0% ( 4% - 4%)
PKLookup 88.46 (0.0%) 92.89 (0.0%) 5.0% ( 5% - 5%)
LowPhrase 191.87 (0.0%) 203.90 (0.0%) 6.3% ( 6% - 6%)
Respell 59.94 (0.0%) 64.01 (0.0%) 6.8% ( 6% - 6%)
AndHighMed 306.92 (0.0%) 331.52 (0.0%) 8.0% ( 8% - 8%)
Prefix3 66.70 (0.0%) 72.16 (0.0%) 8.2% ( 8% - 8%)
OrHighHigh 53.77 (0.0%) 59.19 (0.0%) 10.1% ( 10% - 10%)
MedSloppyPhrase 114.87 (0.0%) 127.47 (0.0%) 11.0% ( 10% - 10%)
HighSpanNear 40.33 (0.0%) 55.91 (0.0%) 38.6% ( 38% - 38%)
iter 1
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.1 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -3267363 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.1 -topN 10 -pk
21.9 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.1 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -3267363 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.1 -topN 10 -pk
22.5 s
Report after iter 1:
||Task ('Wildcard', None)||P50 Base 2.126473||P50 Cmp 2.289603||Pct Diff 7.67138825652||P90 Base 85.793078||P90 Cmp 16.732362||Pct Diff -80.4968391506||P99 Base 106.095403||P99 Cmp 61.66866||Pct Diff -41.8743336127||P999 Base 106.095403||P999 Cmp 61.66866||Pct Diff -41.8743336127||P100 Base 122.770437||P100 Cmp 87.988277||Pct Diff -28.3310549754
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 4.001074||P50 Cmp 4.029545||Pct Diff 0.711583939712||P90 Base 67.631294||P90 Cmp 68.338378||Pct Diff 1.04549825706||P99 Base 120.48632||P99 Cmp 77.567501||Pct Diff -35.6213211591||P999 Base 120.48632||P999 Cmp 77.567501||Pct Diff -35.6213211591||P100 Base 129.266007||P100 Cmp 122.040526||Pct Diff -5.58962187174
||Task ('MedSloppyPhrase', None)||P50 Base 9.109634||P50 Cmp 8.384702||Pct Diff -7.95786087564||P90 Base 43.647023||P90 Cmp 12.381824||Pct Diff -71.6319163394||P99 Base 82.944334||P99 Cmp 49.991131||Pct Diff -39.7292996529||P999 Base 82.944334||P999 Cmp 49.991131||Pct Diff -39.7292996529||P100 Base 243.385475||P100 Cmp 237.320425||Pct Diff -2.49195232378
||Task ('OrHighHigh', None)||P50 Base 19.878916||P50 Cmp 17.24594||Pct Diff -13.2450682925||P90 Base 127.821496||P90 Cmp 33.305321||Pct Diff -73.9438810824||P99 Base 158.701448||P99 Cmp 75.956675||Pct Diff -52.1386377017||P999 Base 158.701448||P999 Cmp 75.956675||Pct Diff -52.1386377017||P100 Base 311.307484||P100 Cmp 78.025898||Pct Diff -74.9360673899
||Task ('MedPhrase', None)||P50 Base 6.868027||P50 Cmp 7.062167||Pct Diff 2.82672156065||P90 Base 7.412934||P90 Cmp 9.764805||Pct Diff 31.7265876102||P99 Base 7.844509||P99 Cmp 10.3485||Pct Diff 31.9203024689||P999 Base 7.844509||P999 Cmp 10.3485||Pct Diff 31.9203024689||P100 Base 8.224355||P100 Cmp 10.385599||Pct Diff 26.2785835485
||Task ('LowSpanNear', None)||P50 Base 23.381812||P50 Cmp 23.356365||Pct Diff -0.108832454901||P90 Base 31.769135||P90 Cmp 35.137591||Pct Diff 10.6029200984||P99 Base 34.443101||P99 Cmp 35.477867||Pct Diff 3.00427653131||P999 Base 34.443101||P999 Cmp 35.477867||Pct Diff 3.00427653131||P100 Base 39.20853||P100 Cmp 36.016823||Pct Diff -8.14033833964
||Task ('Fuzzy2', None)||P50 Base 28.037658||P50 Cmp 44.380512||Pct Diff 58.2889412518||P90 Base 186.337425||P90 Cmp 218.931162||Pct Diff 17.4917824479||P99 Base 216.174986||P99 Cmp 295.805073||Pct Diff 36.8359394736||P999 Base 216.174986||P999 Cmp 295.805073||Pct Diff 36.8359394736||P100 Base 343.697989||P100 Cmp 331.556311||Pct Diff -3.5326590171
||Task ('OrNotHighHigh', None)||P50 Base 2.06424||P50 Cmp 1.882687||Pct Diff -8.79514978878||P90 Base 9.751906||P90 Cmp 3.61788||Pct Diff -62.9007908813||P99 Base 11.979067||P99 Cmp 28.277347||Pct Diff 136.056338945||P999 Base 11.979067||P999 Cmp 28.277347||Pct Diff 136.056338945||P100 Base 21.848283||P100 Cmp 29.642558||Pct Diff 35.6745424801
||Task ('OrHighNotLow', None)||P50 Base 1.553875||P50 Cmp 1.703418||Pct Diff 9.62387579439||P90 Base 2.582877||P90 Cmp 4.642216||Pct Diff 79.7304323822||P99 Base 3.657125||P99 Cmp 36.745207||Pct Diff 904.756659945||P999 Base 3.657125||P999 Cmp 36.745207||Pct Diff 904.756659945||P100 Base 31.492362||P100 Cmp 50.817231||Pct Diff 61.3636697051
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 94.478242||P50 Cmp 65.23066||Pct Diff -30.9569498552||P90 Base 112.491623||P90 Cmp 71.458286||Pct Diff -36.4767934764||P99 Base 114.340831||P99 Cmp 85.168282||Pct Diff -25.5136758626||P999 Base 114.340831||P999 Cmp 85.168282||Pct Diff -25.5136758626||P100 Base 122.413191||P100 Cmp 123.673132||Pct Diff 1.02925263994
||Task ('Fuzzy1', None)||P50 Base 17.405245||P50 Cmp 17.985643||Pct Diff 3.33461551389||P90 Base 74.226385||P90 Cmp 98.796729||Pct Diff 33.1019003552||P99 Base 254.174544||P99 Cmp 261.998263||Pct Diff 3.07808912603||P999 Base 254.174544||P999 Cmp 261.998263||Pct Diff 3.07808912603||P100 Base 366.3911||P100 Cmp 555.516527||Pct Diff 51.6184555247
||Task ('HighSloppyPhrase', None)||P50 Base 9.687505||P50 Cmp 9.57414||Pct Diff -1.17021875085||P90 Base 14.168364||P90 Cmp 11.602508||Pct Diff -18.1097549442||P99 Base 17.914288||P99 Cmp 14.212235||Pct Diff -20.6653649869||P999 Base 17.914288||P999 Cmp 14.212235||Pct Diff -20.6653649869||P100 Base 36.934458||P100 Cmp 20.787736||Pct Diff -43.7172301269
||Task ('OrNotHighMed', None)||P50 Base 1.586983||P50 Cmp 1.644703||Pct Diff 3.63709000033||P90 Base 5.317424||P90 Cmp 7.856147||Pct Diff 47.743475036||P99 Base 10.008333||P99 Cmp 8.431316||Pct Diff -15.7570396589||P999 Base 10.008333||P999 Cmp 8.431316||Pct Diff -15.7570396589||P100 Base 25.697408||P100 Cmp 24.657308||Pct Diff -4.04748992583
||Task ('LowPhrase', None)||P50 Base 6.633995||P50 Cmp 5.13676||Pct Diff -22.5691306671||P90 Base 8.075662||P90 Cmp 7.935994||Pct Diff -1.72949288863||P99 Base 18.943239||P99 Cmp 70.480864||Pct Diff 272.063425901||P999 Base 18.943239||P999 Cmp 70.480864||Pct Diff 272.063425901||P100 Base 75.04085||P100 Cmp 72.031626||Pct Diff -4.01011449097
||Task ('AndHighLow', None)||P50 Base 1.342213||P50 Cmp 1.304165||Pct Diff -2.83472146373||P90 Base 1.843836||P90 Cmp 1.989869||Pct Diff 7.92006447428||P99 Base 4.870992||P99 Cmp 5.016593||Pct Diff 2.98914471631||P999 Base 4.870992||P999 Cmp 5.016593||Pct Diff 2.98914471631||P100 Base 10.266555||P100 Cmp 7.218702||Pct Diff -29.6872027667
||Task ('LowTerm', None)||P50 Base 0.877302||P50 Cmp 0.904978||Pct Diff 3.15467193737||P90 Base 4.115471||P90 Cmp 4.032007||Pct Diff -2.02805462607||P99 Base 4.54732||P99 Cmp 4.547226||Pct Diff -0.00206715164096||P999 Base 4.54732||P999 Cmp 4.547226||Pct Diff -0.00206715164096||P100 Base 21.261058||P100 Cmp 22.698216||Pct Diff 6.75957894475
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 125.976086||P50 Cmp 83.17818||Pct Diff -33.9730399308||P90 Base 167.152749||P90 Cmp 87.071194||Pct Diff -47.9092060879||P99 Base 175.650109||P99 Cmp 93.403551||Pct Diff -46.8240859446||P999 Base 175.650109||P999 Cmp 93.403551||Pct Diff -46.8240859446||P100 Base 285.143782||P100 Cmp 331.691492||Pct Diff 16.3242942468
||Task ('AndHighHigh', None)||P50 Base 5.240664||P50 Cmp 5.062804||Pct Diff -3.39384474944||P90 Base 7.26728||P90 Cmp 9.295245||Pct Diff 27.9054199095||P99 Base 17.190415||P99 Cmp 59.549841||Pct Diff 246.413050528||P999 Base 17.190415||P999 Cmp 59.549841||Pct Diff 246.413050528||P100 Base 63.39361||P100 Cmp 60.31758||Pct Diff -4.85227138824
||Task ('HighTermMonthSort', 'Month')||P50 Base 2.831139||P50 Cmp 2.642793||Pct Diff -6.65265817044||P90 Base 3.861043||P90 Cmp 3.957437||Pct Diff 2.49657929218||P99 Base 4.090115||P99 Cmp 4.147612||Pct Diff 1.40575509491||P999 Base 4.090115||P999 Cmp 4.147612||Pct Diff 1.40575509491||P100 Base 43.071548||P100 Cmp 37.926168||Pct Diff -11.946122763
||Task Respell||P50 Base 15.858715||P50 Cmp 16.124677||Pct Diff 1.67707156601||P90 Base 112.335707||P90 Cmp 135.986129||Pct Diff 21.0533432616||P99 Base 255.742921||P99 Cmp 253.758203||Pct Diff -0.77605979952||P999 Base 255.742921||P999 Cmp 253.758203||Pct Diff -0.77605979952||P100 Base 493.912767||P100 Cmp 590.833993||Pct Diff 19.6231465302
||Task ('MedTerm', None)||P50 Base 1.091892||P50 Cmp 1.037989||Pct Diff -4.93666040231||P90 Base 2.803455||P90 Cmp 2.46928||Pct Diff -11.9201128607||P99 Base 3.333747||P99 Cmp 3.856493||Pct Diff 15.6804340581||P999 Base 3.333747||P999 Cmp 3.856493||Pct Diff 15.6804340581||P100 Base 32.857126||P100 Cmp 32.37159||Pct Diff -1.477719019
||Task ('HighIntervalsOrdered', None)||P50 Base 21.065034||P50 Cmp 18.953901||Pct Diff -10.0219776526||P90 Base 24.647192||P90 Cmp 30.469783||Pct Diff 23.6237499184||P99 Base 30.697138||P99 Cmp 34.322011||Pct Diff 11.8085047538||P999 Base 30.697138||P999 Cmp 34.322011||Pct Diff 11.8085047538||P100 Base 302.052542||P100 Cmp 245.619319||Pct Diff -18.6832471683
||Task ('HighSpanNear', None)||P50 Base 18.470096||P50 Cmp 18.854664||Pct Diff 2.08211153856||P90 Base 25.373431||P90 Cmp 28.733595||Pct Diff 13.2428444541||P99 Base 26.027791||P99 Cmp 39.275119||Pct Diff 50.8968586693||P999 Base 26.027791||P999 Cmp 39.275119||Pct Diff 50.8968586693||P100 Base 99.430907||P100 Cmp 94.701892||Pct Diff -4.75608152704
||Task ('LowSloppyPhrase', None)||P50 Base 17.175679||P50 Cmp 16.289759||Pct Diff -5.15799113386||P90 Base 24.210839||P90 Cmp 25.649242||Pct Diff 5.94115305133||P99 Base 25.127355||P99 Cmp 25.832361||Pct Diff 2.80573104491||P999 Base 25.127355||P999 Cmp 25.832361||Pct Diff 2.80573104491||P100 Base 33.156129||P100 Cmp 26.621603||Pct Diff -19.7083501515
||Task ('OrHighNotHigh', None)||P50 Base 1.777682||P50 Cmp 1.732009||Pct Diff -2.56924466806||P90 Base 4.076724||P90 Cmp 3.00789||Pct Diff -26.217963247||P99 Base 4.873201||P99 Cmp 3.457684||Pct Diff -29.0469652288||P999 Base 4.873201||P999 Cmp 3.457684||Pct Diff -29.0469652288||P100 Base 113.378389||P100 Cmp 160.662509||Pct Diff 41.7047026484
||Task ('OrNotHighLow', None)||P50 Base 1.254335||P50 Cmp 1.164008||Pct Diff -7.20118628596||P90 Base 1.76586||P90 Cmp 1.599874||Pct Diff -9.39972591259||P99 Base 2.241265||P99 Cmp 2.42972||Pct Diff 8.40842113717||P999 Base 2.241265||P999 Cmp 2.42972||Pct Diff 8.40842113717||P100 Base 7.049007||P100 Cmp 7.206905||Pct Diff 2.24000345013
||Task ('MedSpanNear', None)||P50 Base 8.684744||P50 Cmp 8.38671||Pct Diff -3.43169585655||P90 Base 13.662278||P90 Cmp 12.042148||Pct Diff -11.8584177543||P99 Base 14.139925||P99 Cmp 12.607067||Pct Diff -10.840637415||P999 Base 14.139925||P999 Cmp 12.607067||Pct Diff -10.840637415||P100 Base 37.7485||P100 Cmp 28.553493||Pct Diff -24.3586023286
||Task ('BrowseDateTaxoFacets', None)||P50 Base 436.376644||P50 Cmp 437.067443||Pct Diff 0.158303385275||P90 Base 450.688655||P90 Cmp 451.508493||Pct Diff 0.181907840569||P99 Base 456.949003||P99 Cmp 453.592493||Pct Diff -0.734548051963||P999 Base 456.949003||P999 Cmp 453.592493||Pct Diff -0.734548051963||P100 Base 521.957123||P100 Cmp 556.682654||Pct Diff 6.65294704676
||Task ('HighPhrase', None)||P50 Base 4.21908||P50 Cmp 4.329408||Pct Diff 2.61497767286||P90 Base 6.36378||P90 Cmp 10.230534||Pct Diff 60.7619056598||P99 Base 7.330336||P99 Cmp 27.99607||Pct Diff 281.920692312||P999 Base 7.330336||P999 Cmp 27.99607||Pct Diff 281.920692312||P100 Base 133.185285||P100 Cmp 153.039427||Pct Diff 14.9071588502
||Task ('OrHighLow', None)||P50 Base 2.356018||P50 Cmp 2.416914||Pct Diff 2.58470011689||P90 Base 3.270774||P90 Cmp 2.781339||Pct Diff -14.9638892813||P99 Base 19.892546||P99 Cmp 3.319684||Pct Diff -83.3119199523||P999 Base 19.892546||P999 Cmp 3.319684||Pct Diff -83.3119199523||P100 Base 43.642836||P100 Cmp 5.863595||Pct Diff -86.5645875992
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.172204||P50 Cmp 0.180765||Pct Diff 4.97142923509||P90 Base 0.200087||P90 Cmp 0.243942||Pct Diff 21.9179656849||P99 Base 0.221759||P99 Cmp 0.31191||Pct Diff 40.6526905334||P999 Base 0.221759||P999 Cmp 0.31191||Pct Diff 40.6526905334||P100 Base 24.603331||P100 Cmp 29.194089||Pct Diff 18.6590913239
||Task ('OrHighMed', None)||P50 Base 3.733505||P50 Cmp 3.261306||Pct Diff -12.647605936||P90 Base 12.08476||P90 Cmp 6.90602||Pct Diff -42.8534782652||P99 Base 30.581679||P99 Cmp 27.348529||Pct Diff -10.5721795066||P999 Base 30.581679||P999 Cmp 27.348529||Pct Diff -10.5721795066||P100 Base 211.762124||P100 Cmp 230.946147||Pct Diff 9.0592324244
||Task ('IntNRQ', None)||P50 Base 4.038263||P50 Cmp 4.698346||Pct Diff 16.3457159675||P90 Base 33.253813||P90 Cmp 29.579982||Pct Diff -11.0478488587||P99 Base 90.036771||P99 Cmp 97.907284||Pct Diff 8.74144298222||P999 Base 90.036771||P999 Cmp 97.907284||Pct Diff 8.74144298222||P100 Base 243.016533||P100 Cmp 257.273698||Pct Diff 5.86674693446
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.167431||P50 Cmp 0.178116||Pct Diff 6.38173337076||P90 Base 0.205494||P90 Cmp 0.207948||Pct Diff 1.19419545096||P99 Base 9.546415||P99 Cmp 8.915669||Pct Diff -6.60715043291||P999 Base 9.546415||P999 Cmp 8.915669||Pct Diff -6.60715043291||P100 Base 15.353111||P100 Cmp 9.689348||Pct Diff -36.8900022933
||Task ('AndHighMed', None)||P50 Base 3.42076||P50 Cmp 3.843239||Pct Diff 12.3504425917||P90 Base 4.472138||P90 Cmp 4.203009||Pct Diff -6.01790463532||P99 Base 8.247572||P99 Cmp 7.997994||Pct Diff -3.02607846285||P999 Base 8.247572||P999 Cmp 7.997994||Pct Diff -3.02607846285||P100 Base 35.80362||P100 Cmp 64.248233||Pct Diff 79.446192871
||Task ('OrHighNotMed', None)||P50 Base 1.822919||P50 Cmp 1.925972||Pct Diff 5.65318590678||P90 Base 15.597171||P90 Cmp 12.342827||Pct Diff -20.864963268||P99 Base 17.485835||P99 Cmp 222.612254||Pct Diff 1173.10050678||P999 Base 17.485835||P999 Cmp 222.612254||Pct Diff 1173.10050678||P100 Base 245.178351||P100 Cmp 289.458742||Pct Diff 18.0604816124
||Task ('Prefix3', None)||P50 Base 14.021907||P50 Cmp 14.081846||Pct Diff 0.427466820312||P90 Base 23.028588||P90 Cmp 22.789213||Pct Diff -1.03946885497||P99 Base 175.614925||P99 Cmp 30.121646||Pct Diff -82.8479008831||P999 Base 175.614925||P999 Cmp 30.121646||Pct Diff -82.8479008831||P100 Base 430.223227||P100 Cmp 168.091874||Pct Diff -60.9291494622
||Task PKLookup||P50 Base 11.023767||P50 Cmp 11.417392||Pct Diff 3.57069411935||P90 Base 44.156783||P90 Cmp 84.933081||Pct Diff 92.34435851||P99 Base 217.410222||P99 Cmp 205.144324||Pct Diff -5.64182212187||P999 Base 217.410222||P999 Cmp 205.144324||Pct Diff -5.64182212187||P100 Base 472.515068||P100 Cmp 560.664312||Pct Diff 18.6553297386
||Task ('HighTerm', None)||P50 Base 1.161083||P50 Cmp 1.196202||Pct Diff 3.02467609981||P90 Base 1.482161||P90 Cmp 1.706131||Pct Diff 15.1110439419||P99 Base 1.828512||P99 Cmp 1.942188||Pct Diff 6.21685829789||P999 Base 1.828512||P999 Cmp 1.942188||Pct Diff 6.21685829789||P100 Base 107.821474||P100 Cmp 151.730304||Pct Diff 40.7236410068
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
Fuzzy1 60.35 (0.8%) 48.79 (16.4%) -19.2% ( -36% - -1%)
OrHighNotMed 599.07 (2.0%) 561.41 (1.3%) -6.3% ( -9% - -3%)
BrowseDayOfYearTaxoFacets 6016.54 (1.4%) 5641.68 (0.4%) -6.2% ( -7% - -4%)
BrowseMonthTaxoFacets 6317.66 (2.6%) 5941.75 (0.4%) -6.0% ( -8% - -2%)
Fuzzy2 41.62 (5.5%) 39.30 (6.5%) -5.6% ( -16% - 6%)
HighTerm 917.79 (0.2%) 871.87 (0.9%) -5.0% ( -6% - -3%)
OrHighLow 446.00 (3.1%) 428.85 (1.9%) -3.8% ( -8% - 1%)
OrHighNotLow 704.16 (0.4%) 681.31 (0.1%) -3.2% ( -3% - -2%)
HighSloppyPhrase 106.22 (0.3%) 103.18 (1.9%) -2.9% ( -5% - 0%)
IntNRQ 253.11 (1.1%) 246.67 (0.2%) -2.5% ( -3% - -1%)
LowTerm 1121.53 (3.0%) 1098.07 (4.3%) -2.1% ( -9% - 5%)
Wildcard 513.87 (6.6%) 508.44 (8.3%) -1.1% ( -14% - 14%)
MedPhrase 146.50 (0.9%) 146.15 (2.7%) -0.2% ( -3% - 3%)
OrHighNotHigh 609.97 (1.8%) 609.61 (1.6%) -0.1% ( -3% - 3%)
BrowseDateTaxoFacets 2.31 (0.8%) 2.31 (1.0%) 0.0% ( -1% - 1%)
HighPhrase 235.21 (1.0%) 235.37 (1.9%) 0.1% ( -2% - 3%)
OrNotHighHigh 525.50 (4.2%) 526.54 (5.5%) 0.2% ( -9% - 10%)
AndHighLow 782.19 (3.4%) 784.05 (2.7%) 0.2% ( -5% - 6%)
LowSpanNear 43.23 (0.7%) 43.47 (0.1%) 0.5% ( 0% - 1%)
AndHighHigh 196.59 (1.5%) 198.70 (2.1%) 1.1% ( -2% - 4%)
HighTermDayOfYearSort 254.11 (1.4%) 257.50 (7.4%) 1.3% ( -7% - 10%)
MedTerm 954.56 (2.8%) 967.46 (0.4%) 1.4% ( -1% - 4%)
OrNotHighLow 795.74 (4.1%) 806.95 (7.8%) 1.4% ( -10% - 13%)
PKLookup 90.90 (2.7%) 92.55 (0.4%) 1.8% ( -1% - 5%)
AndHighMed 301.97 (1.6%) 307.99 (7.8%) 2.0% ( -7% - 11%)
MedSpanNear 120.47 (3.6%) 123.34 (1.9%) 2.4% ( -2% - 8%)
Respell 61.77 (3.0%) 63.49 (0.8%) 2.8% ( -1% - 6%)
OrNotHighMed 657.52 (0.2%) 676.39 (1.0%) 2.9% ( 1% - 4%)
HighTermMonthSort 384.60 (7.6%) 402.03 (1.0%) 4.5% ( -3% - 14%)
LowSloppyPhrase 57.18 (2.4%) 59.78 (3.0%) 4.6% ( 0% - 10%)
Prefix3 69.31 (3.8%) 72.80 (0.9%) 5.0% ( 0% - 10%)
OrHighMed 294.70 (6.3%) 313.20 (0.3%) 6.3% ( 0% - 13%)
HighIntervalsOrdered 51.61 (6.9%) 55.27 (1.1%) 7.1% ( 0% - 16%)
LowPhrase 185.11 (3.7%) 201.54 (1.3%) 8.9% ( 3% - 14%)
OrHighHigh 53.49 (0.5%) 59.01 (0.3%) 10.3% ( 9% - 11%)
MedSloppyPhrase 113.02 (1.6%) 124.68 (2.5%) 10.3% ( 6% - 14%)
HighSpanNear 47.33 (14.8%) 54.76 (2.4%) 15.7% ( -1% - 38%)
BrowseMonthSSDVFacets 10.65 (0.4%) 13.00 (22.1%) 22.1% ( 0% - 44%)
BrowseDayOfYearSSDVFacets 7.94 (0.2%) 10.02 (25.5%) 26.2% ( 0% - 52%)
iter 2
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.2 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -6922547 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.2 -topN 10 -pk
20.9 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.2 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -6922547 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.2 -topN 10 -pk
21.3 s
Report after iter 2:
||Task ('Wildcard', None)||P50 Base 1.761025||P50 Cmp 1.958756||Pct Diff 11.2281767721||P90 Base 16.684465||P90 Cmp 19.912443||Pct Diff 19.3472071175||P99 Base 20.012324||P99 Cmp 20.504339||Pct Diff 2.45856003531||P999 Base 20.012324||P999 Cmp 20.504339||Pct Diff 2.45856003531||P100 Base 198.109018||P100 Cmp 176.224445||Pct Diff -11.0467323603
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 3.336063||P50 Cmp 3.403453||Pct Diff 2.02004578451||P90 Base 107.942438||P90 Cmp 72.197896||Pct Diff -33.1144475355||P99 Base 133.222216||P99 Cmp 95.922021||Pct Diff -27.9984796229||P999 Base 133.222216||P999 Cmp 95.922021||Pct Diff -27.9984796229||P100 Base 237.017475||P100 Cmp 125.897232||Pct Diff -46.8827216221
||Task ('MedSloppyPhrase', None)||P50 Base 8.229405||P50 Cmp 8.043519||Pct Diff -2.25880242861||P90 Base 12.44147||P90 Cmp 13.636714||Pct Diff 9.60693551485||P99 Base 13.238986||P99 Cmp 17.35215||Pct Diff 31.0685727744||P999 Base 13.238986||P999 Cmp 17.35215||Pct Diff 31.0685727744||P100 Base 17.075985||P100 Cmp 32.241219||Pct Diff 88.8103028903
||Task ('OrHighHigh', None)||P50 Base 17.217027||P50 Cmp 18.552755||Pct Diff 7.75818031766||P90 Base 35.875327||P90 Cmp 28.932667||Pct Diff -19.3521859745||P99 Base 58.191747||P99 Cmp 55.811086||Pct Diff -4.09106294747||P999 Base 58.191747||P999 Cmp 55.811086||Pct Diff -4.09106294747||P100 Base 63.670849||P100 Cmp 74.28735||Pct Diff 16.6740371249
||Task ('MedPhrase', None)||P50 Base 6.825391||P50 Cmp 6.641173||Pct Diff -2.69901021055||P90 Base 12.498159||P90 Cmp 12.472668||Pct Diff -0.20395803894||P99 Base 18.511301||P99 Cmp 21.413486||Pct Diff 15.6779094025||P999 Base 18.511301||P999 Cmp 21.413486||Pct Diff 15.6779094025||P100 Base 23.190692||P100 Cmp 28.404705||Pct Diff 22.4832143862
||Task ('LowSpanNear', None)||P50 Base 22.916035||P50 Cmp 22.996689||Pct Diff 0.351954428417||P90 Base 31.572812||P90 Cmp 30.057501||Pct Diff -4.79941729612||P99 Base 33.507276||P99 Cmp 34.401628||Pct Diff 2.66912774408||P999 Base 33.507276||P999 Cmp 34.401628||Pct Diff 2.66912774408||P100 Base 34.081651||P100 Cmp 35.176812||Pct Diff 3.21334491689
||Task ('Fuzzy2', None)||P50 Base 28.054459||P50 Cmp 26.344826||Pct Diff -6.09397957024||P90 Base 104.808763||P90 Cmp 103.573414||Pct Diff -1.17866957365||P99 Base 119.382809||P99 Cmp 119.342505||Pct Diff -0.0337603046348||P999 Base 119.382809||P999 Cmp 119.342505||Pct Diff -0.0337603046348||P100 Base 1043.981152||P100 Cmp 1062.87888||Pct Diff 1.81015988304
||Task ('OrNotHighHigh', None)||P50 Base 1.896336||P50 Cmp 1.884226||Pct Diff -0.638599910564||P90 Base 2.615376||P90 Cmp 2.351832||Pct Diff -10.0767155468||P99 Base 2.716932||P99 Cmp 3.107785||Pct Diff 14.3858219492||P999 Base 2.716932||P999 Cmp 3.107785||Pct Diff 14.3858219492||P100 Base 227.147402||P100 Cmp 151.669633||Pct Diff -33.2285416146
||Task ('OrHighNotLow', None)||P50 Base 1.488072||P50 Cmp 1.588897||Pct Diff 6.77554580692||P90 Base 2.158884||P90 Cmp 2.138236||Pct Diff -0.956420076299||P99 Base 3.516392||P99 Cmp 2.457501||Pct Diff -30.1129965032||P999 Base 3.516392||P999 Cmp 2.457501||Pct Diff -30.1129965032||P100 Base 6.035812||P100 Cmp 3.506606||Pct Diff -41.9033263461
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 66.135144||P50 Cmp 65.504509||Pct Diff -0.953555041779||P90 Base 80.046122||P90 Cmp 66.843051||Pct Diff -16.4943293568||P99 Base 107.433673||P99 Cmp 71.747578||Pct Diff -33.2168620913||P999 Base 107.433673||P999 Cmp 71.747578||Pct Diff -33.2168620913||P100 Base 122.488543||P100 Cmp 121.584403||Pct Diff -0.738142505295
||Task ('Fuzzy1', None)||P50 Base 15.980632||P50 Cmp 16.365073||Pct Diff 2.40566831149||P90 Base 54.65585||P90 Cmp 56.419269||Pct Diff 3.22640485877||P99 Base 63.812224||P99 Cmp 63.716638||Pct Diff -0.149792616537||P999 Base 63.812224||P999 Cmp 63.716638||Pct Diff -0.149792616537||P100 Base 129.885892||P100 Cmp 138.001359||Pct Diff 6.24815126188
||Task ('HighSloppyPhrase', None)||P50 Base 9.762317||P50 Cmp 9.858171||Pct Diff 0.981877560419||P90 Base 28.532621||P90 Cmp 24.325806||Pct Diff -14.7438785943||P99 Base 29.399104||P99 Cmp 33.03705||Pct Diff 12.3743431092||P999 Base 29.399104||P999 Cmp 33.03705||Pct Diff 12.3743431092||P100 Base 61.733158||P100 Cmp 63.355323||Pct Diff 2.62770454737
||Task ('OrNotHighMed', None)||P50 Base 1.583706||P50 Cmp 1.572037||Pct Diff -0.736816050454||P90 Base 7.194432||P90 Cmp 9.010494||Pct Diff 25.2426042806||P99 Base 8.10963||P99 Cmp 9.249775||Pct Diff 14.059149431||P999 Base 8.10963||P999 Cmp 9.249775||Pct Diff 14.059149431||P100 Base 53.44131||P100 Cmp 17.439015||Pct Diff -67.3679125755
||Task ('LowPhrase', None)||P50 Base 5.21707||P50 Cmp 5.066027||Pct Diff -2.8951691275||P90 Base 7.540529||P90 Cmp 7.723362||Pct Diff 2.42467073597||P99 Base 29.938263||P99 Cmp 7.81679||Pct Diff -73.8903021862||P999 Base 29.938263||P999 Cmp 7.81679||Pct Diff -73.8903021862||P100 Base 30.650534||P100 Cmp 30.242219||Pct Diff -1.33216276101
||Task ('AndHighLow', None)||P50 Base 1.439459||P50 Cmp 1.379143||Pct Diff -4.19018534046||P90 Base 2.148748||P90 Cmp 3.172114||Pct Diff 47.6261525316||P99 Base 3.325079||P99 Cmp 3.520889||Pct Diff 5.88888264008||P999 Base 3.325079||P999 Cmp 3.520889||Pct Diff 5.88888264008||P100 Base 3.458055||P100 Cmp 32.770755||Pct Diff 847.664366241
||Task ('LowTerm', None)||P50 Base 0.900026||P50 Cmp 0.857298||Pct Diff -4.74741840791||P90 Base 3.809439||P90 Cmp 1.511837||Pct Diff -60.313395227||P99 Base 10.247796||P99 Cmp 2.087689||Pct Diff -79.6279219454||P999 Base 10.247796||P999 Cmp 2.087689||Pct Diff -79.6279219454||P100 Base 17.04644||P100 Cmp 58.663684||Pct Diff 244.140383564
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 85.677584||P50 Cmp 85.308625||Pct Diff -0.4306365595||P90 Base 99.607373||P90 Cmp 94.323392||Pct Diff -5.30480911288||P99 Base 104.957564||P99 Cmp 105.488288||Pct Diff 0.505655790563||P999 Base 104.957564||P999 Cmp 105.488288||Pct Diff 0.505655790563||P100 Base 245.871408||P100 Cmp 273.824347||Pct Diff 11.3689262316
||Task ('AndHighHigh', None)||P50 Base 5.428878||P50 Cmp 4.916922||Pct Diff -9.43023586089||P90 Base 12.126372||P90 Cmp 8.489555||Pct Diff -29.9909733925||P99 Base 12.64131||P99 Cmp 12.085247||Pct Diff -4.39877670906||P999 Base 12.64131||P999 Cmp 12.085247||Pct Diff -4.39877670906||P100 Base 58.663098||P100 Cmp 183.561527||Pct Diff 212.908000529
||Task ('HighTermMonthSort', 'Month')||P50 Base 3.024976||P50 Cmp 2.96198||Pct Diff -2.08252891924||P90 Base 4.756706||P90 Cmp 4.60732||Pct Diff -3.1405346473||P99 Base 5.130484||P99 Cmp 6.419397||Pct Diff 25.1226395015||P999 Base 5.130484||P999 Cmp 6.419397||Pct Diff 25.1226395015||P100 Base 25.839347||P100 Cmp 35.543756||Pct Diff 37.5567114757
||Task Respell||P50 Base 16.762871||P50 Cmp 15.539761||Pct Diff -7.29654245982||P90 Base 43.119447||P90 Cmp 39.675526||Pct Diff -7.98693220718||P99 Base 259.320117||P99 Cmp 264.674732||Pct Diff 2.06486679936||P999 Base 259.320117||P999 Cmp 264.674732||Pct Diff 2.06486679936||P100 Base 323.955033||P100 Cmp 281.763012||Pct Diff -13.0240362711
||Task ('MedTerm', None)||P50 Base 1.14766||P50 Cmp 1.023095||Pct Diff -10.8538243034||P90 Base 2.308905||P90 Cmp 2.211727||Pct Diff -4.20883492391||P99 Base 2.644037||P99 Cmp 2.628708||Pct Diff -0.579757393713||P999 Base 2.644037||P999 Cmp 2.628708||Pct Diff -0.579757393713||P100 Base 7.843953||P100 Cmp 6.804116||Pct Diff -13.2565429701
||Task ('HighIntervalsOrdered', None)||P50 Base 18.005978||P50 Cmp 18.21279||Pct Diff 1.14857410133||P90 Base 24.520231||P90 Cmp 27.981482||Pct Diff 14.1158988266||P99 Base 29.331384||P99 Cmp 29.107462||Pct Diff -0.763421187353||P999 Base 29.331384||P999 Cmp 29.107462||Pct Diff -0.763421187353||P100 Base 63.683809||P100 Cmp 73.033168||Pct Diff 14.6809042154
||Task ('HighSpanNear', None)||P50 Base 18.354825||P50 Cmp 17.979286||Pct Diff -2.04599608005||P90 Base 24.776164||P90 Cmp 22.31506||Pct Diff -9.93335368623||P99 Base 27.997049||P99 Cmp 23.758904||Pct Diff -15.1378275618||P999 Base 27.997049||P999 Cmp 23.758904||Pct Diff -15.1378275618||P100 Base 30.516457||P100 Cmp 39.784708||Pct Diff 30.3713206287
||Task ('LowSloppyPhrase', None)||P50 Base 18.323568||P50 Cmp 16.539343||Pct Diff -9.73732299299||P90 Base 26.597343||P90 Cmp 31.061387||Pct Diff 16.7837967875||P99 Base 37.871701||P99 Cmp 35.99082||Pct Diff -4.96645503195||P999 Base 37.871701||P999 Cmp 35.99082||Pct Diff -4.96645503195||P100 Base 146.065958||P100 Cmp 130.059479||Pct Diff -10.95839114
||Task ('OrHighNotHigh', None)||P50 Base 1.820317||P50 Cmp 1.825245||Pct Diff 0.270722077528||P90 Base 9.606463||P90 Cmp 5.947205||Pct Diff -38.0916264394||P99 Base 45.811566||P99 Cmp 54.546215||Pct Diff 19.0664711178||P999 Base 45.811566||P999 Cmp 54.546215||Pct Diff 19.0664711178||P100 Base 102.854653||P100 Cmp 104.399618||Pct Diff 1.50208566646
||Task ('OrNotHighLow', None)||P50 Base 1.292419||P50 Cmp 1.194206||Pct Diff -7.59916095322||P90 Base 2.952065||P90 Cmp 2.938895||Pct Diff -0.446128388094||P99 Base 3.19541||P99 Cmp 3.147885||Pct Diff -1.48728958099||P999 Base 3.19541||P999 Cmp 3.147885||Pct Diff -1.48728958099||P100 Base 11.601884||P100 Cmp 8.376501||Pct Diff -27.8005106757
||Task ('MedSpanNear', None)||P50 Base 8.315267||P50 Cmp 8.136454||Pct Diff -2.15041802025||P90 Base 30.22059||P90 Cmp 26.764399||Pct Diff -11.4365437604||P99 Base 111.787149||P99 Cmp 117.806668||Pct Diff 5.38480411554||P999 Base 111.787149||P999 Cmp 117.806668||Pct Diff 5.38480411554||P100 Base 143.561572||P100 Cmp 128.389587||Pct Diff -10.5682772824
||Task ('BrowseDateTaxoFacets', None)||P50 Base 428.159701||P50 Cmp 428.992781||Pct Diff 0.194572258448||P90 Base 455.005077||P90 Cmp 440.012768||Pct Diff -3.29497620089||P99 Base 479.70755||P99 Cmp 447.567376||Pct Diff -6.69995166847||P999 Base 479.70755||P999 Cmp 447.567376||Pct Diff -6.69995166847||P100 Base 731.78654||P100 Cmp 762.968023||Pct Diff 4.26100799832
||Task ('HighPhrase', None)||P50 Base 4.10145||P50 Cmp 4.12548||Pct Diff 0.58589035585||P90 Base 62.851414||P90 Cmp 24.70848||Pct Diff -60.6874715659||P99 Base 68.873046||P99 Cmp 61.01636||Pct Diff -11.4074902394||P999 Base 68.873046||P999 Cmp 61.01636||Pct Diff -11.4074902394||P100 Base 354.406827||P100 Cmp 404.881912||Pct Diff 14.2421311201
||Task ('OrHighLow', None)||P50 Base 2.369665||P50 Cmp 2.269209||Pct Diff -4.23924900777||P90 Base 3.748949||P90 Cmp 8.232959||Pct Diff 119.607121889||P99 Base 5.454337||P99 Cmp 10.227848||Pct Diff 87.5177129686||P999 Base 5.454337||P999 Cmp 10.227848||Pct Diff 87.5177129686||P100 Base 24.265423||P100 Cmp 23.387913||Pct Diff -3.61629797263
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.177684||P50 Cmp 0.179224||Pct Diff 0.866707188042||P90 Base 0.203056||P90 Cmp 0.216361||Pct Diff 6.55237963911||P99 Base 0.229273||P99 Cmp 0.217911||Pct Diff -4.95566420817||P999 Base 0.229273||P999 Cmp 0.217911||Pct Diff -4.95566420817||P100 Base 18.959366||P100 Cmp 19.011736||Pct Diff 0.276222316717
||Task ('OrHighMed', None)||P50 Base 3.293735||P50 Cmp 3.159531||Pct Diff -4.07452329954||P90 Base 12.233798||P90 Cmp 6.958761||Pct Diff -43.1185556603||P99 Base 72.775863||P99 Cmp 12.299705||Pct Diff -83.0991973259||P999 Base 72.775863||P999 Cmp 12.299705||Pct Diff -83.0991973259||P100 Base 155.243622||P100 Cmp 71.515062||Pct Diff -53.9336553227
||Task ('IntNRQ', None)||P50 Base 4.069668||P50 Cmp 4.165969||Pct Diff 2.36631096198||P90 Base 12.714328||P90 Cmp 13.086415||Pct Diff 2.92651723316||P99 Base 45.661554||P99 Cmp 43.145206||Pct Diff -5.51086807076||P999 Base 45.661554||P999 Cmp 43.145206||Pct Diff -5.51086807076||P100 Base 214.126666||P100 Cmp 156.269461||Pct Diff -27.0200839908
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.174943||P50 Cmp 0.18437||Pct Diff 5.38861229086||P90 Base 0.195585||P90 Cmp 0.205409||Pct Diff 5.02288007772||P99 Base 0.198663||P99 Cmp 0.227337||Pct Diff 14.4334878664||P999 Base 0.198663||P999 Cmp 0.227337||Pct Diff 14.4334878664||P100 Base 0.317912||P100 Cmp 0.303298||Pct Diff -4.59686957397
||Task ('AndHighMed', None)||P50 Base 4.012226||P50 Cmp 3.080062||Pct Diff -23.2330880663||P90 Base 29.909541||P90 Cmp 22.529083||Pct Diff -24.6759320044||P99 Base 40.388369||P99 Cmp 27.188241||Pct Diff -32.6829934628||P999 Base 40.388369||P999 Cmp 27.188241||Pct Diff -32.6829934628||P100 Base 65.946014||P100 Cmp 41.364628||Pct Diff -37.2750140744
||Task ('OrHighNotMed', None)||P50 Base 1.790406||P50 Cmp 1.884002||Pct Diff 5.22764110487||P90 Base 8.76734||P90 Cmp 11.461083||Pct Diff 30.7247466164||P99 Base 22.126042||P99 Cmp 167.697484||Pct Diff 657.919034954||P999 Base 22.126042||P999 Cmp 167.697484||Pct Diff 657.919034954||P100 Base 290.438422||P100 Cmp 299.222783||Pct Diff 3.02451753439
||Task ('Prefix3', None)||P50 Base 14.163704||P50 Cmp 13.984334||Pct Diff -1.26640601922||P90 Base 22.950341||P90 Cmp 20.409049||Pct Diff -11.073003229||P99 Base 23.569384||P99 Cmp 21.860003||Pct Diff -7.2525484756||P999 Base 23.569384||P999 Cmp 21.860003||Pct Diff -7.2525484756||P100 Base 272.850425||P100 Cmp 195.966949||Pct Diff -28.1778839084
||Task PKLookup||P50 Base 11.085748||P50 Cmp 10.65563||Pct Diff -3.87991861262||P90 Base 79.154411||P90 Cmp 66.433542||Pct Diff -16.0709540243||P99 Base 133.680141||P99 Cmp 126.099332||Pct Diff -5.6708565261||P999 Base 133.680141||P999 Cmp 126.099332||Pct Diff -5.6708565261||P100 Base 262.836084||P100 Cmp 259.393963||Pct Diff -1.30960747384
||Task ('HighTerm', None)||P50 Base 1.217643||P50 Cmp 1.23403||Pct Diff 1.34579675652||P90 Base 1.479964||P90 Cmp 1.679488||Pct Diff 13.4816792841||P99 Base 1.78661||P99 Cmp 1.961013||Pct Diff 9.76167154555||P999 Base 1.78661||P999 Cmp 1.961013||Pct Diff 9.76167154555||P100 Base 12.609173||P100 Cmp 40.09178||Pct Diff 217.957252232
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
Fuzzy1 62.14 (4.1%) 54.29 (18.1%) -12.6% ( -33% - 9%)
OrHighNotMed 589.45 (2.8%) 558.94 (1.2%) -5.2% ( -8% - -1%)
OrHighNotLow 706.59 (0.6%) 672.96 (1.7%) -4.8% ( -6% - -2%)
BrowseMonthTaxoFacets 6131.75 (4.8%) 5850.68 (2.1%) -4.6% ( -11% - 2%)
HighTerm 898.27 (3.1%) 868.36 (0.9%) -3.3% ( -7% - 0%)
Fuzzy2 40.32 (6.5%) 38.98 (5.6%) -3.3% ( -14% - 9%)
Wildcard 535.16 (7.6%) 518.64 (7.1%) -3.1% ( -16% - 12%)
BrowseDayOfYearTaxoFacets 5911.82 (2.7%) 5732.48 (2.2%) -3.0% ( -7% - 1%)
HighSloppyPhrase 105.82 (0.6%) 103.56 (1.6%) -2.1% ( -4% - 0%)
IntNRQ 253.00 (0.9%) 248.17 (0.9%) -1.9% ( -3% - 0%)
OrHighLow 443.70 (2.7%) 436.70 (2.9%) -1.6% ( -6% - 4%)
HighTermDayOfYearSort 278.55 (12.5%) 275.69 (10.8%) -1.0% ( -21% - 25%)
HighPhrase 240.23 (3.1%) 238.72 (2.5%) -0.6% ( -5% - 5%)
OrHighNotHigh 602.93 (2.2%) 599.59 (2.7%) -0.6% ( -5% - 4%)
BrowseDateTaxoFacets 2.32 (0.9%) 2.32 (0.9%) -0.1% ( -1% - 1%)
LowTerm 1127.19 (2.5%) 1129.40 (5.3%) 0.2% ( -7% - 8%)
AndHighLow 770.14 (3.6%) 772.87 (3.0%) 0.4% ( -6% - 7%)
LowSpanNear 43.40 (0.8%) 43.57 (0.4%) 0.4% ( 0% - 1%)
MedPhrase 147.17 (1.0%) 147.86 (2.7%) 0.5% ( -3% - 4%)
OrNotHighHigh 532.61 (3.9%) 538.33 (5.4%) 1.1% ( -7% - 10%)
OrNotHighLow 811.12 (4.3%) 823.47 (6.9%) 1.5% ( -9% - 13%)
Respell 62.94 (3.5%) 64.24 (1.8%) 2.1% ( -3% - 7%)
MedSpanNear 120.81 (2.9%) 123.96 (1.7%) 2.6% ( -1% - 7%)
OrNotHighMed 650.41 (1.6%) 670.87 (1.5%) 3.1% ( 0% - 6%)
Prefix3 70.20 (3.5%) 72.42 (1.1%) 3.2% ( -1% - 8%)
PKLookup 90.74 (2.2%) 93.68 (1.8%) 3.2% ( 0% - 7%)
MedTerm 941.75 (3.0%) 972.70 (0.9%) 3.3% ( 0% - 7%)
AndHighHigh 192.92 (3.0%) 200.35 (2.1%) 3.9% ( -1% - 9%)
HighTermMonthSort 366.63 (9.5%) 382.31 (7.7%) 4.3% ( -11% - 23%)
HighIntervalsOrdered 52.94 (6.6%) 55.20 (0.9%) 4.3% ( -2% - 12%)
OrHighMed 299.93 (5.6%) 314.97 (0.9%) 5.0% ( -1% - 12%)
OrHighHigh 55.13 (4.2%) 58.40 (1.6%) 5.9% ( 0% - 12%)
LowSloppyPhrase 56.94 (2.0%) 60.78 (3.5%) 6.8% ( 1% - 12%)
AndHighMed 293.67 (4.2%) 314.30 (7.2%) 7.0% ( -4% - 19%)
MedSloppyPhrase 116.38 (4.3%) 124.99 (2.0%) 7.4% ( 1% - 14%)
LowPhrase 187.86 (3.6%) 201.97 (1.1%) 7.5% ( 2% - 12%)
HighSpanNear 49.93 (13.6%) 55.13 (2.2%) 10.4% ( -4% - 30%)
BrowseMonthSSDVFacets 12.14 (17.4%) 13.76 (18.1%) 13.4% ( -18% - 59%)
BrowseDayOfYearSSDVFacets 9.19 (19.2%) 10.61 (20.1%) 15.4% ( -20% - 67%)
iter 3
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.3 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -3929608 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.3 -topN 10 -pk
21.6 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.3 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -3929608 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.3 -topN 10 -pk
21.2 s
Report after iter 3:
||Task ('Wildcard', None)||P50 Base 1.756892||P50 Cmp 2.132977||Pct Diff 21.4062674314||P90 Base 14.501403||P90 Cmp 5.642445||Pct Diff -61.0903510509||P99 Base 20.828984||P99 Cmp 16.811744||Pct Diff -19.2867784622||P999 Base 20.828984||P999 Cmp 16.811744||Pct Diff -19.2867784622||P100 Base 158.33297||P100 Cmp 172.316234||Pct Diff 8.83155542399
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 3.423986||P50 Cmp 4.224826||Pct Diff 23.3891143246||P90 Base 21.008659||P90 Cmp 22.706913||Pct Diff 8.08359067564||P99 Base 76.637082||P99 Cmp 82.738033||Pct Diff 7.96083415598||P999 Base 76.637082||P999 Cmp 82.738033||Pct Diff 7.96083415598||P100 Base 108.583476||P100 Cmp 89.452664||Pct Diff -17.6185297291
||Task ('MedSloppyPhrase', None)||P50 Base 7.694078||P50 Cmp 8.287265||Pct Diff 7.70965669961||P90 Base 12.024474||P90 Cmp 11.918004||Pct Diff -0.885444136683||P99 Base 13.026483||P99 Cmp 18.954985||Pct Diff 45.5111483276||P999 Base 13.026483||P999 Cmp 18.954985||Pct Diff 45.5111483276||P100 Base 156.292655||P100 Cmp 222.051924||Pct Diff 42.0744461728
||Task ('OrHighHigh', None)||P50 Base 16.333387||P50 Cmp 17.235654||Pct Diff 5.52406552297||P90 Base 28.093079||P90 Cmp 28.933923||Pct Diff 2.99306459075||P99 Base 34.176561||P99 Cmp 32.493871||Pct Diff -4.92352053795||P999 Base 34.176561||P999 Cmp 32.493871||Pct Diff -4.92352053795||P100 Base 108.784403||P100 Cmp 64.112655||Pct Diff -41.0644787011
||Task ('MedPhrase', None)||P50 Base 6.715512||P50 Cmp 6.470772||Pct Diff -3.6443982231||P90 Base 12.498996||P90 Cmp 8.683829||Pct Diff -30.5237876706||P99 Base 28.067404||P99 Cmp 30.726727||Pct Diff 9.47477365559||P999 Base 28.067404||P999 Cmp 30.726727||Pct Diff 9.47477365559||P100 Base 45.549929||P100 Cmp 45.428193||Pct Diff -0.26725837487
||Task ('LowSpanNear', None)||P50 Base 22.012836||P50 Cmp 22.516321||Pct Diff 2.28723368493||P90 Base 29.070178||P90 Cmp 36.743587||Pct Diff 26.3961541618||P99 Base 34.99504||P99 Cmp 37.934194||Pct Diff 8.39877308327||P999 Base 34.99504||P999 Cmp 37.934194||Pct Diff 8.39877308327||P100 Base 156.671985||P100 Cmp 235.953436||Pct Diff 50.6034636633
||Task ('Fuzzy2', None)||P50 Base 31.392131||P50 Cmp 32.607041||Pct Diff 3.87010999667||P90 Base 105.152468||P90 Cmp 111.449934||Pct Diff 5.98889034159||P99 Base 231.05878||P99 Cmp 212.198027||Pct Diff -8.16275105408||P999 Base 231.05878||P999 Cmp 212.198027||Pct Diff -8.16275105408||P100 Base 235.432324||P100 Cmp 237.659171||Pct Diff 0.945854401879
||Task ('OrNotHighHigh', None)||P50 Base 1.864384||P50 Cmp 1.914481||Pct Diff 2.68705374||P90 Base 3.294092||P90 Cmp 2.678994||Pct Diff -18.6727632379||P99 Base 4.814994||P99 Cmp 3.955988||Pct Diff -17.8402299151||P999 Base 4.814994||P999 Cmp 3.955988||Pct Diff -17.8402299151||P100 Base 57.320149||P100 Cmp 55.713888||Pct Diff -2.80226242957
||Task ('OrHighNotLow', None)||P50 Base 1.535338||P50 Cmp 1.657767||Pct Diff 7.97407476399||P90 Base 2.758528||P90 Cmp 2.523565||Pct Diff -8.51769494455||P99 Base 3.053922||P99 Cmp 3.731594||Pct Diff 22.1902196585||P999 Base 3.053922||P999 Cmp 3.731594||Pct Diff 22.1902196585||P100 Base 72.662079||P100 Cmp 70.76188||Pct Diff -2.6151178526
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 65.757142||P50 Cmp 64.897126||Pct Diff -1.30786706028||P90 Base 69.838147||P90 Cmp 67.272459||Pct Diff -3.67376299374||P99 Base 75.993611||P99 Cmp 70.383822||Pct Diff -7.38192188288||P999 Base 75.993611||P999 Cmp 70.383822||Pct Diff -7.38192188288||P100 Base 123.58105||P100 Cmp 123.061445||Pct Diff -0.42045685807
||Task ('Fuzzy1', None)||P50 Base 15.150527||P50 Cmp 17.43204||Pct Diff 15.0589679158||P90 Base 147.601263||P90 Cmp 158.607585||Pct Diff 7.45679391646||P99 Base 161.925898||P99 Cmp 176.043419||Pct Diff 8.71850715319||P999 Base 161.925898||P999 Cmp 176.043419||Pct Diff 8.71850715319||P100 Base 457.715925||P100 Cmp 584.026746||Pct Diff 27.5958982638
||Task ('HighSloppyPhrase', None)||P50 Base 8.444076||P50 Cmp 8.5313||Pct Diff 1.03296085919||P90 Base 29.93352||P90 Cmp 30.751798||Pct Diff 2.73365110418||P99 Base 62.758494||P99 Cmp 64.617887||Pct Diff 2.96277504683||P999 Base 62.758494||P999 Cmp 64.617887||Pct Diff 2.96277504683||P100 Base 352.383524||P100 Cmp 374.38798||Pct Diff 6.24446221271
||Task ('OrNotHighMed', None)||P50 Base 1.539969||P50 Cmp 1.554063||Pct Diff 0.915213228318||P90 Base 7.007773||P90 Cmp 6.631158||Pct Diff -5.37424656877||P99 Base 14.520384||P99 Cmp 11.167339||Pct Diff -23.0919857216||P999 Base 14.520384||P999 Cmp 11.167339||Pct Diff -23.0919857216||P100 Base 59.659929||P100 Cmp 22.699474||Pct Diff -61.9518923665
||Task ('LowPhrase', None)||P50 Base 4.996881||P50 Cmp 5.130343||Pct Diff 2.67090611123||P90 Base 7.772988||P90 Cmp 7.727452||Pct Diff -0.585823624068||P99 Base 8.090443||P99 Cmp 9.81305||Pct Diff 21.2918748701||P999 Base 8.090443||P999 Cmp 9.81305||Pct Diff 21.2918748701||P100 Base 15.297293||P100 Cmp 30.614468||Pct Diff 100.129970708
||Task ('AndHighLow', None)||P50 Base 1.323207||P50 Cmp 1.246986||Pct Diff -5.76032321474||P90 Base 2.382775||P90 Cmp 1.813692||Pct Diff -23.8832034078||P99 Base 2.666286||P99 Cmp 2.24526||Pct Diff -15.7907291266||P999 Base 2.666286||P999 Cmp 2.24526||Pct Diff -15.7907291266||P100 Base 18.911422||P100 Cmp 27.668032||Pct Diff 46.3032869765
||Task ('LowTerm', None)||P50 Base 0.87273||P50 Cmp 0.903479||Pct Diff 3.52331190632||P90 Base 1.090532||P90 Cmp 2.223416||Pct Diff 103.883609101||P99 Base 1.700517||P99 Cmp 2.793609||Pct Diff 64.2799807353||P999 Base 1.700517||P999 Cmp 2.793609||Pct Diff 64.2799807353||P100 Base 22.101022||P100 Cmp 35.570366||Pct Diff 60.9444395829
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 82.855466||P50 Cmp 83.192603||Pct Diff 0.406897717527||P90 Base 91.551605||P90 Cmp 93.833297||Pct Diff 2.49224685903||P99 Base 119.210059||P99 Cmp 103.601615||Pct Diff -13.0932273089||P999 Base 119.210059||P999 Cmp 103.601615||Pct Diff -13.0932273089||P100 Base 234.359758||P100 Cmp 233.281315||Pct Diff -0.460165605735
||Task ('AndHighHigh', None)||P50 Base 4.770696||P50 Cmp 5.146629||Pct Diff 7.8800451758||P90 Base 36.221077||P90 Cmp 30.665605||Pct Diff -15.3376775627||P99 Base 41.284334||P99 Cmp 37.577742||Pct Diff -8.97820466233||P999 Base 41.284334||P999 Cmp 37.577742||Pct Diff -8.97820466233||P100 Base 111.819809||P100 Cmp 119.458237||Pct Diff 6.83101506639
||Task ('HighTermMonthSort', 'Month')||P50 Base 2.801068||P50 Cmp 2.684487||Pct Diff -4.16201962966||P90 Base 4.513031||P90 Cmp 3.361692||Pct Diff -25.5114356626||P99 Base 27.706354||P99 Cmp 3.961575||Pct Diff -85.7015650634||P999 Base 27.706354||P999 Cmp 3.961575||Pct Diff -85.7015650634||P100 Base 125.783258||P100 Cmp 200.479095||Pct Diff 59.3845621331
||Task Respell||P50 Base 16.398896||P50 Cmp 17.628613||Pct Diff 7.49877918611||P90 Base 95.239027||P90 Cmp 95.368772||Pct Diff 0.136230917185||P99 Base 171.088304||P99 Cmp 177.081249||Pct Diff 3.50283734182||P999 Base 171.088304||P999 Cmp 177.081249||Pct Diff 3.50283734182||P100 Base 254.987101||P100 Cmp 253.604027||Pct Diff -0.542409398191
||Task ('MedTerm', None)||P50 Base 1.057518||P50 Cmp 1.057978||Pct Diff 0.0434980775741||P90 Base 1.787649||P90 Cmp 2.026421||Pct Diff 13.3567607511||P99 Base 1.984315||P99 Cmp 2.037209||Pct Diff 2.66560500727||P999 Base 1.984315||P999 Cmp 2.037209||Pct Diff 2.66560500727||P100 Base 7.927375||P100 Cmp 7.965634||Pct Diff 0.482618773554
||Task ('HighIntervalsOrdered', None)||P50 Base 17.927865||P50 Cmp 17.403353||Pct Diff -2.92568021903||P90 Base 28.522412||P90 Cmp 26.253169||Pct Diff -7.95599965389||P99 Base 29.461052||P99 Cmp 28.238813||Pct Diff -4.14866040765||P999 Base 29.461052||P999 Cmp 28.238813||Pct Diff -4.14866040765||P100 Base 86.928758||P100 Cmp 73.05035||Pct Diff -15.9652666382
||Task ('HighSpanNear', None)||P50 Base 18.006471||P50 Cmp 18.568869||Pct Diff 3.12331050321||P90 Base 26.485057||P90 Cmp 27.762785||Pct Diff 4.8243354734||P99 Base 28.118094||P99 Cmp 28.177436||Pct Diff 0.211045599321||P999 Base 28.118094||P999 Cmp 28.177436||Pct Diff 0.211045599321||P100 Base 36.198441||P100 Cmp 28.940377||Pct Diff -20.0507640647
||Task ('LowSloppyPhrase', None)||P50 Base 15.02665||P50 Cmp 16.783608||Pct Diff 11.6922800491||P90 Base 24.485026||P90 Cmp 25.478317||Pct Diff 4.05672838575||P99 Base 24.665767||P99 Cmp 25.547594||Pct Diff 3.57510471902||P999 Base 24.665767||P999 Cmp 25.547594||Pct Diff 3.57510471902||P100 Base 40.064598||P100 Cmp 249.473513||Pct Diff 522.67818836
||Task ('OrHighNotHigh', None)||P50 Base 1.865029||P50 Cmp 1.765918||Pct Diff -5.31418010122||P90 Base 3.07265||P90 Cmp 3.236983||Pct Diff 5.34824988202||P99 Base 4.992011||P99 Cmp 4.795888||Pct Diff -3.92873733652||P999 Base 4.992011||P999 Cmp 4.795888||Pct Diff -3.92873733652||P100 Base 7.422254||P100 Cmp 7.954752||Pct Diff 7.174343535
||Task ('OrNotHighLow', None)||P50 Base 1.170548||P50 Cmp 1.287706||Pct Diff 10.0088163834||P90 Base 4.294668||P90 Cmp 4.470638||Pct Diff 4.09740636529||P99 Base 14.226642||P99 Cmp 10.962646||Pct Diff -22.9428420284||P999 Base 14.226642||P999 Cmp 10.962646||Pct Diff -22.9428420284||P100 Base 86.008293||P100 Cmp 98.577949||Pct Diff 14.614469793
||Task ('MedSpanNear', None)||P50 Base 7.987331||P50 Cmp 8.287628||Pct Diff 3.75966640171||P90 Base 9.748806||P90 Cmp 11.150007||Pct Diff 14.3730524538||P99 Base 11.610956||P99 Cmp 11.591652||Pct Diff -0.166256766454||P999 Base 11.610956||P999 Cmp 11.591652||Pct Diff -0.166256766454||P100 Base 14.809976||P100 Cmp 17.28367||Pct Diff 16.7028899979
||Task ('BrowseDateTaxoFacets', None)||P50 Base 444.758339||P50 Cmp 445.149244||Pct Diff 0.0878915504719||P90 Base 453.901914||P90 Cmp 458.578617||Pct Diff 1.03033339489||P99 Base 500.645336||P99 Cmp 468.720171||Pct Diff -6.37680263938||P999 Base 500.645336||P999 Cmp 468.720171||Pct Diff -6.37680263938||P100 Base 611.7817||P100 Cmp 641.587173||Pct Diff 4.87191313503
||Task ('HighPhrase', None)||P50 Base 4.346378||P50 Cmp 4.572054||Pct Diff 5.19227733989||P90 Base 92.596609||P90 Cmp 11.877062||Pct Diff -87.1733294251||P99 Base 213.714489||P99 Cmp 72.52951||Pct Diff -66.062427335||P999 Base 213.714489||P999 Cmp 72.52951||Pct Diff -66.062427335||P100 Base 236.178629||P100 Cmp 296.10213||Pct Diff 25.3721097687
||Task ('OrHighLow', None)||P50 Base 2.176705||P50 Cmp 2.615621||Pct Diff 20.1642390678||P90 Base 3.890943||P90 Cmp 5.1147||Pct Diff 31.4514245004||P99 Base 12.832426||P99 Cmp 12.979788||Pct Diff 1.14835651497||P999 Base 12.832426||P999 Cmp 12.979788||Pct Diff 1.14835651497||P100 Base 13.153525||P100 Cmp 70.8929||Pct Diff 438.965030287
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.170314||P50 Cmp 0.176019||Pct Diff 3.34969526874||P90 Base 0.239387||P90 Cmp 0.198082||Pct Diff -17.2544875035||P99 Base 0.276329||P99 Cmp 0.204549||Pct Diff -25.9762818959||P999 Base 0.276329||P999 Cmp 0.204549||Pct Diff -25.9762818959||P100 Base 24.230139||P100 Cmp 25.391156||Pct Diff 4.791623358
||Task ('OrHighMed', None)||P50 Base 3.14798||P50 Cmp 3.122954||Pct Diff -0.794985991016||P90 Base 8.542589||P90 Cmp 7.834624||Pct Diff -8.28747584602||P99 Base 14.795316||P99 Cmp 13.834651||Pct Diff -6.49303468746||P999 Base 14.795316||P999 Cmp 13.834651||Pct Diff -6.49303468746||P100 Base 295.87437||P100 Cmp 256.619481||Pct Diff -13.2674178571
||Task ('IntNRQ', None)||P50 Base 3.785345||P50 Cmp 3.82563||Pct Diff 1.06423588867||P90 Base 13.054227||P90 Cmp 12.216608||Pct Diff -6.41645805608||P99 Base 69.735681||P99 Cmp 72.378678||Pct Diff 3.7900210654||P999 Base 69.735681||P999 Cmp 72.378678||Pct Diff 3.7900210654||P100 Base 175.946488||P100 Cmp 159.562007||Pct Diff -9.31219553527
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.16897||P50 Cmp 0.176331||Pct Diff 4.35639462627||P90 Base 0.22909||P90 Cmp 0.229039||Pct Diff -0.0222619931031||P99 Base 0.233886||P99 Cmp 0.263779||Pct Diff 12.7810129721||P999 Base 0.233886||P999 Cmp 0.263779||Pct Diff 12.7810129721||P100 Base 0.551228||P100 Cmp 0.553018||Pct Diff 0.324729513015
||Task ('AndHighMed', None)||P50 Base 3.091435||P50 Cmp 3.446293||Pct Diff 11.478746925||P90 Base 5.015802||P90 Cmp 4.964876||Pct Diff -1.01531121045||P99 Base 11.173311||P99 Cmp 12.567324||Pct Diff 12.4762749377||P999 Base 11.173311||P999 Cmp 12.567324||Pct Diff 12.4762749377||P100 Base 96.185052||P100 Cmp 129.434602||Pct Diff 34.568313172
||Task ('OrHighNotMed', None)||P50 Base 1.794881||P50 Cmp 1.915363||Pct Diff 6.71253414572||P90 Base 3.402799||P90 Cmp 4.930034||Pct Diff 44.8817282478||P99 Base 8.204192||P99 Cmp 8.286318||Pct Diff 1.00102484193||P999 Base 8.204192||P999 Cmp 8.286318||Pct Diff 1.00102484193||P100 Base 289.017248||P100 Cmp 293.90517||Pct Diff 1.69122155644
||Task ('Prefix3', None)||P50 Base 13.397601||P50 Cmp 14.090945||Pct Diff 5.17513545895||P90 Base 16.655429||P90 Cmp 23.784805||Pct Diff 42.8051177787||P99 Base 146.535438||P99 Cmp 158.881559||Pct Diff 8.4253482765||P999 Base 146.535438||P999 Cmp 158.881559||Pct Diff 8.4253482765||P100 Base 371.304468||P100 Cmp 413.392947||Pct Diff 11.33530098
||Task PKLookup||P50 Base 10.435038||P50 Cmp 10.924179||Pct Diff 4.68748652377||P90 Base 12.083125||P90 Cmp 61.793028||Pct Diff 411.399393783||P99 Base 157.876318||P99 Cmp 136.665061||Pct Diff -13.435363371||P999 Base 157.876318||P999 Cmp 136.665061||Pct Diff -13.435363371||P100 Base 497.276611||P100 Cmp 500.739856||Pct Diff 0.696442366963
||Task ('HighTerm', None)||P50 Base 1.077266||P50 Cmp 1.27425||Pct Diff 18.2855487874||P90 Base 2.832682||P90 Cmp 2.001313||Pct Diff -29.3491821532||P99 Base 4.649883||P99 Cmp 4.60892||Pct Diff -0.880946896943||P999 Base 4.649883||P999 Cmp 4.60892||Pct Diff -0.880946896943||P100 Base 252.553473||P100 Cmp 151.810734||Pct Diff -39.8896668509
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
Fuzzy1 63.73 (5.5%) 56.88 (16.8%) -10.7% ( -31% - 12%)
HighTermDayOfYearSort 288.90 (12.1%) 268.49 (10.0%) -7.1% ( -25% - 17%)
Wildcard 543.94 (7.1%) 508.89 (6.8%) -6.4% ( -18% - 7%)
OrHighNotLow 709.97 (1.0%) 666.53 (2.1%) -6.1% ( -9% - -3%)
OrHighLow 452.89 (4.2%) 428.38 (4.0%) -5.4% ( -13% - 2%)
HighTerm 907.46 (3.2%) 861.07 (1.6%) -5.1% ( -9% - 0%)
OrHighNotMed 592.82 (2.6%) 563.94 (1.8%) -4.9% ( -9% - 0%)
BrowseMonthTaxoFacets 6131.73 (4.2%) 5903.41 (2.4%) -3.7% ( -9% - 2%)
Fuzzy2 39.34 (7.2%) 37.92 (6.8%) -3.6% ( -16% - 11%)
BrowseDayOfYearTaxoFacets 5955.89 (2.7%) 5741.18 (1.9%) -3.6% ( -7% - 1%)
HighSloppyPhrase 109.05 (5.2%) 107.17 (5.9%) -1.7% ( -12% - 9%)
OrNotHighLow 828.37 (5.1%) 815.03 (6.1%) -1.6% ( -12% - 10%)
IntNRQ 256.19 (2.3%) 253.45 (3.6%) -1.1% ( -6% - 4%)
MedTerm 985.49 (8.1%) 975.54 (0.9%) -1.0% ( -9% - 8%)
LowTerm 1134.36 (2.4%) 1127.88 (4.5%) -0.6% ( -7% - 6%)
LowSpanNear 43.99 (2.4%) 43.78 (0.9%) -0.5% ( -3% - 2%)
HighPhrase 238.13 (3.1%) 237.63 (2.3%) -0.2% ( -5% - 5%)
OrNotHighHigh 542.42 (4.6%) 541.90 (4.8%) -0.1% ( -9% - 9%)
BrowseDateTaxoFacets 2.30 (1.5%) 2.30 (1.5%) -0.1% ( -3% - 3%)
OrHighNotHigh 592.34 (3.7%) 594.06 (2.9%) 0.3% ( -6% - 7%)
Respell 62.95 (3.1%) 63.46 (2.7%) 0.8% ( -4% - 6%)
Prefix3 71.35 (4.1%) 72.10 (1.2%) 1.0% ( -4% - 6%)
MedPhrase 148.07 (1.3%) 149.69 (3.2%) 1.1% ( -3% - 5%)
MedSpanNear 122.03 (3.1%) 123.45 (1.6%) 1.2% ( -3% - 6%)
AndHighHigh 197.51 (4.7%) 199.88 (1.8%) 1.2% ( -5% - 8%)
PKLookup 92.07 (3.1%) 93.17 (1.8%) 1.2% ( -3% - 6%)
AndHighLow 771.26 (3.1%) 782.44 (3.4%) 1.5% ( -4% - 8%)
LowSloppyPhrase 59.45 (7.5%) 60.42 (3.1%) 1.6% ( -8% - 13%)
OrNotHighMed 658.00 (2.4%) 669.72 (1.3%) 1.8% ( -1% - 5%)
OrHighHigh 56.91 (6.5%) 58.32 (1.3%) 2.5% ( -5% - 11%)
OrHighMed 305.92 (5.9%) 317.56 (1.6%) 3.8% ( -3% - 12%)
HighIntervalsOrdered 53.72 (6.1%) 55.82 (2.1%) 3.9% ( -4% - 12%)
AndHighMed 301.79 (5.9%) 313.80 (6.1%) 4.0% ( -7% - 16%)
MedSloppyPhrase 120.12 (6.5%) 125.23 (1.7%) 4.3% ( -3% - 13%)
LowPhrase 191.31 (4.4%) 200.22 (1.8%) 4.7% ( -1% - 11%)
HighSpanNear 51.41 (12.5%) 54.99 (1.9%) 7.0% ( -6% - 24%)
HighTermMonthSort 365.34 (8.3%) 392.29 (8.2%) 7.4% ( -8% - 25%)
BrowseMonthSSDVFacets 12.95 (17.8%) 14.17 (15.7%) 9.5% ( -20% - 52%)
BrowseDayOfYearSSDVFacets 9.91 (20.0%) 10.98 (17.4%) 10.7% ( -22% - 60%)
iter 4
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.4 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -5048033 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.4 -topN 10 -pk
22.9 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.4 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -5048033 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.4 -topN 10 -pk
22.4 s
Report after iter 4:
||Task ('Wildcard', None)||P50 Base 1.792479||P50 Cmp 1.87949||Pct Diff 4.85422702302||P90 Base 14.837217||P90 Cmp 16.627839||Pct Diff 12.0684492247||P99 Base 51.740867||P99 Cmp 40.907399||Pct Diff -20.9379328723||P999 Base 51.740867||P999 Cmp 40.907399||Pct Diff -20.9379328723||P100 Base 278.228952||P100 Cmp 194.59299||Pct Diff -30.0601218525
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 3.384978||P50 Cmp 3.112672||Pct Diff -8.0445426824||P90 Base 7.356295||P90 Cmp 8.12685||Pct Diff 10.4747702478||P99 Base 82.697122||P99 Cmp 83.613742||Pct Diff 1.10840616678||P999 Base 82.697122||P999 Cmp 83.613742||Pct Diff 1.10840616678||P100 Base 137.660938||P100 Cmp 116.129752||Pct Diff -15.6407375344
||Task ('MedSloppyPhrase', None)||P50 Base 8.327251||P50 Cmp 7.715263||Pct Diff -7.34922004873||P90 Base 11.494135||P90 Cmp 8.236834||Pct Diff -28.3388093145||P99 Base 11.735992||P99 Cmp 10.999646||Pct Diff -6.27425444734||P999 Base 11.735992||P999 Cmp 10.999646||Pct Diff -6.27425444734||P100 Base 155.649968||P100 Cmp 96.489701||Pct Diff -38.0085314248
||Task ('OrHighHigh', None)||P50 Base 16.771782||P50 Cmp 16.881116||Pct Diff 0.651892565739||P90 Base 28.423746||P90 Cmp 28.762942||Pct Diff 1.1933543172||P99 Base 40.8227||P99 Cmp 40.663644||Pct Diff -0.389626359844||P999 Base 40.8227||P999 Cmp 40.663644||Pct Diff -0.389626359844||P100 Base 138.683716||P100 Cmp 201.187629||Pct Diff 45.0693958907
||Task ('MedPhrase', None)||P50 Base 6.565491||P50 Cmp 6.856853||Pct Diff 4.43777929175||P90 Base 38.812794||P90 Cmp 16.896269||Pct Diff -56.4672695297||P99 Base 82.909801||P99 Cmp 40.310726||Pct Diff -51.3800232134||P999 Base 82.909801||P999 Cmp 40.310726||Pct Diff -51.3800232134||P100 Base 178.028204||P100 Cmp 203.190946||Pct Diff 14.1341323648
||Task ('LowSpanNear', None)||P50 Base 23.25486||P50 Cmp 22.829017||Pct Diff -1.83120001582||P90 Base 38.216293||P90 Cmp 35.69589||Pct Diff -6.59510068127||P99 Base 40.427788||P99 Cmp 43.449278||Pct Diff 7.47379500456||P999 Base 40.427788||P999 Cmp 43.449278||Pct Diff 7.47379500456||P100 Base 81.065287||P100 Cmp 74.590018||Pct Diff -7.98772105747
||Task ('Fuzzy2', None)||P50 Base 22.552183||P50 Cmp 26.761081||Pct Diff 18.6629294379||P90 Base 102.478003||P90 Cmp 189.617584||Pct Diff 85.0324737495||P99 Base 164.754741||P99 Cmp 196.933172||Pct Diff 19.5311107921||P999 Base 164.754741||P999 Cmp 196.933172||Pct Diff 19.5311107921||P100 Base 265.672553||P100 Cmp 334.788734||Pct Diff 26.015551934
||Task ('OrNotHighHigh', None)||P50 Base 1.922578||P50 Cmp 1.83914||Pct Diff -4.33990194416||P90 Base 3.30239||P90 Cmp 2.814424||Pct Diff -14.7761469723||P99 Base 4.911656||P99 Cmp 3.546022||Pct Diff -27.8039422956||P999 Base 4.911656||P999 Cmp 3.546022||Pct Diff -27.8039422956||P100 Base 18.946431||P100 Cmp 4.151294||Pct Diff -78.0893087463
||Task ('OrHighNotLow', None)||P50 Base 1.693104||P50 Cmp 1.712825||Pct Diff 1.16478373449||P90 Base 3.755778||P90 Cmp 3.029969||Pct Diff -19.3251305056||P99 Base 9.160918||P99 Cmp 3.286659||Pct Diff -64.123038761||P999 Base 9.160918||P999 Cmp 3.286659||Pct Diff -64.123038761||P100 Base 36.483268||P100 Cmp 17.64721||Pct Diff -51.6293057957
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 94.438756||P50 Cmp 94.929174||Pct Diff 0.519297395235||P90 Base 98.404375||P90 Cmp 104.065375||Pct Diff 5.75279300336||P99 Base 115.919984||P99 Cmp 118.229929||Pct Diff 1.99270645172||P999 Base 115.919984||P999 Cmp 118.229929||Pct Diff 1.99270645172||P100 Base 124.433983||P100 Cmp 123.104113||Pct Diff -1.06873537914
||Task ('Fuzzy1', None)||P50 Base 17.710037||P50 Cmp 21.351457||Pct Diff 20.5613347956||P90 Base 160.021584||P90 Cmp 149.053247||Pct Diff -6.85428598182||P99 Base 184.22212||P99 Cmp 273.709867||Pct Diff 48.5760054222||P999 Base 184.22212||P999 Cmp 273.709867||Pct Diff 48.5760054222||P100 Base 495.452308||P100 Cmp 394.965778||Pct Diff -20.2817765459
||Task ('HighSloppyPhrase', None)||P50 Base 8.817818||P50 Cmp 8.701993||Pct Diff -1.31353357486||P90 Base 11.737791||P90 Cmp 15.090083||Pct Diff 28.559820157||P99 Base 16.063891||P99 Cmp 18.428995||Pct Diff 14.7231078697||P999 Base 16.063891||P999 Cmp 18.428995||Pct Diff 14.7231078697||P100 Base 20.769664||P100 Cmp 30.003893||Pct Diff 44.4601751863
||Task ('OrNotHighMed', None)||P50 Base 1.554227||P50 Cmp 1.574813||Pct Diff 1.32451694637||P90 Base 3.90194||P90 Cmp 2.383111||Pct Diff -38.9249706556||P99 Base 4.602837||P99 Cmp 6.47858||Pct Diff 40.7518884549||P999 Base 4.602837||P999 Cmp 6.47858||Pct Diff 40.7518884549||P100 Base 94.423837||P100 Cmp 69.667766||Pct Diff -26.2180311525
||Task ('LowPhrase', None)||P50 Base 4.89349||P50 Cmp 5.382896||Pct Diff 10.0011648128||P90 Base 7.308805||P90 Cmp 7.765651||Pct Diff 6.25062510219||P99 Base 7.471831||P99 Cmp 7.864251||Pct Diff 5.25199245004||P999 Base 7.471831||P999 Cmp 7.864251||Pct Diff 5.25199245004||P100 Base 7.8945||P100 Cmp 14.341095||Pct Diff 81.6593197796
||Task ('AndHighLow', None)||P50 Base 1.322431||P50 Cmp 1.373834||Pct Diff 3.88700809343||P90 Base 2.160215||P90 Cmp 2.022669||Pct Diff -6.36723659451||P99 Base 5.307524||P99 Cmp 9.095847||Pct Diff 71.3764648073||P999 Base 5.307524||P999 Cmp 9.095847||Pct Diff 71.3764648073||P100 Base 54.954134||P100 Cmp 54.714859||Pct Diff -0.435408553613
||Task ('LowTerm', None)||P50 Base 0.933165||P50 Cmp 0.942292||Pct Diff 0.97806925892||P90 Base 1.917416||P90 Cmp 1.147523||Pct Diff -40.1526325012||P99 Base 21.117185||P99 Cmp 21.429989||Pct Diff 1.48127697892||P999 Base 21.117185||P999 Cmp 21.429989||Pct Diff 1.48127697892||P100 Base 43.135554||P100 Cmp 42.519872||Pct Diff -1.42731909737
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 126.739029||P50 Cmp 125.487318||Pct Diff -0.987628680665||P90 Base 130.365464||P90 Cmp 128.090292||Pct Diff -1.7452260209||P99 Base 137.677331||P99 Cmp 134.439565||Pct Diff -2.35170596095||P999 Base 137.677331||P999 Cmp 134.439565||Pct Diff -2.35170596095||P100 Base 332.37843||P100 Cmp 318.86157||Pct Diff -4.0667079389
||Task ('AndHighHigh', None)||P50 Base 4.878065||P50 Cmp 5.292926||Pct Diff 8.50462222213||P90 Base 7.046774||P90 Cmp 11.071541||Pct Diff 57.1150288061||P99 Base 11.864913||P99 Cmp 12.957359||Pct Diff 9.20736629084||P999 Base 11.864913||P999 Cmp 12.957359||Pct Diff 9.20736629084||P100 Base 139.418836||P100 Cmp 153.338508||Pct Diff 9.98406843678
||Task ('HighTermMonthSort', 'Month')||P50 Base 3.122049||P50 Cmp 4.798094||Pct Diff 53.6841350024||P90 Base 5.064382||P90 Cmp 8.724153||Pct Diff 72.2649081369||P99 Base 19.104867||P99 Cmp 19.545038||Pct Diff 2.30397311847||P999 Base 19.104867||P999 Cmp 19.545038||Pct Diff 2.30397311847||P100 Base 27.784||P100 Cmp 22.857773||Pct Diff -17.7304455802
||Task Respell||P50 Base 16.747728||P50 Cmp 16.672358||Pct Diff -0.450031192291||P90 Base 41.509553||P90 Cmp 31.349827||Pct Diff -24.475633356||P99 Base 172.797325||P99 Cmp 258.022182||Pct Diff 49.320703894||P999 Base 172.797325||P999 Cmp 258.022182||Pct Diff 49.320703894||P100 Base 251.510647||P100 Cmp 410.803029||Pct Diff 63.3342500208
||Task ('MedTerm', None)||P50 Base 1.104709||P50 Cmp 1.16082||Pct Diff 5.0792561661||P90 Base 3.122864||P90 Cmp 1.979222||Pct Diff -36.6215755793||P99 Base 3.844652||P99 Cmp 3.697844||Pct Diff -3.81849904751||P999 Base 3.844652||P999 Cmp 3.697844||Pct Diff -3.81849904751||P100 Base 4.262042||P100 Cmp 43.293393||Pct Diff 915.78991948
||Task ('HighIntervalsOrdered', None)||P50 Base 17.660603||P50 Cmp 17.969779||Pct Diff 1.75065370078||P90 Base 28.607566||P90 Cmp 23.613728||Pct Diff -17.4563540289||P99 Base 29.930671||P99 Cmp 29.857439||Pct Diff -0.244672095724||P999 Base 29.930671||P999 Cmp 29.857439||Pct Diff -0.244672095724||P100 Base 85.403132||P100 Cmp 91.843986||Pct Diff 7.54170701843
||Task ('HighSpanNear', None)||P50 Base 18.200658||P50 Cmp 18.088518||Pct Diff -0.616131570628||P90 Base 19.479055||P90 Cmp 29.276618||Pct Diff 50.2979379646||P99 Base 29.97452||P99 Cmp 37.905264||Pct Diff 26.4582852369||P999 Base 29.97452||P999 Cmp 37.905264||Pct Diff 26.4582852369||P100 Base 81.519337||P100 Cmp 81.996093||Pct Diff 0.584837926246
||Task ('LowSloppyPhrase', None)||P50 Base 14.689315||P50 Cmp 14.771263||Pct Diff 0.557874890694||P90 Base 24.823381||P90 Cmp 24.023257||Pct Diff -3.2232676121||P99 Base 26.993268||P99 Cmp 24.631515||Pct Diff -8.7494148541||P999 Base 26.993268||P999 Cmp 24.631515||Pct Diff -8.7494148541||P100 Base 424.090168||P100 Cmp 577.384606||Pct Diff 36.1466616222
||Task ('OrHighNotHigh', None)||P50 Base 1.819968||P50 Cmp 1.876067||Pct Diff 3.0824168337||P90 Base 15.454877||P90 Cmp 9.877435||Pct Diff -36.0885563826||P99 Base 41.543704||P99 Cmp 39.006571||Pct Diff -6.10714201122||P999 Base 41.543704||P999 Cmp 39.006571||Pct Diff -6.10714201122||P100 Base 286.091884||P100 Cmp 295.21697||Pct Diff 3.18956479031
||Task ('OrNotHighLow', None)||P50 Base 1.281303||P50 Cmp 1.284228||Pct Diff 0.228283239796||P90 Base 3.371467||P90 Cmp 2.55649||Pct Diff -24.1727710815||P99 Base 5.956815||P99 Cmp 22.46722||Pct Diff 277.168335763||P999 Base 5.956815||P999 Cmp 22.46722||Pct Diff 277.168335763||P100 Base 257.279726||P100 Cmp 331.709843||Pct Diff 28.929647181
||Task ('MedSpanNear', None)||P50 Base 8.310693||P50 Cmp 8.096429||Pct Diff -2.57817248213||P90 Base 14.957392||P90 Cmp 115.907602||Pct Diff 674.918528578||P99 Base 16.820605||P99 Cmp 188.362651||Pct Diff 1019.83279436||P999 Base 16.820605||P999 Cmp 188.362651||Pct Diff 1019.83279436||P100 Base 196.673437||P100 Cmp 201.498437||Pct Diff 2.45330537443
||Task ('BrowseDateTaxoFacets', None)||P50 Base 429.16798||P50 Cmp 434.007634||Pct Diff 1.127682918||P90 Base 443.524874||P90 Cmp 454.128064||Pct Diff 2.39066411414||P99 Base 456.947542||P99 Cmp 454.412016||Pct Diff -0.554883387468||P999 Base 456.947542||P999 Cmp 454.412016||Pct Diff -0.554883387468||P100 Base 617.451071||P100 Cmp 529.900088||Pct Diff -14.1794203803
||Task ('HighPhrase', None)||P50 Base 4.035578||P50 Cmp 4.386532||Pct Diff 8.69649898974||P90 Base 5.914167||P90 Cmp 5.456566||Pct Diff -7.73737028393||P99 Base 45.577124||P99 Cmp 10.31796||Pct Diff -77.361537775||P999 Base 45.577124||P999 Cmp 10.31796||Pct Diff -77.361537775||P100 Base 74.892127||P100 Cmp 52.446941||Pct Diff -29.9700207473
||Task ('OrHighLow', None)||P50 Base 2.704083||P50 Cmp 2.296833||Pct Diff -15.0605584222||P90 Base 22.416513||P90 Cmp 21.75432||Pct Diff -2.95404106785||P99 Base 49.011223||P99 Cmp 23.589034||Pct Diff -51.8701379886||P999 Base 49.011223||P999 Cmp 23.589034||Pct Diff -51.8701379886||P100 Base 233.613182||P100 Cmp 201.366667||Pct Diff -13.8033798966
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.170433||P50 Cmp 0.169229||Pct Diff -0.706435960172||P90 Base 0.211647||P90 Cmp 0.2045||Pct Diff -3.37684918756||P99 Base 0.29375||P99 Cmp 0.238105||Pct Diff -18.9429787234||P999 Base 0.29375||P999 Cmp 0.238105||Pct Diff -18.9429787234||P100 Base 0.514981||P100 Cmp 0.543085||Pct Diff 5.45728871551
||Task ('OrHighMed', None)||P50 Base 3.036054||P50 Cmp 3.361158||Pct Diff 10.7081099348||P90 Base 4.744306||P90 Cmp 4.518291||Pct Diff -4.76392121419||P99 Base 5.229564||P99 Cmp 10.018823||Pct Diff 91.5804644517||P999 Base 5.229564||P999 Cmp 10.018823||Pct Diff 91.5804644517||P100 Base 147.382372||P100 Cmp 74.066152||Pct Diff -49.7455828707
||Task ('IntNRQ', None)||P50 Base 4.072346||P50 Cmp 4.066421||Pct Diff -0.145493531247||P90 Base 85.299661||P90 Cmp 48.034386||Pct Diff -43.6874831191||P99 Base 101.461115||P99 Cmp 103.995062||Pct Diff 2.49745629151||P999 Base 101.461115||P999 Cmp 103.995062||Pct Diff 2.49745629151||P100 Base 186.418301||P100 Cmp 215.22933||Pct Diff 15.4550432256
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.174758||P50 Cmp 0.177842||Pct Diff 1.76472607835||P90 Base 0.209261||P90 Cmp 0.218831||Pct Diff 4.57323629343||P99 Base 0.262725||P99 Cmp 0.240893||Pct Diff -8.30982966981||P999 Base 0.262725||P999 Cmp 0.240893||Pct Diff -8.30982966981||P100 Base 31.674699||P100 Cmp 30.535921||Pct Diff -3.59522911331
||Task ('AndHighMed', None)||P50 Base 3.134253||P50 Cmp 3.151888||Pct Diff 0.562654004||P90 Base 6.704166||P90 Cmp 8.255104||Pct Diff 23.1339438791||P99 Base 7.13778||P99 Cmp 19.792721||Pct Diff 177.295195425||P999 Base 7.13778||P999 Cmp 19.792721||Pct Diff 177.295195425||P100 Base 133.334835||P100 Cmp 88.812628||Pct Diff -33.3912791807
||Task ('OrHighNotMed', None)||P50 Base 1.87694||P50 Cmp 1.981199||Pct Diff 5.55473270323||P90 Base 22.348397||P90 Cmp 23.101241||Pct Diff 3.36867114004||P99 Base 78.21118||P99 Cmp 113.422292||Pct Diff 45.0205609991||P999 Base 78.21118||P999 Cmp 113.422292||Pct Diff 45.0205609991||P100 Base 212.116293||P100 Cmp 219.779784||Pct Diff 3.61287239731
||Task ('Prefix3', None)||P50 Base 14.921896||P50 Cmp 15.352026||Pct Diff 2.88254254017||P90 Base 17.626678||P90 Cmp 25.836104||Pct Diff 46.5738694495||P99 Base 293.001238||P99 Cmp 235.444135||Pct Diff -19.6439794565||P999 Base 293.001238||P999 Cmp 235.444135||Pct Diff -19.6439794565||P100 Base 390.179287||P100 Cmp 398.550559||Pct Diff 2.14549369454
||Task PKLookup||P50 Base 10.999919||P50 Cmp 11.124378||Pct Diff 1.13145378616||P90 Base 11.640477||P90 Cmp 50.320547||Pct Diff 332.289389859||P99 Base 60.537684||P99 Cmp 61.53133||Pct Diff 1.64136771403||P999 Base 60.537684||P999 Cmp 61.53133||Pct Diff 1.64136771403||P100 Base 356.741205||P100 Cmp 373.158894||Pct Diff 4.60212859347
||Task ('HighTerm', None)||P50 Base 1.146715||P50 Cmp 1.178463||Pct Diff 2.76860423034||P90 Base 1.833835||P90 Cmp 1.962712||Pct Diff 7.02773150256||P99 Base 4.040744||P99 Cmp 4.141391||Pct Diff 2.49080367378||P999 Base 4.040744||P999 Cmp 4.141391||Pct Diff 2.49080367378||P100 Base 98.211821||P100 Cmp 216.699746||Pct Diff 120.645278535
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
Fuzzy1 62.63 (6.1%) 56.61 (15.3%) -9.6% ( -29% - 12%)
Wildcard 547.84 (6.5%) 517.76 (6.8%) -5.5% ( -17% - 8%)
Fuzzy2 40.59 (8.7%) 38.43 (6.4%) -5.3% ( -18% - 10%)
OrHighNotLow 688.38 (6.3%) 654.19 (4.1%) -5.0% ( -14% - 5%)
OrHighNotMed 588.43 (2.8%) 559.25 (2.3%) -5.0% ( -9% - 0%)
HighTerm 904.13 (2.9%) 859.64 (1.5%) -4.9% ( -9% - 0%)
BrowseMonthTaxoFacets 6101.55 (3.9%) 5863.03 (2.5%) -3.9% ( -9% - 2%)
HighTermDayOfYearSort 291.25 (10.9%) 279.86 (11.8%) -3.9% ( -23% - 21%)
BrowseDayOfYearTaxoFacets 6007.94 (2.9%) 5833.91 (3.5%) -2.9% ( -9% - 3%)
OrHighLow 444.09 (5.5%) 431.48 (3.9%) -2.8% ( -11% - 6%)
OrNotHighLow 832.54 (4.7%) 814.65 (5.4%) -2.1% ( -11% - 8%)
HighPhrase 240.38 (3.3%) 236.01 (2.4%) -1.8% ( -7% - 4%)
OrHighNotHigh 590.46 (3.3%) 582.71 (4.6%) -1.3% ( -8% - 6%)
IntNRQ 255.45 (2.1%) 252.59 (3.3%) -1.1% ( -6% - 4%)
HighSloppyPhrase 109.97 (4.9%) 109.13 (6.3%) -0.8% ( -11% - 10%)
MedTerm 971.55 (7.9%) 965.22 (2.3%) -0.7% ( -10% - 10%)
BrowseDateTaxoFacets 2.31 (1.4%) 2.30 (1.4%) -0.3% ( -3% - 2%)
HighTermMonthSort 356.76 (9.0%) 355.90 (21.7%) -0.2% ( -28% - 33%)
AndHighHigh 199.21 (4.5%) 199.05 (1.8%) -0.1% ( -6% - 6%)
OrNotHighMed 670.85 (4.4%) 670.50 (1.2%) -0.1% ( -5% - 5%)
LowSpanNear 43.81 (2.3%) 43.83 (0.8%) 0.0% ( -3% - 3%)
LowTerm 1127.86 (2.5%) 1128.87 (4.1%) 0.1% ( -6% - 6%)
Respell 63.05 (2.8%) 63.15 (2.6%) 0.2% ( -5% - 5%)
Prefix3 70.52 (4.4%) 70.71 (4.1%) 0.3% ( -7% - 9%)
AndHighLow 774.33 (2.9%) 777.15 (3.3%) 0.4% ( -5% - 6%)
MedPhrase 149.47 (2.2%) 150.25 (2.9%) 0.5% ( -4% - 5%)
OrNotHighHigh 542.74 (4.1%) 546.61 (4.6%) 0.7% ( -7% - 9%)
PKLookup 91.84 (2.8%) 92.55 (2.1%) 0.8% ( -4% - 5%)
MedSpanNear 122.12 (2.7%) 123.59 (1.5%) 1.2% ( -2% - 5%)
LowSloppyPhrase 61.20 (8.7%) 62.02 (5.9%) 1.4% ( -12% - 17%)
LowPhrase 194.83 (5.3%) 198.19 (2.6%) 1.7% ( -5% - 10%)
OrHighMed 311.95 (6.4%) 317.44 (1.4%) 1.8% ( -5% - 10%)
OrHighHigh 57.53 (6.1%) 58.58 (1.5%) 1.8% ( -5% - 10%)
HighIntervalsOrdered 54.31 (5.8%) 55.80 (1.9%) 2.8% ( -4% - 11%)
AndHighMed 305.65 (5.8%) 314.82 (5.4%) 3.0% ( -7% - 15%)
MedSloppyPhrase 121.61 (6.2%) 126.20 (2.2%) 3.8% ( -4% - 13%)
HighSpanNear 52.14 (11.4%) 55.07 (1.7%) 5.6% ( -6% - 21%)
BrowseMonthSSDVFacets 12.48 (18.1%) 13.46 (18.6%) 7.8% ( -24% - 54%)
BrowseDayOfYearSSDVFacets 9.51 (20.4%) 10.38 (20.6%) 9.1% ( -26% - 62%)
iter 5
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.5 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -2553130 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.5 -topN 10 -pk
21.3 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.5 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -2553130 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.5 -topN 10 -pk
21.4 s
Report after iter 5:
||Task ('Wildcard', None)||P50 Base 2.322613||P50 Cmp 2.169938||Pct Diff -6.57341537312||P90 Base 22.40689||P90 Cmp 16.16963||Pct Diff -27.8363485517||P99 Base 67.308701||P99 Cmp 21.014925||Pct Diff -68.7782936117||P999 Base 67.308701||P999 Cmp 21.014925||Pct Diff -68.7782936117||P100 Base 93.551481||P100 Cmp 191.390209||Pct Diff 104.582767642
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 3.31381||P50 Cmp 4.184837||Pct Diff 26.2847598384||P90 Base 14.11718||P90 Cmp 6.928367||Pct Diff -50.9224434342||P99 Base 90.73146||P99 Cmp 94.270729||Pct Diff 3.90081786406||P999 Base 90.73146||P999 Cmp 94.270729||Pct Diff 3.90081786406||P100 Base 111.98027||P100 Cmp 107.935511||Pct Diff -3.61202826176
||Task ('MedSloppyPhrase', None)||P50 Base 8.202111||P50 Cmp 7.592194||Pct Diff -7.43609785335||P90 Base 12.490482||P90 Cmp 11.872087||Pct Diff -4.95092983601||P99 Base 12.583674||P99 Cmp 16.643959||Pct Diff 32.2662920225||P999 Base 12.583674||P999 Cmp 16.643959||Pct Diff 32.2662920225||P100 Base 83.079267||P100 Cmp 78.90778||Pct Diff -5.0210926873
||Task ('OrHighHigh', None)||P50 Base 16.930848||P50 Cmp 16.92584||Pct Diff -0.0295791445296||P90 Base 29.553871||P90 Cmp 27.734178||Pct Diff -6.15720695269||P99 Base 29.707737||P99 Cmp 32.781891||Pct Diff 10.3479911647||P999 Base 29.707737||P999 Cmp 32.781891||Pct Diff 10.3479911647||P100 Base 45.897972||P100 Cmp 39.962725||Pct Diff -12.9313926986
||Task ('MedPhrase', None)||P50 Base 6.314413||P50 Cmp 6.196485||Pct Diff -1.86760036127||P90 Base 7.797815||P90 Cmp 9.367203||Pct Diff 20.1259968337||P99 Base 8.063841||P99 Cmp 9.893136||Pct Diff 22.6851571106||P999 Base 8.063841||P999 Cmp 9.893136||Pct Diff 22.6851571106||P100 Base 318.70385||P100 Cmp 241.326624||Pct Diff -24.2787233352
||Task ('LowSpanNear', None)||P50 Base 22.939024||P50 Cmp 23.047385||Pct Diff 0.472387142539||P90 Base 32.798016||P90 Cmp 34.844139||Pct Diff 6.23855723468||P99 Base 32.983112||P99 Cmp 35.342991||Pct Diff 7.15481001308||P999 Base 32.983112||P999 Cmp 35.342991||Pct Diff 7.15481001308||P100 Base 36.328006||P100 Cmp 35.732234||Pct Diff -1.63997990971
||Task ('Fuzzy2', None)||P50 Base 34.821148||P50 Cmp 31.565633||Pct Diff -9.34924661301||P90 Base 104.173101||P90 Cmp 102.651779||Pct Diff -1.46037891298||P99 Base 158.505513||P99 Cmp 154.882781||Pct Diff -2.28555583426||P999 Base 158.505513||P999 Cmp 154.882781||Pct Diff -2.28555583426||P100 Base 345.752298||P100 Cmp 618.834645||Pct Diff 78.9820772211
||Task ('OrNotHighHigh', None)||P50 Base 1.814924||P50 Cmp 1.776132||Pct Diff -2.137389775||P90 Base 4.802614||P90 Cmp 8.01419||Pct Diff 66.8714162746||P99 Base 13.49077||P99 Cmp 10.610488||Pct Diff -21.3500193095||P999 Base 13.49077||P999 Cmp 10.610488||Pct Diff -21.3500193095||P100 Base 218.926247||P100 Cmp 32.209325||Pct Diff -85.2875909392
||Task ('OrHighNotLow', None)||P50 Base 1.632872||P50 Cmp 1.380721||Pct Diff -15.4421779539||P90 Base 2.778753||P90 Cmp 2.75262||Pct Diff -0.940457824067||P99 Base 2.857225||P99 Cmp 8.309504||Pct Diff 190.824278802||P999 Base 2.857225||P999 Cmp 8.309504||Pct Diff 190.824278802||P100 Base 8.369918||P100 Cmp 11.121991||Pct Diff 32.8805252333
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 65.003084||P50 Cmp 65.06457||Pct Diff 0.0945893582526||P90 Base 84.248222||P90 Cmp 83.538548||Pct Diff -0.842360803769||P99 Base 129.510203||P99 Cmp 130.412877||Pct Diff 0.696990645594||P999 Base 129.510203||P999 Cmp 130.412877||Pct Diff 0.696990645594||P100 Base 152.813412||P100 Cmp 154.015424||Pct Diff 0.786588025402
||Task ('Fuzzy1', None)||P50 Base 18.282353||P50 Cmp 18.163526||Pct Diff -0.649954631113||P90 Base 96.715734||P90 Cmp 101.175856||Pct Diff 4.6115785049||P99 Base 145.553102||P99 Cmp 149.558635||Pct Diff 2.7519392888||P999 Base 145.553102||P999 Cmp 149.558635||Pct Diff 2.7519392888||P100 Base 159.08468||P100 Cmp 153.12775||Pct Diff -3.74450261333
||Task ('HighSloppyPhrase', None)||P50 Base 9.944823||P50 Cmp 8.703007||Pct Diff -12.4870598501||P90 Base 13.266208||P90 Cmp 10.621173||Pct Diff -19.9381390673||P99 Base 14.926729||P99 Cmp 10.981052||Pct Diff -26.4336345893||P999 Base 14.926729||P999 Cmp 10.981052||Pct Diff -26.4336345893||P100 Base 24.307675||P100 Cmp 11.804014||Pct Diff -51.4391483348
||Task ('OrNotHighMed', None)||P50 Base 1.508237||P50 Cmp 1.425006||Pct Diff -5.51842979585||P90 Base 2.709588||P90 Cmp 5.017277||Pct Diff 85.1675236235||P99 Base 8.768029||P99 Cmp 21.212873||Pct Diff 141.934338949||P999 Base 8.768029||P999 Cmp 21.212873||Pct Diff 141.934338949||P100 Base 12.803768||P100 Cmp 23.965693||Pct Diff 87.1768763695
||Task ('LowPhrase', None)||P50 Base 5.285808||P50 Cmp 6.635229||Pct Diff 25.5291338618||P90 Base 14.712701||P90 Cmp 9.704124||Pct Diff -34.042539164||P99 Base 30.87264||P99 Cmp 25.318757||Pct Diff -17.9896601003||P999 Base 30.87264||P999 Cmp 25.318757||Pct Diff -17.9896601003||P100 Base 94.9873||P100 Cmp 262.296992||Pct Diff 176.139012268
||Task ('AndHighLow', None)||P50 Base 1.367991||P50 Cmp 1.238509||Pct Diff -9.46512075006||P90 Base 2.739103||P90 Cmp 3.092423||Pct Diff 12.8991133229||P99 Base 3.172217||P99 Cmp 30.007765||Pct Diff 845.955620312||P999 Base 3.172217||P999 Cmp 30.007765||Pct Diff 845.955620312||P100 Base 290.75068||P100 Cmp 287.694382||Pct Diff -1.05117484162
||Task ('LowTerm', None)||P50 Base 0.893824||P50 Cmp 0.833578||Pct Diff -6.74025311471||P90 Base 4.171105||P90 Cmp 3.969702||Pct Diff -4.82852865128||P99 Base 5.547239||P99 Cmp 5.432198||Pct Diff -2.07384250075||P999 Base 5.547239||P999 Cmp 5.432198||Pct Diff -2.07384250075||P100 Base 22.183222||P100 Cmp 22.507628||Pct Diff 1.46239351524
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 82.537963||P50 Cmp 82.638155||Pct Diff 0.121388990421||P90 Base 104.296012||P90 Cmp 91.485733||Pct Diff -12.2826163286||P99 Base 115.38635||P99 Cmp 114.600393||Pct Diff -0.681152493341||P999 Base 115.38635||P999 Cmp 114.600393||Pct Diff -0.681152493341||P100 Base 207.329165||P100 Cmp 207.630179||Pct Diff 0.145186520189
||Task ('AndHighHigh', None)||P50 Base 5.216284||P50 Cmp 5.155042||Pct Diff -1.17405417343||P90 Base 5.574189||P90 Cmp 6.227791||Pct Diff 11.7255084103||P99 Base 5.651887||P99 Cmp 7.020169||Pct Diff 24.2092950549||P999 Base 5.651887||P999 Cmp 7.020169||Pct Diff 24.2092950549||P100 Base 286.11694||P100 Cmp 313.464884||Pct Diff 9.55830996934
||Task ('HighTermMonthSort', 'Month')||P50 Base 3.236519||P50 Cmp 3.092223||Pct Diff -4.45837024284||P90 Base 5.096677||P90 Cmp 24.450627||Pct Diff 379.736640168||P99 Base 21.670532||P99 Cmp 30.729744||Pct Diff 41.804289807||P999 Base 21.670532||P999 Cmp 30.729744||Pct Diff 41.804289807||P100 Base 32.963423||P100 Cmp 33.795926||Pct Diff 2.52553565205
||Task Respell||P50 Base 16.264584||P50 Cmp 15.07729||Pct Diff -7.29987314769||P90 Base 39.701477||P90 Cmp 38.982623||Pct Diff -1.81064800184||P99 Base 217.653297||P99 Cmp 216.572124||Pct Diff -0.496740924627||P999 Base 217.653297||P999 Cmp 216.572124||Pct Diff -0.496740924627||P100 Base 252.133828||P100 Cmp 249.607794||Pct Diff -1.0018623919
||Task ('MedTerm', None)||P50 Base 1.007883||P50 Cmp 0.999755||Pct Diff -0.806442811318||P90 Base 1.37765||P90 Cmp 1.329864||Pct Diff -3.46866039996||P99 Base 1.834294||P99 Cmp 1.548759||Pct Diff -15.5664795284||P999 Base 1.834294||P999 Cmp 1.548759||Pct Diff -15.5664795284||P100 Base 63.060322||P100 Cmp 41.394494||Pct Diff -34.3573063265
||Task ('HighIntervalsOrdered', None)||P50 Base 18.173338||P50 Cmp 17.659516||Pct Diff -2.82733969951||P90 Base 37.064857||P90 Cmp 34.527213||Pct Diff -6.84649612974||P99 Base 70.886423||P99 Cmp 73.465498||Pct Diff 3.6383201336||P999 Base 70.886423||P999 Cmp 73.465498||Pct Diff 3.6383201336||P100 Base 78.650399||P100 Cmp 81.597178||Pct Diff 3.74668029338
||Task ('HighSpanNear', None)||P50 Base 17.97782||P50 Cmp 17.698784||Pct Diff -1.55211254757||P90 Base 25.739491||P90 Cmp 27.527568||Pct Diff 6.94682346283||P99 Base 27.839563||P99 Cmp 29.080579||Pct Diff 4.45774238626||P999 Base 27.839563||P999 Cmp 29.080579||Pct Diff 4.45774238626||P100 Base 72.310856||P100 Cmp 29.793209||Pct Diff -58.7984285513
||Task ('LowSloppyPhrase', None)||P50 Base 17.416366||P50 Cmp 15.794003||Pct Diff -9.31516367995||P90 Base 25.130184||P90 Cmp 25.085389||Pct Diff -0.178251778817||P99 Base 55.326031||P99 Cmp 57.463547||Pct Diff 3.86349058728||P999 Base 55.326031||P999 Cmp 57.463547||Pct Diff 3.86349058728||P100 Base 121.540007||P100 Cmp 174.533891||Pct Diff 43.6020083494
||Task ('OrHighNotHigh', None)||P50 Base 1.788985||P50 Cmp 1.64901||Pct Diff -7.82426906877||P90 Base 6.718123||P90 Cmp 5.921961||Pct Diff -11.8509589658||P99 Base 7.562539||P99 Cmp 10.784092||Pct Diff 42.5988282507||P999 Base 7.562539||P999 Cmp 10.784092||Pct Diff 42.5988282507||P100 Base 53.185941||P100 Cmp 58.65702||Pct Diff 10.2867015176
||Task ('OrNotHighLow', None)||P50 Base 1.327846||P50 Cmp 1.170398||Pct Diff -11.8573991261||P90 Base 2.767128||P90 Cmp 2.932361||Pct Diff 5.97128141524||P99 Base 4.157988||P99 Cmp 4.205691||Pct Diff 1.14726160826||P999 Base 4.157988||P999 Cmp 4.205691||Pct Diff 1.14726160826||P100 Base 27.793239||P100 Cmp 11.592266||Pct Diff -58.2910577641
||Task ('MedSpanNear', None)||P50 Base 8.462385||P50 Cmp 8.22016||Pct Diff -2.86237272353||P90 Base 11.374051||P90 Cmp 12.989835||Pct Diff 14.2058796817||P99 Base 12.069364||P99 Cmp 14.303511||Pct Diff 18.5108925375||P999 Base 12.069364||P999 Cmp 14.303511||Pct Diff 18.5108925375||P100 Base 461.626871||P100 Cmp 315.172593||Pct Diff -31.7256830571
||Task ('BrowseDateTaxoFacets', None)||P50 Base 429.078366||P50 Cmp 429.874691||Pct Diff 0.185589641217||P90 Base 448.767547||P90 Cmp 446.097882||Pct Diff -0.594888159326||P99 Base 482.290039||P99 Cmp 447.157282||Pct Diff -7.28457031226||P999 Base 482.290039||P999 Cmp 447.157282||Pct Diff -7.28457031226||P100 Base 595.990955||P100 Cmp 542.446878||Pct Diff -8.9840418803
||Task ('HighPhrase', None)||P50 Base 4.072865||P50 Cmp 3.988732||Pct Diff -2.06569576944||P90 Base 15.409802||P90 Cmp 15.105297||Pct Diff -1.97604745343||P99 Base 41.472552||P99 Cmp 41.480104||Pct Diff 0.0182096341696||P999 Base 41.472552||P999 Cmp 41.480104||Pct Diff 0.0182096341696||P100 Base 102.278007||P100 Cmp 100.019374||Pct Diff -2.20832715287
||Task ('OrHighLow', None)||P50 Base 2.330694||P50 Cmp 2.231125||Pct Diff -4.27207518447||P90 Base 6.647042||P90 Cmp 6.109867||Pct Diff -8.08141425915||P99 Base 9.203413||P99 Cmp 12.155958||Pct Diff 32.080979089||P999 Base 9.203413||P999 Cmp 12.155958||Pct Diff 32.080979089||P100 Base 115.669912||P100 Cmp 135.338141||Pct Diff 17.0037554796
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.154936||P50 Cmp 0.178255||Pct Diff 15.0507306243||P90 Base 0.203042||P90 Cmp 0.221386||Pct Diff 9.0345839777||P99 Base 0.204392||P99 Cmp 0.250006||Pct Diff 22.3169204274||P999 Base 0.204392||P999 Cmp 0.250006||Pct Diff 22.3169204274||P100 Base 8.56196||P100 Cmp 8.877857||Pct Diff 3.68954071264
||Task ('OrHighMed', None)||P50 Base 3.115771||P50 Cmp 3.066609||Pct Diff -1.57784381458||P90 Base 22.746141||P90 Cmp 22.927813||Pct Diff 0.798693721278||P99 Base 23.937352||P99 Cmp 29.986459||Pct Diff 25.2705771298||P999 Base 23.937352||P999 Cmp 29.986459||Pct Diff 25.2705771298||P100 Base 44.545198||P100 Cmp 206.592964||Pct Diff 363.782794276
||Task ('IntNRQ', None)||P50 Base 3.924612||P50 Cmp 3.836809||Pct Diff -2.23724026732||P90 Base 14.756589||P90 Cmp 12.456218||Pct Diff -15.5887719039||P99 Base 83.567873||P99 Cmp 69.467954||Pct Diff -16.8724157907||P999 Base 83.567873||P999 Cmp 69.467954||Pct Diff -16.8724157907||P100 Base 89.640793||P100 Cmp 72.312308||Pct Diff -19.3310259984
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.162101||P50 Cmp 0.172329||Pct Diff 6.30964645499||P90 Base 0.194366||P90 Cmp 0.269758||Pct Diff 38.788677032||P99 Base 0.337639||P99 Cmp 22.872153||Pct Diff 6674.14427836||P999 Base 0.337639||P999 Cmp 22.872153||Pct Diff 6674.14427836||P100 Base 14.466002||P100 Cmp 23.988539||Pct Diff 65.8270128817
||Task ('AndHighMed', None)||P50 Base 3.314097||P50 Cmp 3.380123||Pct Diff 1.99227723268||P90 Base 4.381392||P90 Cmp 4.250437||Pct Diff -2.98889028875||P99 Base 8.312251||P99 Cmp 8.10277||Pct Diff -2.52014767119||P999 Base 8.312251||P999 Cmp 8.10277||Pct Diff -2.52014767119||P100 Base 54.508967||P100 Cmp 53.3003||Pct Diff -2.21737278566
||Task ('OrHighNotMed', None)||P50 Base 1.828542||P50 Cmp 1.619953||Pct Diff -11.4073945253||P90 Base 10.944944||P90 Cmp 7.770353||Pct Diff -29.0050913006||P99 Base 13.484144||P99 Cmp 15.127585||Pct Diff 12.1879520124||P999 Base 13.484144||P999 Cmp 15.127585||Pct Diff 12.1879520124||P100 Base 73.849316||P100 Cmp 65.220675||Pct Diff -11.6841176972
||Task ('Prefix3', None)||P50 Base 14.726838||P50 Cmp 14.371613||Pct Diff -2.41209280634||P90 Base 124.185699||P90 Cmp 135.572006||Pct Diff 9.16877473951||P99 Base 370.487538||P99 Cmp 342.436003||Pct Diff -7.57151918022||P999 Base 370.487538||P999 Cmp 342.436003||Pct Diff -7.57151918022||P100 Base 471.974378||P100 Cmp 377.925865||Pct Diff -19.9266141095
||Task PKLookup||P50 Base 10.567311||P50 Cmp 10.391473||Pct Diff -1.66398055286||P90 Base 70.108886||P90 Cmp 59.166349||Pct Diff -15.6079173758||P99 Base 212.392609||P99 Cmp 173.126008||Pct Diff -18.4877436107||P999 Base 212.392609||P999 Cmp 173.126008||Pct Diff -18.4877436107||P100 Base 664.680066||P100 Cmp 895.314375||Pct Diff 34.6985445777
||Task ('HighTerm', None)||P50 Base 1.173504||P50 Cmp 1.137592||Pct Diff -3.06023669284||P90 Base 1.730495||P90 Cmp 1.487236||Pct Diff -14.0571917284||P99 Base 18.026644||P99 Cmp 16.864626||Pct Diff -6.44611387455||P999 Base 18.026644||P999 Cmp 16.864626||Pct Diff -6.44611387455||P100 Base 22.272079||P100 Cmp 31.140732||Pct Diff 39.819601035
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
Fuzzy1 61.99 (6.1%) 58.08 (15.1%) -6.3% ( -25% - 15%)
Wildcard 538.71 (7.1%) 510.36 (7.0%) -5.3% ( -18% - 9%)
BrowseDayOfYearTaxoFacets 6083.93 (3.9%) 5804.74 (3.3%) -4.6% ( -11% - 2%)
HighTerm 899.89 (2.9%) 866.71 (2.2%) -3.7% ( -8% - 1%)
BrowseMonthTaxoFacets 6121.50 (3.6%) 5913.78 (2.9%) -3.4% ( -9% - 3%)
HighTermDayOfYearSort 293.14 (10.0%) 283.98 (11.2%) -3.1% ( -22% - 19%)
OrHighNotMed 594.29 (3.4%) 578.78 (7.6%) -2.6% ( -13% - 8%)
LowPhrase 194.95 (4.8%) 190.25 (9.4%) -2.4% ( -15% - 12%)
OrHighNotLow 678.98 (6.6%) 669.77 (6.4%) -1.4% ( -13% - 12%)
OrNotHighLow 830.35 (4.3%) 822.86 (5.4%) -0.9% ( -10% - 9%)
OrHighLow 442.66 (5.1%) 438.98 (5.2%) -0.8% ( -10% - 9%)
HighPhrase 242.51 (3.6%) 240.85 (5.0%) -0.7% ( -8% - 8%)
IntNRQ 256.00 (2.0%) 254.39 (3.4%) -0.6% ( -5% - 4%)
BrowseDateTaxoFacets 2.31 (1.4%) 2.31 (1.3%) -0.2% ( -2% - 2%)
OrHighNotHigh 591.39 (3.1%) 590.59 (5.2%) -0.1% ( -8% - 8%)
LowSpanNear 43.90 (2.2%) 43.86 (0.8%) -0.1% ( -2% - 2%)
MedTerm 977.80 (7.3%) 978.29 (3.6%) 0.1% ( -10% - 11%)
OrNotHighHigh 550.70 (4.9%) 551.15 (4.5%) 0.1% ( -8% - 9%)
AndHighHigh 198.23 (4.3%) 198.43 (1.8%) 0.1% ( -5% - 6%)
HighTermMonthSort 349.37 (9.6%) 350.27 (20.6%) 0.3% ( -27% - 33%)
MedPhrase 151.48 (3.6%) 152.17 (3.9%) 0.5% ( -6% - 8%)
Fuzzy2 38.70 (13.8%) 38.98 (6.9%) 0.7% ( -17% - 24%)
Prefix3 70.10 (4.2%) 70.63 (3.8%) 0.8% ( -6% - 9%)
MedSpanNear 122.01 (2.5%) 123.62 (1.3%) 1.3% ( -2% - 5%)
OrNotHighMed 676.46 (4.4%) 685.71 (5.1%) 1.4% ( -7% - 11%)
Respell 62.93 (2.6%) 63.91 (3.6%) 1.6% ( -4% - 7%)
HighSloppyPhrase 108.54 (5.4%) 110.25 (6.3%) 1.6% ( -9% - 13%)
LowTerm 1131.72 (2.4%) 1150.42 (5.7%) 1.7% ( -6% - 9%)
OrHighHigh 57.85 (5.7%) 58.89 (1.8%) 1.8% ( -5% - 9%)
OrHighMed 314.52 (6.1%) 320.27 (2.4%) 1.8% ( -6% - 11%)
PKLookup 92.31 (2.8%) 94.01 (4.0%) 1.8% ( -4% - 8%)
AndHighLow 772.79 (2.7%) 787.79 (4.3%) 1.9% ( -4% - 9%)
AndHighMed 305.93 (5.3%) 312.52 (5.2%) 2.2% ( -7% - 13%)
HighIntervalsOrdered 54.71 (5.6%) 55.95 (1.8%) 2.3% ( -4% - 10%)
LowSloppyPhrase 60.93 (8.0%) 62.67 (5.9%) 2.8% ( -10% - 18%)
MedSloppyPhrase 121.68 (5.7%) 127.25 (2.8%) 4.6% ( -3% - 13%)
HighSpanNear 52.79 (10.6%) 55.38 (2.0%) 4.9% ( -6% - 19%)
BrowseMonthSSDVFacets 12.98 (18.0%) 13.79 (17.3%) 6.3% ( -24% - 50%)
BrowseDayOfYearSSDVFacets 9.95 (20.4%) 10.66 (19.1%) 7.2% ( -26% - 58%)
iter 6
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.6 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -7920588 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.6 -topN 10 -pk
22.3 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.6 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -7920588 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.6 -topN 10 -pk
22.4 s
Report after iter 6:
||Task ('Wildcard', None)||P50 Base 2.009165||P50 Cmp 2.065814||Pct Diff 2.81952950604||P90 Base 14.13146||P90 Cmp 21.307506||Pct Diff 50.7806412076||P99 Base 81.108174||P99 Cmp 80.180972||Pct Diff -1.1431671486||P999 Base 81.108174||P999 Cmp 80.180972||Pct Diff -1.1431671486||P100 Base 159.775652||P100 Cmp 127.822492||Pct Diff -19.9987667708
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 3.871972||P50 Cmp 4.341981||Pct Diff 12.1387499703||P90 Base 100.348654||P90 Cmp 99.0168||Pct Diff -1.32722657147||P99 Base 106.760198||P99 Cmp 137.223709||Pct Diff 28.5345208895||P999 Base 106.760198||P999 Cmp 137.223709||Pct Diff 28.5345208895||P100 Base 130.777374||P100 Cmp 161.200562||Pct Diff 23.2633421742
||Task ('MedSloppyPhrase', None)||P50 Base 8.582685||P50 Cmp 8.072373||Pct Diff -5.9458316366||P90 Base 13.611036||P90 Cmp 13.199909||Pct Diff -3.02054156642||P99 Base 61.524726||P99 Cmp 60.121595||Pct Diff -2.28059690993||P999 Base 61.524726||P999 Cmp 60.121595||Pct Diff -2.28059690993||P100 Base 92.129761||P100 Cmp 67.247032||Pct Diff -27.0083507543
||Task ('OrHighHigh', None)||P50 Base 16.29712||P50 Cmp 17.424862||Pct Diff 6.91988523126||P90 Base 28.890466||P90 Cmp 31.015713||Pct Diff 7.3562226376||P99 Base 45.915254||P99 Cmp 52.468827||Pct Diff 14.2731933923||P999 Base 45.915254||P999 Cmp 52.468827||Pct Diff 14.2731933923||P100 Base 662.806553||P100 Cmp 404.80122||Pct Diff -38.9261892225
||Task ('MedPhrase', None)||P50 Base 6.763059||P50 Cmp 6.600295||Pct Diff -2.40666242894||P90 Base 8.080829||P90 Cmp 29.69327||Pct Diff 267.453265005||P99 Base 30.652453||P99 Cmp 30.453355||Pct Diff -0.649533660487||P999 Base 30.652453||P999 Cmp 30.453355||Pct Diff -0.649533660487||P100 Base 102.983854||P100 Cmp 76.62942||Pct Diff -25.5908406768
||Task ('LowSpanNear', None)||P50 Base 24.221352||P50 Cmp 24.809228||Pct Diff 2.42709820657||P90 Base 31.834194||P90 Cmp 35.600847||Pct Diff 11.8320979008||P99 Base 35.043444||P99 Cmp 36.212586||Pct Diff 3.33626455208||P999 Base 35.043444||P999 Cmp 36.212586||Pct Diff 3.33626455208||P100 Base 36.344867||P100 Cmp 36.279267||Pct Diff -0.1804931629
||Task ('Fuzzy2', None)||P50 Base 30.615679||P50 Cmp 27.65544||Pct Diff -9.6690293885||P90 Base 213.246762||P90 Cmp 242.623185||Pct Diff 13.7757885393||P99 Base 237.892791||P99 Cmp 306.33945||Pct Diff 28.7720610247||P999 Base 237.892791||P999 Cmp 306.33945||Pct Diff 28.7720610247||P100 Base 1149.207215||P100 Cmp 1387.50249||Pct Diff 20.7356229486
||Task ('OrNotHighHigh', None)||P50 Base 1.941236||P50 Cmp 1.931937||Pct Diff -0.479024703848||P90 Base 3.87497||P90 Cmp 13.648025||Pct Diff 252.20982356||P99 Base 5.156252||P99 Cmp 14.102116||Pct Diff 173.495476947||P999 Base 5.156252||P999 Cmp 14.102116||Pct Diff 173.495476947||P100 Base 70.820513||P100 Cmp 69.546861||Pct Diff -1.79842244294
||Task ('OrHighNotLow', None)||P50 Base 1.497945||P50 Cmp 1.665896||Pct Diff 11.212093902||P90 Base 2.507144||P90 Cmp 3.635148||Pct Diff 44.9915920266||P99 Base 3.453682||P99 Cmp 4.393439||Pct Diff 27.2102932465||P999 Base 3.453682||P999 Cmp 4.393439||Pct Diff 27.2102932465||P100 Base 6.082617||P100 Cmp 6.122857||Pct Diff 0.661557352699
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 113.62161||P50 Cmp 113.639148||Pct Diff 0.0154354440146||P90 Base 123.567922||P90 Cmp 123.08097||Pct Diff -0.39407638497||P99 Base 134.967498||P99 Cmp 131.244941||Pct Diff -2.75811366082||P999 Base 134.967498||P999 Cmp 131.244941||Pct Diff -2.75811366082||P100 Base 135.345505||P100 Cmp 155.518573||Pct Diff 14.9048673615
||Task ('Fuzzy1', None)||P50 Base 16.863727||P50 Cmp 17.364179||Pct Diff 2.9676239422||P90 Base 127.223119||P90 Cmp 127.502951||Pct Diff 0.219953733409||P99 Base 216.74373||P99 Cmp 135.261198||Pct Diff -37.5939511607||P999 Base 216.74373||P999 Cmp 135.261198||Pct Diff -37.5939511607||P100 Base 247.555642||P100 Cmp 237.385608||Pct Diff -4.10818106097
||Task ('HighSloppyPhrase', None)||P50 Base 10.248558||P50 Cmp 10.072498||Pct Diff -1.71790021582||P90 Base 12.046931||P90 Cmp 13.032326||Pct Diff 8.17963512865||P99 Base 12.361084||P99 Cmp 14.760264||Pct Diff 19.4091391985||P999 Base 12.361084||P999 Cmp 14.760264||Pct Diff 19.4091391985||P100 Base 73.22765||P100 Cmp 16.456847||Pct Diff -77.5264575608
||Task ('OrNotHighMed', None)||P50 Base 1.437469||P50 Cmp 1.485281||Pct Diff 3.3261239025||P90 Base 8.968336||P90 Cmp 19.725747||Pct Diff 119.948795406||P99 Base 51.442633||P99 Cmp 21.70926||Pct Diff -57.7990885498||P999 Base 51.442633||P999 Cmp 21.70926||Pct Diff -57.7990885498||P100 Base 57.734017||P100 Cmp 55.322266||Pct Diff -4.17734833868
||Task ('LowPhrase', None)||P50 Base 5.264741||P50 Cmp 5.157245||Pct Diff -2.04180984402||P90 Base 7.575204||P90 Cmp 8.459729||Pct Diff 11.6765832313||P99 Base 26.28294||P99 Cmp 25.136033||Pct Diff -4.36369371159||P999 Base 26.28294||P999 Cmp 25.136033||Pct Diff -4.36369371159||P100 Base 175.980826||P100 Cmp 426.810529||Pct Diff 142.532404638
||Task ('AndHighLow', None)||P50 Base 1.384992||P50 Cmp 1.321761||Pct Diff -4.56544153324||P90 Base 2.142766||P90 Cmp 1.999642||Pct Diff -6.67940409732||P99 Base 2.161142||P99 Cmp 2.015934||Pct Diff -6.71904021115||P999 Base 2.161142||P999 Cmp 2.015934||Pct Diff -6.71904021115||P100 Base 2.846481||P100 Cmp 3.240727||Pct Diff 13.8502944513
||Task ('LowTerm', None)||P50 Base 0.903557||P50 Cmp 0.870869||Pct Diff -3.61770203761||P90 Base 1.311238||P90 Cmp 1.133619||Pct Diff -13.5459008967||P99 Base 2.015093||P99 Cmp 1.664908||Pct Diff -17.3781061221||P999 Base 2.015093||P999 Cmp 1.664908||Pct Diff -17.3781061221||P100 Base 5.534229||P100 Cmp 2.798181||Pct Diff -49.4386480935
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 101.475195||P50 Cmp 101.485483||Pct Diff 0.0101384382656||P90 Base 114.230066||P90 Cmp 104.103739||Pct Diff -8.8648526212||P99 Base 140.869374||P99 Cmp 106.369609||Pct Diff -24.4906071635||P999 Base 140.869374||P999 Cmp 106.369609||Pct Diff -24.4906071635||P100 Base 233.417301||P100 Cmp 234.690449||Pct Diff 0.545438574838
||Task ('AndHighHigh', None)||P50 Base 5.294797||P50 Cmp 5.261398||Pct Diff -0.630789055747||P90 Base 26.036199||P90 Cmp 26.1725||Pct Diff 0.523505754431||P99 Base 27.709606||P99 Cmp 27.971497||Pct Diff 0.945127115846||P999 Base 27.709606||P999 Cmp 27.971497||Pct Diff 0.945127115846||P100 Base 298.665061||P100 Cmp 296.693802||Pct Diff -0.660023302826
||Task ('HighTermMonthSort', 'Month')||P50 Base 3.202073||P50 Cmp 3.203725||Pct Diff 0.0515915783307||P90 Base 5.406869||P90 Cmp 5.008571||Pct Diff -7.36651840464||P99 Base 5.46124||P99 Cmp 5.3097||Pct Diff -2.77482769481||P999 Base 5.46124||P999 Cmp 5.3097||Pct Diff -2.77482769481||P100 Base 34.795879||P100 Cmp 10.670674||Pct Diff -69.3335121668
||Task Respell||P50 Base 16.917639||P50 Cmp 16.706357||Pct Diff -1.24888585222||P90 Base 41.788929||P90 Cmp 36.117562||Pct Diff -13.5714581247||P99 Base 70.64121||P99 Cmp 108.48069||Pct Diff 53.5657302586||P999 Base 70.64121||P999 Cmp 108.48069||Pct Diff 53.5657302586||P100 Base 254.011756||P100 Cmp 301.055144||Pct Diff 18.5201617204
||Task ('MedTerm', None)||P50 Base 1.065195||P50 Cmp 1.106222||Pct Diff 3.85159524782||P90 Base 1.280547||P90 Cmp 1.393797||Pct Diff 8.84387687449||P99 Base 5.646788||P99 Cmp 6.441376||Pct Diff 14.0715040125||P999 Base 5.646788||P999 Cmp 6.441376||Pct Diff 14.0715040125||P100 Base 75.115975||P100 Cmp 16.059987||Pct Diff -78.619745001
||Task ('HighIntervalsOrdered', None)||P50 Base 17.873355||P50 Cmp 17.975977||Pct Diff 0.574161929867||P90 Base 25.777761||P90 Cmp 27.274145||Pct Diff 5.80494170925||P99 Base 27.786042||P99 Cmp 28.636093||Pct Diff 3.05927342944||P999 Base 27.786042||P999 Cmp 28.636093||Pct Diff 3.05927342944||P100 Base 90.464198||P100 Cmp 74.574877||Pct Diff -17.5642092135
||Task ('HighSpanNear', None)||P50 Base 19.214059||P50 Cmp 18.449907||Pct Diff -3.97704618269||P90 Base 28.410305||P90 Cmp 21.357886||Pct Diff -24.8234540249||P99 Base 82.273592||P99 Cmp 23.221367||Pct Diff -71.7754306874||P999 Base 82.273592||P999 Cmp 23.221367||Pct Diff -71.7754306874||P100 Base 346.467736||P100 Cmp 315.73088||Pct Diff -8.87149157231
||Task ('LowSloppyPhrase', None)||P50 Base 16.50282||P50 Cmp 17.545897||Pct Diff 6.32059854013||P90 Base 26.384492||P90 Cmp 28.004606||Pct Diff 6.14040247582||P99 Base 28.317522||P99 Cmp 28.782041||Pct Diff 1.64039424071||P999 Base 28.317522||P999 Cmp 28.782041||Pct Diff 1.64039424071||P100 Base 36.159396||P100 Cmp 41.044194||Pct Diff 13.5090696758
||Task ('OrHighNotHigh', None)||P50 Base 2.136607||P50 Cmp 2.234294||Pct Diff 4.57206215275||P90 Base 22.258455||P90 Cmp 7.364611||Pct Diff -66.913197704||P99 Base 25.727235||P99 Cmp 14.860448||Pct Diff -42.2384566394||P999 Base 25.727235||P999 Cmp 14.860448||Pct Diff -42.2384566394||P100 Base 31.849728||P100 Cmp 15.069384||Pct Diff -52.6859884015
||Task ('OrNotHighLow', None)||P50 Base 1.331494||P50 Cmp 1.257545||Pct Diff -5.55383651748||P90 Base 2.56366||P90 Cmp 3.251601||Pct Diff 26.8343306055||P99 Base 2.636046||P99 Cmp 6.206848||Pct Diff 135.460534452||P999 Base 2.636046||P999 Cmp 6.206848||Pct Diff 135.460534452||P100 Base 6.443129||P100 Cmp 77.762||Pct Diff 1106.89807701
||Task ('MedSpanNear', None)||P50 Base 8.340252||P50 Cmp 8.853158||Pct Diff 6.1497662181||P90 Base 11.598802||P90 Cmp 12.246298||Pct Diff 5.58243860012||P99 Base 11.720452||P99 Cmp 15.649525||Pct Diff 33.5232207768||P999 Base 11.720452||P999 Cmp 15.649525||Pct Diff 33.5232207768||P100 Base 110.008423||P100 Cmp 109.236089||Pct Diff -0.702068058916
||Task ('BrowseDateTaxoFacets', None)||P50 Base 428.673237||P50 Cmp 429.92873||Pct Diff 0.292878792431||P90 Base 452.070332||P90 Cmp 436.920057||Pct Diff -3.35130928256||P99 Base 455.26839||P99 Cmp 444.988275||Pct Diff -2.25803399177||P999 Base 455.26839||P999 Cmp 444.988275||Pct Diff -2.25803399177||P100 Base 634.365087||P100 Cmp 614.525784||Pct Diff -3.12742668324
||Task ('HighPhrase', None)||P50 Base 4.135094||P50 Cmp 4.152563||Pct Diff 0.422457143659||P90 Base 12.812348||P90 Cmp 4.944226||Pct Diff -61.4104612207||P99 Base 24.394913||P99 Cmp 24.219723||Pct Diff -0.718141524014||P999 Base 24.394913||P999 Cmp 24.219723||Pct Diff -0.718141524014||P100 Base 31.896374||P100 Cmp 29.090705||Pct Diff -8.79620047094
||Task ('OrHighLow', None)||P50 Base 2.495878||P50 Cmp 2.284128||Pct Diff -8.48398840007||P90 Base 3.942204||P90 Cmp 3.532391||Pct Diff -10.3955300132||P99 Base 5.501905||P99 Cmp 3.669346||Pct Diff -33.3077179631||P999 Base 5.501905||P999 Cmp 3.669346||Pct Diff -33.3077179631||P100 Base 7.450548||P100 Cmp 13.36179||Pct Diff 79.3396942077
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.165839||P50 Cmp 0.186162||Pct Diff 12.2546566248||P90 Base 0.185528||P90 Cmp 0.237119||Pct Diff 27.8076624553||P99 Base 0.41689||P99 Cmp 0.253544||Pct Diff -39.1820384274||P999 Base 0.41689||P999 Cmp 0.253544||Pct Diff -39.1820384274||P100 Base 14.663645||P100 Cmp 14.362002||Pct Diff -2.05708062354
||Task ('OrHighMed', None)||P50 Base 3.075442||P50 Cmp 3.738054||Pct Diff 21.5452608113||P90 Base 14.251823||P90 Cmp 6.999115||Pct Diff -50.8896861826||P99 Base 18.292637||P99 Cmp 14.541365||Pct Diff -20.5070050863||P999 Base 18.292637||P999 Cmp 14.541365||Pct Diff -20.5070050863||P100 Base 83.885863||P100 Cmp 37.002925||Pct Diff -55.8889618862
||Task ('IntNRQ', None)||P50 Base 4.018288||P50 Cmp 3.827667||Pct Diff -4.74383618098||P90 Base 12.132974||P90 Cmp 14.592862||Pct Diff 20.274402632||P99 Base 156.454859||P99 Cmp 70.615224||Pct Diff -54.8654324632||P999 Base 156.454859||P999 Cmp 70.615224||Pct Diff -54.8654324632||P100 Base 320.264895||P100 Cmp 196.541701||Pct Diff -38.6315190742
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.165757||P50 Cmp 0.184774||Pct Diff 11.4728186442||P90 Base 0.224941||P90 Cmp 0.21298||Pct Diff -5.31739433896||P99 Base 0.287402||P99 Cmp 3.81899||Pct Diff 1228.79729438||P999 Base 0.287402||P999 Cmp 3.81899||Pct Diff 1228.79729438||P100 Base 19.711931||P100 Cmp 19.143475||Pct Diff -2.88381691271
||Task ('AndHighMed', None)||P50 Base 3.279002||P50 Cmp 3.197857||Pct Diff -2.47468589528||P90 Base 4.432861||P90 Cmp 4.32123||Pct Diff -2.51826078011||P99 Base 4.580808||P99 Cmp 5.013416||Pct Diff 9.4439234301||P999 Base 4.580808||P999 Cmp 5.013416||Pct Diff 9.4439234301||P100 Base 87.283384||P100 Cmp 66.831005||Pct Diff -23.4321563426
||Task ('OrHighNotMed', None)||P50 Base 1.67652||P50 Cmp 1.715534||Pct Diff 2.3270822895||P90 Base 2.135719||P90 Cmp 2.392002||Pct Diff 11.9998464217||P99 Base 2.952607||P99 Cmp 4.468108||Pct Diff 51.3275556144||P999 Base 2.952607||P999 Cmp 4.468108||Pct Diff 51.3275556144||P100 Base 4.495309||P100 Cmp 4.995243||Pct Diff 11.1212377169
||Task ('Prefix3', None)||P50 Base 13.734404||P50 Cmp 13.891173||Pct Diff 1.14143285722||P90 Base 24.374184||P90 Cmp 24.28982||Pct Diff -0.346120304992||P99 Base 246.86119||P99 Cmp 200.192038||Pct Diff -18.9050178361||P999 Base 246.86119||P999 Cmp 200.192038||Pct Diff -18.9050178361||P100 Base 408.971785||P100 Cmp 517.159358||Pct Diff 26.453554247
||Task PKLookup||P50 Base 10.671185||P50 Cmp 10.966826||Pct Diff 2.77046082511||P90 Base 71.272189||P90 Cmp 73.006394||Pct Diff 2.43321416717||P99 Base 109.934855||P99 Cmp 120.058501||Pct Diff 9.20876822915||P999 Base 109.934855||P999 Cmp 120.058501||Pct Diff 9.20876822915||P100 Base 273.176476||P100 Cmp 235.582027||Pct Diff -13.7619642623
||Task ('HighTerm', None)||P50 Base 1.223879||P50 Cmp 1.302262||Pct Diff 6.4044729912||P90 Base 22.870916||P90 Cmp 13.518633||Pct Diff -40.8915978704||P99 Base 24.647359||P99 Cmp 23.118467||Pct Diff -6.20306621898||P999 Base 24.647359||P999 Cmp 23.118467||Pct Diff -6.20306621898||P100 Base 36.898824||P100 Cmp 35.888499||Pct Diff -2.73809539296
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
Fuzzy1 61.97 (5.7%) 58.38 (14.0%) -5.8% ( -24% - 14%)
BrowseDayOfYearTaxoFacets 6094.76 (3.6%) 5773.28 (3.3%) -5.3% ( -11% - 1%)
Wildcard 536.25 (6.7%) 512.57 (6.6%) -4.4% ( -16% - 9%)
BrowseMonthTaxoFacets 6112.88 (3.4%) 5867.94 (3.3%) -4.0% ( -10% - 2%)
HighTerm 891.79 (3.5%) 860.06 (2.8%) -3.6% ( -9% - 2%)
HighTermDayOfYearSort 292.32 (9.3%) 282.20 (10.5%) -3.5% ( -21% - 17%)
OrHighNotMed 600.61 (4.0%) 581.59 (7.1%) -3.2% ( -13% - 8%)
LowPhrase 195.29 (4.5%) 191.27 (8.8%) -2.1% ( -14% - 11%)
OrHighNotLow 679.00 (6.1%) 666.56 (6.0%) -1.8% ( -13% - 10%)
MedTerm 982.38 (6.8%) 972.19 (3.7%) -1.0% ( -10% - 10%)
HighPhrase 243.11 (3.4%) 241.26 (4.6%) -0.8% ( -8% - 7%)
OrNotHighHigh 551.66 (4.5%) 548.73 (4.3%) -0.5% ( -8% - 8%)
OrHighMed 316.14 (5.8%) 314.55 (5.0%) -0.5% ( -10% - 10%)
LowSpanNear 43.66 (2.4%) 43.48 (2.3%) -0.4% ( -4% - 4%)
BrowseDateTaxoFacets 2.32 (1.3%) 2.31 (1.3%) -0.2% ( -2% - 2%)
OrHighNotHigh 576.34 (7.0%) 575.19 (8.2%) -0.2% ( -14% - 16%)
OrNotHighLow 824.29 (4.4%) 823.29 (5.1%) -0.1% ( -9% - 9%)
OrNotHighMed 686.71 (5.4%) 686.52 (4.7%) -0.0% ( -9% - 10%)
AndHighHigh 197.17 (4.2%) 197.49 (2.1%) 0.2% ( -5% - 6%)
OrHighLow 438.19 (5.4%) 439.77 (4.9%) 0.4% ( -9% - 11%)
HighTermMonthSort 344.30 (9.7%) 345.58 (19.6%) 0.4% ( -26% - 32%)
MedSpanNear 121.93 (2.3%) 122.41 (2.7%) 0.4% ( -4% - 5%)
OrHighHigh 58.42 (5.7%) 58.69 (1.9%) 0.5% ( -6% - 8%)
IntNRQ 255.39 (1.9%) 256.65 (3.8%) 0.5% ( -5% - 6%)
Prefix3 70.51 (4.2%) 70.94 (3.6%) 0.6% ( -6% - 8%)
Fuzzy2 38.52 (12.9%) 38.77 (6.6%) 0.6% ( -16% - 23%)
MedPhrase 150.99 (3.4%) 152.12 (3.6%) 0.7% ( -6% - 8%)
Respell 62.76 (2.5%) 63.45 (3.8%) 1.1% ( -5% - 7%)
PKLookup 92.60 (2.7%) 93.68 (3.8%) 1.2% ( -5% - 7%)
HighSloppyPhrase 107.07 (6.1%) 108.71 (6.9%) 1.5% ( -10% - 15%)
AndHighLow 772.45 (2.5%) 786.79 (4.0%) 1.9% ( -4% - 8%)
HighIntervalsOrdered 54.95 (5.2%) 55.99 (1.7%) 1.9% ( -4% - 9%)
AndHighMed 306.85 (4.9%) 313.08 (4.8%) 2.0% ( -7% - 12%)
LowTerm 1131.35 (2.2%) 1156.21 (5.4%) 2.2% ( -5% - 9%)
LowSloppyPhrase 60.92 (7.4%) 62.53 (5.5%) 2.6% ( -9% - 16%)
HighSpanNear 52.75 (9.8%) 55.24 (2.0%) 4.7% ( -6% - 18%)
MedSloppyPhrase 121.22 (5.4%) 127.07 (2.6%) 4.8% ( -2% - 13%)
BrowseMonthSSDVFacets 12.38 (21.1%) 13.08 (21.9%) 5.6% ( -30% - 61%)
BrowseDayOfYearSSDVFacets 9.95 (18.8%) 10.55 (17.9%) 6.1% ( -25% - 52%)
iter 7
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.7 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -5194239 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.7 -topN 10 -pk
21.5 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.7 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -5194239 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.7 -topN 10 -pk
21.7 s
Report after iter 7:
||Task ('Wildcard', None)||P50 Base 1.927012||P50 Cmp 2.166763||Pct Diff 12.4415935137||P90 Base 28.233983||P90 Cmp 28.929391||Pct Diff 2.46301770459||P99 Base 89.21558||P99 Cmp 88.35581||Pct Diff -0.963699389725||P999 Base 89.21558||P999 Cmp 88.35581||Pct Diff -0.963699389725||P100 Base 102.174435||P100 Cmp 100.448276||Pct Diff -1.68942358233
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 4.368214||P50 Cmp 3.924935||Pct Diff -10.1478315852||P90 Base 131.638014||P90 Cmp 92.71739||Pct Diff -29.5664016931||P99 Base 166.175545||P99 Cmp 139.311095||Pct Diff -16.166307744||P999 Base 166.175545||P999 Cmp 139.311095||Pct Diff -16.166307744||P100 Base 252.344723||P100 Cmp 171.018141||Pct Diff -32.2283664319
||Task ('MedSloppyPhrase', None)||P50 Base 10.840995||P50 Cmp 7.786716||Pct Diff -28.1734195062||P90 Base 11.937085||P90 Cmp 11.83291||Pct Diff -0.872700495975||P99 Base 12.034936||P99 Cmp 12.473732||Pct Diff 3.64601855797||P999 Base 12.034936||P999 Cmp 12.473732||Pct Diff 3.64601855797||P100 Base 649.406866||P100 Cmp 709.601178||Pct Diff 9.2691215864
||Task ('OrHighHigh', None)||P50 Base 17.693368||P50 Cmp 18.148439||Pct Diff 2.57198629453||P90 Base 28.930685||P90 Cmp 28.891992||Pct Diff -0.133743808693||P99 Base 32.70025||P99 Cmp 28.96747||Pct Diff -11.4151420861||P999 Base 32.70025||P999 Cmp 28.96747||Pct Diff -11.4151420861||P100 Base 55.961729||P100 Cmp 121.866453||Pct Diff 117.767490708
||Task ('MedPhrase', None)||P50 Base 6.389315||P50 Cmp 6.796964||Pct Diff 6.38016751404||P90 Base 8.952778||P90 Cmp 7.307334||Pct Diff -18.3791444399||P99 Base 14.08127||P99 Cmp 11.344792||Pct Diff -19.4334601922||P999 Base 14.08127||P999 Cmp 11.344792||Pct Diff -19.4334601922||P100 Base 32.510616||P100 Cmp 13.898147||Pct Diff -57.2504347503
||Task ('LowSpanNear', None)||P50 Base 23.283047||P50 Cmp 22.861868||Pct Diff -1.80895137995||P90 Base 31.339471||P90 Cmp 33.315473||Pct Diff 6.3051542893||P99 Base 37.277579||P99 Cmp 34.954992||Pct Diff -6.23051995946||P999 Base 37.277579||P999 Cmp 34.954992||Pct Diff -6.23051995946||P100 Base 37.938488||P100 Cmp 240.492624||Pct Diff 533.901445941
||Task ('Fuzzy2', None)||P50 Base 26.395183||P50 Cmp 27.754765||Pct Diff 5.15087165715||P90 Base 104.93959||P90 Cmp 72.695229||Pct Diff -30.7265932714||P99 Base 106.381527||P99 Cmp 106.364084||Pct Diff -0.0163966437519||P999 Base 106.381527||P999 Cmp 106.364084||Pct Diff -0.0163966437519||P100 Base 673.007779||P100 Cmp 561.335911||Pct Diff -16.5929535266
||Task ('OrNotHighHigh', None)||P50 Base 1.87967||P50 Cmp 2.153572||Pct Diff 14.5718131374||P90 Base 26.155052||P90 Cmp 22.383454||Pct Diff -14.4201510286||P99 Base 28.914644||P99 Cmp 28.563993||Pct Diff -1.21271076345||P999 Base 28.914644||P999 Cmp 28.563993||Pct Diff -1.21271076345||P100 Base 62.756502||P100 Cmp 56.723171||Pct Diff -9.61387395365
||Task ('OrHighNotLow', None)||P50 Base 1.550922||P50 Cmp 1.548617||Pct Diff -0.148621271734||P90 Base 2.517746||P90 Cmp 2.047305||Pct Diff -18.6850063509||P99 Base 4.573498||P99 Cmp 2.983492||Pct Diff -34.7656432779||P999 Base 4.573498||P999 Cmp 2.983492||Pct Diff -34.7656432779||P100 Base 24.427149||P100 Cmp 26.714408||Pct Diff 9.36359376201
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 63.077291||P50 Cmp 62.631801||Pct Diff -0.70626051458||P90 Base 72.3891||P90 Cmp 72.386516||Pct Diff -0.00356959818536||P99 Base 82.912988||P99 Cmp 82.222325||Pct Diff -0.832997358629||P999 Base 82.912988||P999 Cmp 82.222325||Pct Diff -0.832997358629||P100 Base 261.074566||P100 Cmp 248.987553||Pct Diff -4.62971678367
||Task ('Fuzzy1', None)||P50 Base 18.475401||P50 Cmp 19.09224||Pct Diff 3.33870425871||P90 Base 114.661901||P90 Cmp 110.664027||Pct Diff -3.48666293262||P99 Base 240.676388||P99 Cmp 160.531736||Pct Diff -33.2997568503||P999 Base 240.676388||P999 Cmp 160.531736||Pct Diff -33.2997568503||P100 Base 256.980816||P100 Cmp 186.112723||Pct Diff -27.5771919877
||Task ('HighSloppyPhrase', None)||P50 Base 8.859855||P50 Cmp 8.893237||Pct Diff 0.376778175264||P90 Base 14.972389||P90 Cmp 16.349618||Pct Diff 9.19845857598||P99 Base 16.121801||P99 Cmp 27.046561||Pct Diff 67.7638931283||P999 Base 16.121801||P999 Cmp 27.046561||Pct Diff 67.7638931283||P100 Base 17.617545||P100 Cmp 43.053227||Pct Diff 144.376994638
||Task ('OrNotHighMed', None)||P50 Base 1.554584||P50 Cmp 1.529966||Pct Diff -1.58357476984||P90 Base 2.0465||P90 Cmp 2.133242||Pct Diff 4.23855362815||P99 Base 2.176001||P99 Cmp 4.599364||Pct Diff 111.367733746||P999 Base 2.176001||P999 Cmp 4.599364||Pct Diff 111.367733746||P100 Base 6.806359||P100 Cmp 6.685384||Pct Diff -1.77738200409
||Task ('LowPhrase', None)||P50 Base 5.086534||P50 Cmp 5.277887||Pct Diff 3.76195263808||P90 Base 7.542942||P90 Cmp 7.622587||Pct Diff 1.05588774248||P99 Base 34.07113||P99 Cmp 39.667046||Pct Diff 16.4242160445||P999 Base 34.07113||P999 Cmp 39.667046||Pct Diff 16.4242160445||P100 Base 89.314718||P100 Cmp 75.808839||Pct Diff -15.1216723318
||Task ('AndHighLow', None)||P50 Base 1.342108||P50 Cmp 1.457249||Pct Diff 8.57911583867||P90 Base 3.006925||P90 Cmp 3.048568||Pct Diff 1.38490318182||P99 Base 7.244436||P99 Cmp 8.429925||Pct Diff 16.3641310379||P999 Base 7.244436||P999 Cmp 8.429925||Pct Diff 16.3641310379||P100 Base 9.78641||P100 Cmp 10.711253||Pct Diff 9.45027849845
||Task ('LowTerm', None)||P50 Base 0.857459||P50 Cmp 0.898684||Pct Diff 4.80781005273||P90 Base 1.079997||P90 Cmp 1.676206||Pct Diff 55.2046903834||P99 Base 1.667546||P99 Cmp 2.523672||Pct Diff 51.3404727666||P999 Base 1.667546||P999 Cmp 2.523672||Pct Diff 51.3404727666||P100 Base 3.177556||P100 Cmp 3.540968||Pct Diff 11.4368401375
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 76.605666||P50 Cmp 77.195643||Pct Diff 0.770147994014||P90 Base 81.814077||P90 Cmp 86.814987||Pct Diff 6.11252999896||P99 Base 94.499732||P99 Cmp 91.761259||Pct Diff -2.89786324473||P999 Base 94.499732||P999 Cmp 91.761259||Pct Diff -2.89786324473||P100 Base 217.731775||P100 Cmp 212.569936||Pct Diff -2.37073298098
||Task ('AndHighHigh', None)||P50 Base 5.095224||P50 Cmp 5.262987||Pct Diff 3.29255396819||P90 Base 8.462222||P90 Cmp 10.983332||Pct Diff 29.7925296689||P99 Base 32.702297||P99 Cmp 30.91852||Pct Diff -5.45459237924||P999 Base 32.702297||P999 Cmp 30.91852||Pct Diff -5.45459237924||P100 Base 38.517358||P100 Cmp 41.731896||Pct Diff 8.34568663822
||Task ('HighTermMonthSort', 'Month')||P50 Base 3.188||P50 Cmp 3.172483||Pct Diff -0.486731493099||P90 Base 5.338721||P90 Cmp 5.152871||Pct Diff -3.48117086471||P99 Base 19.770694||P99 Cmp 5.352297||Pct Diff -72.9281278644||P999 Base 19.770694||P999 Cmp 5.352297||Pct Diff -72.9281278644||P100 Base 31.858391||P100 Cmp 31.651664||Pct Diff -0.648893410844
||Task Respell||P50 Base 16.291041||P50 Cmp 16.608862||Pct Diff 1.95089435967||P90 Base 146.022972||P90 Cmp 116.257912||Pct Diff -20.3838201567||P99 Base 260.46162||P99 Cmp 266.003773||Pct Diff 2.1278194461||P999 Base 260.46162||P999 Cmp 266.003773||Pct Diff 2.1278194461||P100 Base 558.439021||P100 Cmp 523.968742||Pct Diff -6.17261289125
||Task ('MedTerm', None)||P50 Base 1.095564||P50 Cmp 1.116081||Pct Diff 1.87273404383||P90 Base 1.425053||P90 Cmp 1.478834||Pct Diff 3.77396489815||P99 Base 4.37225||P99 Cmp 4.31378||Pct Diff -1.33729773||P999 Base 4.37225||P999 Cmp 4.31378||Pct Diff -1.33729773||P100 Base 50.830251||P100 Cmp 53.885171||Pct Diff 6.01004311389
||Task ('HighIntervalsOrdered', None)||P50 Base 17.999827||P50 Cmp 17.991702||Pct Diff -0.0451393227279||P90 Base 29.121577||P90 Cmp 29.228124||Pct Diff 0.365869609328||P99 Base 70.8622||P99 Cmp 72.972563||Pct Diff 2.97812232756||P999 Base 70.8622||P999 Cmp 72.972563||Pct Diff 2.97812232756||P100 Base 101.684117||P100 Cmp 75.789111||Pct Diff -25.4661266321
||Task ('HighSpanNear', None)||P50 Base 19.576408||P50 Cmp 18.082434||Pct Diff -7.63150216322||P90 Base 28.423835||P90 Cmp 24.027484||Pct Diff -15.4671282042||P99 Base 28.788242||P99 Cmp 25.886658||Pct Diff -10.0790593604||P999 Base 28.788242||P999 Cmp 25.886658||Pct Diff -10.0790593604||P100 Base 30.371031||P100 Cmp 28.643288||Pct Diff -5.68878613308
||Task ('LowSloppyPhrase', None)||P50 Base 15.23128||P50 Cmp 15.576514||Pct Diff 2.26661186716||P90 Base 24.824119||P90 Cmp 24.559907||Pct Diff -1.0643358582||P99 Base 26.237381||P99 Cmp 26.433408||Pct Diff 0.747128686358||P999 Base 26.237381||P999 Cmp 26.433408||Pct Diff 0.747128686358||P100 Base 27.827633||P100 Cmp 26.643014||Pct Diff -4.25698800901
||Task ('OrHighNotHigh', None)||P50 Base 1.881156||P50 Cmp 1.8973||Pct Diff 0.858195705194||P90 Base 7.154643||P90 Cmp 7.306348||Pct Diff 2.12037134487||P99 Base 22.815666||P99 Cmp 35.982125||Pct Diff 57.7079757391||P999 Base 22.815666||P999 Cmp 35.982125||Pct Diff 57.7079757391||P100 Base 264.485534||P100 Cmp 194.830291||Pct Diff -26.3361258162
||Task ('OrNotHighLow', None)||P50 Base 1.193839||P50 Cmp 1.291784||Pct Diff 8.20420508963||P90 Base 2.859391||P90 Cmp 10.008588||Pct Diff 250.025162701||P99 Base 11.656468||P99 Cmp 11.35815||Pct Diff -2.55924865062||P999 Base 11.656468||P999 Cmp 11.35815||Pct Diff -2.55924865062||P100 Base 42.06404||P100 Cmp 45.041708||Pct Diff 7.0788920893
||Task ('MedSpanNear', None)||P50 Base 8.55427||P50 Cmp 8.316786||Pct Diff -2.7762041647||P90 Base 25.632962||P90 Cmp 14.28253||Pct Diff -44.2806102549||P99 Base 50.081684||P99 Cmp 56.599575||Pct Diff 13.0145204383||P999 Base 50.081684||P999 Cmp 56.599575||Pct Diff 13.0145204383||P100 Base 131.525729||P100 Cmp 124.191291||Pct Diff -5.57642831997
||Task ('BrowseDateTaxoFacets', None)||P50 Base 434.462225||P50 Cmp 427.721666||Pct Diff -1.55147182244||P90 Base 453.976167||P90 Cmp 451.891305||Pct Diff -0.459244813175||P99 Base 468.036842||P99 Cmp 453.325632||Pct Diff -3.14317350257||P999 Base 468.036842||P999 Cmp 453.325632||Pct Diff -3.14317350257||P100 Base 557.221818||P100 Cmp 707.615942||Pct Diff 26.989991982
||Task ('HighPhrase', None)||P50 Base 4.050249||P50 Cmp 4.185624||Pct Diff 3.34238709768||P90 Base 7.416112||P90 Cmp 5.371056||Pct Diff -27.5758510659||P99 Base 8.277063||P99 Cmp 8.147717||Pct Diff -1.56270406544||P999 Base 8.277063||P999 Cmp 8.147717||Pct Diff -1.56270406544||P100 Base 733.627083||P100 Cmp 800.441613||Pct Diff 9.10742413254
||Task ('OrHighLow', None)||P50 Base 2.339841||P50 Cmp 2.317196||Pct Diff -0.967800803559||P90 Base 7.402542||P90 Cmp 4.487207||Pct Diff -39.3828903639||P99 Base 11.007666||P99 Cmp 5.334194||Pct Diff -51.5410987216||P999 Base 11.007666||P999 Cmp 5.334194||Pct Diff -51.5410987216||P100 Base 11.868847||P100 Cmp 9.017051||Pct Diff -24.0275740348
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.169621||P50 Cmp 0.180435||Pct Diff 6.3753898397||P90 Base 0.208281||P90 Cmp 0.223916||Pct Diff 7.50668567944||P99 Base 0.257819||P99 Cmp 0.304507||Pct Diff 18.1088282865||P999 Base 0.257819||P999 Cmp 0.304507||Pct Diff 18.1088282865||P100 Base 11.089922||P100 Cmp 10.9707||Pct Diff -1.0750481383
||Task ('OrHighMed', None)||P50 Base 4.187519||P50 Cmp 3.961002||Pct Diff -5.40933665017||P90 Base 22.951946||P90 Cmp 14.881059||Pct Diff -35.1642819306||P99 Base 111.848522||P99 Cmp 112.117197||Pct Diff 0.240213277025||P999 Base 111.848522||P999 Cmp 112.117197||Pct Diff 0.240213277025||P100 Base 288.691756||P100 Cmp 297.672372||Pct Diff 3.11079752482
||Task ('IntNRQ', None)||P50 Base 4.037625||P50 Cmp 4.024243||Pct Diff -0.331432463391||P90 Base 13.671622||P90 Cmp 14.501471||Pct Diff 6.06986500943||P99 Base 67.934054||P99 Cmp 69.595515||Pct Diff 2.44569682239||P999 Base 67.934054||P999 Cmp 69.595515||Pct Diff 2.44569682239||P100 Base 91.050414||P100 Cmp 85.395989||Pct Diff -6.21021338794
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.169768||P50 Cmp 0.177979||Pct Diff 4.8366005372||P90 Base 0.229152||P90 Cmp 0.202194||Pct Diff -11.7642438207||P99 Base 0.247704||P99 Cmp 0.268664||Pct Diff 8.46171236637||P999 Base 0.247704||P999 Cmp 0.268664||Pct Diff 8.46171236637||P100 Base 17.353803||P100 Cmp 17.362402||Pct Diff 0.0495510983961
||Task ('AndHighMed', None)||P50 Base 4.119426||P50 Cmp 3.276648||Pct Diff -20.4586270029||P90 Base 9.762065||P90 Cmp 5.865592||Pct Diff -39.9144340875||P99 Base 156.053048||P99 Cmp 159.679757||Pct Diff 2.32402317448||P999 Base 156.053048||P999 Cmp 159.679757||Pct Diff 2.32402317448||P100 Base 160.769486||P100 Cmp 209.674102||Pct Diff 30.4190908466
||Task ('OrHighNotMed', None)||P50 Base 1.776559||P50 Cmp 1.84606||Pct Diff 3.91211324814||P90 Base 5.767355||P90 Cmp 15.286445||Pct Diff 165.051223655||P99 Base 10.207732||P99 Cmp 15.65441||Pct Diff 53.3583561951||P999 Base 10.207732||P999 Cmp 15.65441||Pct Diff 53.3583561951||P100 Base 18.899399||P100 Cmp 18.172821||Pct Diff -3.84445029178
||Task ('Prefix3', None)||P50 Base 13.174287||P50 Cmp 13.962125||Pct Diff 5.98011869637||P90 Base 19.567042||P90 Cmp 17.311311||Pct Diff -11.5282166819||P99 Base 102.204021||P99 Cmp 17.477715||Pct Diff -82.899190434||P999 Base 102.204021||P999 Cmp 17.477715||Pct Diff -82.899190434||P100 Base 164.913848||P100 Cmp 150.082204||Pct Diff -8.99357099472
||Task PKLookup||P50 Base 10.497889||P50 Cmp 11.166238||Pct Diff 6.36650854281||P90 Base 61.600668||P90 Cmp 51.593883||Pct Diff -16.2446046851||P99 Base 66.898191||P99 Cmp 110.301706||Pct Diff 64.8799531814||P999 Base 66.898191||P999 Cmp 110.301706||Pct Diff 64.8799531814||P100 Base 284.265275||P100 Cmp 225.079151||Pct Diff -20.8207365462
||Task ('HighTerm', None)||P50 Base 1.188637||P50 Cmp 1.290235||Pct Diff 8.54743710653||P90 Base 12.591813||P90 Cmp 23.320075||Pct Diff 85.2002964148||P99 Base 13.772302||P99 Cmp 31.134756||Pct Diff 126.067915153||P999 Base 13.772302||P999 Cmp 31.134756||Pct Diff 126.067915153||P100 Base 70.824141||P100 Cmp 67.397078||Pct Diff -4.83883454372
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
BrowseDayOfYearTaxoFacets 6108.78 (3.4%) 5749.61 (3.3%) -5.9% ( -12% - 0%)
Fuzzy1 61.21 (6.3%) 57.93 (13.4%) -5.4% ( -23% - 15%)
Wildcard 535.44 (6.3%) 509.51 (6.4%) -4.8% ( -16% - 8%)
BrowseMonthTaxoFacets 6099.28 (3.2%) 5858.56 (3.1%) -3.9% ( -9% - 2%)
HighTerm 887.41 (3.5%) 852.88 (3.4%) -3.9% ( -10% - 3%)
OrHighNotMed 597.67 (4.0%) 578.18 (6.8%) -3.3% ( -13% - 7%)
OrHighNotLow 681.01 (5.8%) 665.83 (5.6%) -2.2% ( -12% - 9%)
LowPhrase 195.91 (4.3%) 191.58 (8.2%) -2.2% ( -14% - 10%)
HighTermDayOfYearSort 286.49 (10.4%) 280.69 (10.1%) -2.0% ( -20% - 20%)
OrNotHighHigh 550.62 (4.3%) 541.07 (5.5%) -1.7% ( -11% - 8%)
Fuzzy2 39.16 (12.6%) 38.65 (6.1%) -1.3% ( -17% - 19%)
HighPhrase 243.71 (3.2%) 241.22 (4.3%) -1.0% ( -8% - 6%)
MedTerm 974.55 (6.8%) 965.96 (3.9%) -0.9% ( -10% - 10%)
OrNotHighLow 828.54 (4.3%) 823.97 (4.7%) -0.6% ( -9% - 8%)
AndHighHigh 197.46 (4.0%) 196.55 (2.3%) -0.5% ( -6% - 6%)
Prefix3 71.30 (4.8%) 71.02 (3.4%) -0.4% ( -8% - 8%)
OrHighHigh 58.28 (5.4%) 58.15 (3.0%) -0.2% ( -8% - 8%)
MedPhrase 151.75 (3.4%) 151.52 (3.5%) -0.2% ( -6% - 7%)
LowSpanNear 43.58 (2.3%) 43.54 (2.2%) -0.1% ( -4% - 4%)
BrowseDateTaxoFacets 2.31 (1.2%) 2.31 (1.3%) -0.0% ( -2% - 2%)
OrHighLow 439.29 (5.1%) 439.49 (4.6%) 0.0% ( -9% - 10%)
OrNotHighMed 683.13 (5.3%) 684.53 (4.5%) 0.2% ( -9% - 10%)
IntNRQ 255.28 (1.8%) 255.91 (3.7%) 0.2% ( -5% - 5%)
PKLookup 93.07 (2.9%) 93.32 (3.7%) 0.3% ( -6% - 7%)
OrHighNotHigh 574.04 (6.7%) 576.06 (7.7%) 0.4% ( -13% - 15%)
HighTermMonthSort 340.61 (9.6%) 342.12 (18.7%) 0.4% ( -25% - 31%)
MedSpanNear 121.50 (2.4%) 122.19 (2.6%) 0.6% ( -4% - 5%)
OrHighMed 308.68 (8.4%) 310.68 (5.8%) 0.6% ( -12% - 16%)
Respell 62.62 (2.4%) 63.07 (3.9%) 0.7% ( -5% - 7%)
AndHighLow 771.45 (2.4%) 781.55 (4.2%) 1.3% ( -5% - 8%)
HighSloppyPhrase 107.86 (6.0%) 109.33 (6.6%) 1.4% ( -10% - 14%)
LowTerm 1136.50 (2.4%) 1154.42 (5.0%) 1.6% ( -5% - 9%)
HighIntervalsOrdered 55.05 (4.9%) 55.95 (1.6%) 1.6% ( -4% - 8%)
LowSloppyPhrase 61.56 (7.4%) 62.81 (5.2%) 2.0% ( -9% - 15%)
AndHighMed 301.49 (6.6%) 313.42 (4.6%) 4.0% ( -6% - 16%)
BrowseMonthSSDVFacets 12.82 (21.1%) 13.44 (21.1%) 4.8% ( -30% - 59%)
BrowseDayOfYearSSDVFacets 10.34 (19.7%) 10.87 (18.0%) 5.1% ( -27% - 53%)
HighSpanNear 52.52 (9.3%) 55.28 (1.9%) 5.3% ( -5% - 18%)
MedSloppyPhrase 119.20 (6.8%) 127.29 (2.5%) 6.8% ( -2% - 17%)
iter 8
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.8 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -840659 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.8 -topN 10 -pk
22.3 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.8 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -840659 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.8 -topN 10 -pk
22.4 s
Report after iter 8:
||Task ('Wildcard', None)||P50 Base 2.387074||P50 Cmp 1.862403||Pct Diff -21.9796705087||P90 Base 16.100486||P90 Cmp 16.754472||Pct Diff 4.06190223078||P99 Base 29.690022||P99 Cmp 61.960238||Pct Diff 108.690441523||P999 Base 29.690022||P999 Cmp 61.960238||Pct Diff 108.690441523||P100 Base 206.343667||P100 Cmp 191.363893||Pct Diff -7.25962381971
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 3.844021||P50 Cmp 3.591795||Pct Diff -6.56151462232||P90 Base 17.414358||P90 Cmp 5.1068||Pct Diff -70.6747730809||P99 Base 108.081125||P99 Cmp 98.204569||Pct Diff -9.13809511143||P999 Base 108.081125||P999 Cmp 98.204569||Pct Diff -9.13809511143||P100 Base 121.316093||P100 Cmp 106.847428||Pct Diff -11.9264185338
||Task ('MedSloppyPhrase', None)||P50 Base 7.60651||P50 Cmp 8.417004||Pct Diff 10.6552676589||P90 Base 13.326386||P90 Cmp 12.033209||Pct Diff -9.70388370861||P99 Base 20.080933||P99 Cmp 12.265997||Pct Diff -38.9171957299||P999 Base 20.080933||P999 Cmp 12.265997||Pct Diff -38.9171957299||P100 Base 28.790361||P100 Cmp 33.257722||Pct Diff 15.5168634391
||Task ('OrHighHigh', None)||P50 Base 17.049799||P50 Cmp 19.834964||Pct Diff 16.3354711689||P90 Base 45.621243||P90 Cmp 45.032191||Pct Diff -1.29117919913||P99 Base 46.77883||P99 Cmp 54.648274||Pct Diff 16.82266102||P999 Base 46.77883||P999 Cmp 54.648274||Pct Diff 16.82266102||P100 Base 294.721116||P100 Cmp 373.542402||Pct Diff 26.7443633051
||Task ('MedPhrase', None)||P50 Base 6.440395||P50 Cmp 6.598425||Pct Diff 2.45373148697||P90 Base 9.010167||P90 Cmp 7.200755||Pct Diff -20.0818919339||P99 Base 9.7236||P99 Cmp 7.608597||Pct Diff -21.7512341108||P999 Base 9.7236||P999 Cmp 7.608597||Pct Diff -21.7512341108||P100 Base 32.223895||P100 Cmp 9.02974||Pct Diff -71.9781236874
||Task ('LowSpanNear', None)||P50 Base 23.695884||P50 Cmp 22.795527||Pct Diff -3.79963456945||P90 Base 30.493862||P90 Cmp 37.14783||Pct Diff 21.820679847||P99 Base 30.755649||P99 Cmp 41.928179||Pct Diff 36.3267574032||P999 Base 30.755649||P999 Cmp 41.928179||Pct Diff 36.3267574032||P100 Base 36.638823||P100 Cmp 45.532155||Pct Diff 24.2729740527
||Task ('Fuzzy2', None)||P50 Base 32.214137||P50 Cmp 28.454332||Pct Diff -11.6712889127||P90 Base 102.509833||P90 Cmp 74.205325||Pct Diff -27.6115053275||P99 Base 199.439789||P99 Cmp 103.483696||Pct Diff -48.1128131358||P999 Base 199.439789||P999 Cmp 103.483696||Pct Diff -48.1128131358||P100 Base 221.471924||P100 Cmp 199.539365||Pct Diff -9.90308776114
||Task ('OrNotHighHigh', None)||P50 Base 2.096515||P50 Cmp 1.93135||Pct Diff -7.87807385113||P90 Base 6.519022||P90 Cmp 5.019491||Pct Diff -23.0023920766||P99 Base 9.276401||P99 Cmp 6.147261||Pct Diff -33.7322631913||P999 Base 9.276401||P999 Cmp 6.147261||Pct Diff -33.7322631913||P100 Base 42.220907||P100 Cmp 17.575447||Pct Diff -58.3726446237
||Task ('OrHighNotLow', None)||P50 Base 1.556173||P50 Cmp 1.603451||Pct Diff 3.03809409365||P90 Base 2.139647||P90 Cmp 3.58771||Pct Diff 67.6776589783||P99 Base 4.18252||P99 Cmp 11.00358||Pct Diff 163.084934441||P999 Base 4.18252||P999 Cmp 11.00358||Pct Diff 163.084934441||P100 Base 29.740526||P100 Cmp 38.329685||Pct Diff 28.8803197361
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 112.65954||P50 Cmp 113.038375||Pct Diff 0.336265353116||P90 Base 116.666842||P90 Cmp 119.636594||Pct Diff 2.54549788877||P99 Base 124.124383||P99 Cmp 121.108466||Pct Diff -2.42975387036||P999 Base 124.124383||P999 Cmp 121.108466||Pct Diff -2.42975387036||P100 Base 189.524434||P100 Cmp 180.643944||Pct Diff -4.68567023923
||Task ('Fuzzy1', None)||P50 Base 17.81285||P50 Cmp 19.108182||Pct Diff 7.27189641186||P90 Base 48.157346||P90 Cmp 130.594615||Pct Diff 171.18316487||P99 Base 177.228601||P99 Cmp 219.307299||Pct Diff 23.7426113858||P999 Base 177.228601||P999 Cmp 219.307299||Pct Diff 23.7426113858||P100 Base 196.001832||P100 Cmp 324.010349||Pct Diff 65.3098574099
||Task ('HighSloppyPhrase', None)||P50 Base 8.569186||P50 Cmp 9.644886||Pct Diff 12.5531176473||P90 Base 23.806457||P90 Cmp 20.210016||Pct Diff -15.106998072||P99 Base 28.123352||P99 Cmp 22.824909||Pct Diff -18.8400123854||P999 Base 28.123352||P999 Cmp 22.824909||Pct Diff -18.8400123854||P100 Base 72.986824||P100 Cmp 31.542151||Pct Diff -56.7837737398
||Task ('OrNotHighMed', None)||P50 Base 1.559879||P50 Cmp 1.732729||Pct Diff 11.080987692||P90 Base 7.676449||P90 Cmp 5.713533||Pct Diff -25.570625168||P99 Base 12.607904||P99 Cmp 12.069912||Pct Diff -4.26710101854||P999 Base 12.607904||P999 Cmp 12.069912||Pct Diff -4.26710101854||P100 Base 227.246787||P100 Cmp 188.154643||Pct Diff -17.202506806
||Task ('LowPhrase', None)||P50 Base 5.075483||P50 Cmp 5.121422||Pct Diff 0.905115828385||P90 Base 7.34506||P90 Cmp 7.852471||Pct Diff 6.90819407874||P99 Base 7.383148||P99 Cmp 11.476321||Pct Diff 55.4394006459||P999 Base 7.383148||P999 Cmp 11.476321||Pct Diff 55.4394006459||P100 Base 28.079355||P100 Cmp 31.282225||Pct Diff 11.4064942019
||Task ('AndHighLow', None)||P50 Base 1.442037||P50 Cmp 1.411726||Pct Diff -2.10195716199||P90 Base 5.913905||P90 Cmp 11.568582||Pct Diff 95.6166357086||P99 Base 31.968993||P99 Cmp 36.619475||Pct Diff 14.5468516947||P999 Base 31.968993||P999 Cmp 36.619475||Pct Diff 14.5468516947||P100 Base 100.139259||P100 Cmp 101.575594||Pct Diff 1.43433755586
||Task ('LowTerm', None)||P50 Base 0.893084||P50 Cmp 0.959623||Pct Diff 7.45047498332||P90 Base 2.721899||P90 Cmp 4.14478||Pct Diff 52.2753048515||P99 Base 4.098991||P99 Cmp 12.394244||Pct Diff 202.373047416||P999 Base 4.098991||P999 Cmp 12.394244||Pct Diff 202.373047416||P100 Base 21.210339||P100 Cmp 21.364279||Pct Diff 0.725778121698
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 111.830553||P50 Cmp 111.054618||Pct Diff -0.693848844689||P90 Base 123.734652||P90 Cmp 125.219125||Pct Diff 1.19972293614||P99 Base 131.355519||P99 Cmp 130.381772||Pct Diff -0.741306499653||P999 Base 131.355519||P999 Cmp 130.381772||Pct Diff -0.741306499653||P100 Base 297.000876||P100 Cmp 388.70529||Pct Diff 30.8768159997
||Task ('AndHighHigh', None)||P50 Base 5.052937||P50 Cmp 5.13372||Pct Diff 1.59873356822||P90 Base 6.608511||P90 Cmp 7.442978||Pct Diff 12.6271561022||P99 Base 7.013226||P99 Cmp 36.846561||Pct Diff 425.386762098||P999 Base 7.013226||P999 Cmp 36.846561||Pct Diff 425.386762098||P100 Base 52.23919||P100 Cmp 64.580159||Pct Diff 23.6239669872
||Task ('HighTermMonthSort', 'Month')||P50 Base 3.10961||P50 Cmp 4.719335||Pct Diff 51.7661378758||P90 Base 4.219546||P90 Cmp 7.510076||Pct Diff 77.9830341937||P99 Base 7.006885||P99 Cmp 8.783525||Pct Diff 25.355632353||P999 Base 7.006885||P999 Cmp 8.783525||Pct Diff 25.355632353||P100 Base 21.172234||P100 Cmp 27.0021||Pct Diff 27.5354315468
||Task Respell||P50 Base 16.937646||P50 Cmp 17.32516||Pct Diff 2.28788581365||P90 Base 160.246278||P90 Cmp 155.535973||Pct Diff -2.93941616541||P99 Base 247.468849||P99 Cmp 251.572807||Pct Diff 1.65837357574||P999 Base 247.468849||P999 Cmp 251.572807||Pct Diff 1.65837357574||P100 Base 336.107108||P100 Cmp 330.569414||Pct Diff -1.64759800319
||Task ('MedTerm', None)||P50 Base 1.030289||P50 Cmp 1.112219||Pct Diff 7.95213770117||P90 Base 1.48403||P90 Cmp 1.98772||Pct Diff 33.9406885306||P99 Base 3.036274||P99 Cmp 2.252594||Pct Diff -25.8105823124||P999 Base 3.036274||P999 Cmp 2.252594||Pct Diff -25.8105823124||P100 Base 4.609764||P100 Cmp 4.515779||Pct Diff -2.0388245472
||Task ('HighIntervalsOrdered', None)||P50 Base 17.363354||P50 Cmp 18.055466||Pct Diff 3.98605016059||P90 Base 27.42099||P90 Cmp 25.040248||Pct Diff -8.68218835279||P99 Base 28.538835||P99 Cmp 29.130089||Pct Diff 2.07175240335||P999 Base 28.538835||P999 Cmp 29.130089||Pct Diff 2.07175240335||P100 Base 168.479201||P100 Cmp 134.548637||Pct Diff -20.1393191555
||Task ('HighSpanNear', None)||P50 Base 18.710034||P50 Cmp 18.673593||Pct Diff -0.194767150076||P90 Base 28.947992||P90 Cmp 24.463424||Pct Diff -15.4918102782||P99 Base 38.76039||P99 Cmp 24.991596||Pct Diff -35.5228469063||P999 Base 38.76039||P999 Cmp 24.991596||Pct Diff -35.5228469063||P100 Base 69.84756||P100 Cmp 29.597757||Pct Diff -57.6252098141
||Task ('LowSloppyPhrase', None)||P50 Base 14.58923||P50 Cmp 14.791184||Pct Diff 1.38426770981||P90 Base 24.345895||P90 Cmp 25.228678||Pct Diff 3.62600348026||P99 Base 77.786176||P99 Cmp 74.545892||Pct Diff -4.16562963579||P999 Base 77.786176||P999 Cmp 74.545892||Pct Diff -4.16562963579||P100 Base 615.676341||P100 Cmp 381.997027||Pct Diff -37.9548958501
||Task ('OrHighNotHigh', None)||P50 Base 1.931916||P50 Cmp 1.756493||Pct Diff -9.08026021835||P90 Base 75.908705||P90 Cmp 3.032103||Pct Diff -96.0055925075||P99 Base 206.565879||P99 Cmp 8.496156||Pct Diff -95.8869509131||P999 Base 206.565879||P999 Cmp 8.496156||Pct Diff -95.8869509131||P100 Base 289.300458||P100 Cmp 295.709235||Pct Diff 2.21526680058
||Task ('OrNotHighLow', None)||P50 Base 1.272013||P50 Cmp 1.219156||Pct Diff -4.15538205977||P90 Base 1.848847||P90 Cmp 2.111743||Pct Diff 14.219456775||P99 Base 8.593548||P99 Cmp 5.179172||Pct Diff -39.7318546426||P999 Base 8.593548||P999 Cmp 5.179172||Pct Diff -39.7318546426||P100 Base 67.71686||P100 Cmp 36.390936||Pct Diff -46.2601544135
||Task ('MedSpanNear', None)||P50 Base 8.254112||P50 Cmp 8.598426||Pct Diff 4.17142389151||P90 Base 17.931309||P90 Cmp 19.130225||Pct Diff 6.68615994516||P99 Base 32.141681||P99 Cmp 25.545088||Pct Diff -20.5234847549||P999 Base 32.141681||P999 Cmp 25.545088||Pct Diff -20.5234847549||P100 Base 79.828034||P100 Cmp 79.154767||Pct Diff -0.843396694449
||Task ('BrowseDateTaxoFacets', None)||P50 Base 428.690775||P50 Cmp 431.041903||Pct Diff 0.548443805445||P90 Base 441.820042||P90 Cmp 440.339014||Pct Diff -0.335210687432||P99 Base 442.502061||P99 Cmp 459.90638||Pct Diff 3.93316111583||P999 Base 442.502061||P999 Cmp 459.90638||Pct Diff 3.93316111583||P100 Base 542.601567||P100 Cmp 546.793582||Pct Diff 0.772577016903
||Task ('HighPhrase', None)||P50 Base 4.189755||P50 Cmp 4.270044||Pct Diff 1.91631730256||P90 Base 56.167903||P90 Cmp 58.127715||Pct Diff 3.48920272135||P99 Base 73.213473||P99 Cmp 70.215526||Pct Diff -4.09480233235||P999 Base 73.213473||P999 Cmp 70.215526||Pct Diff -4.09480233235||P100 Base 123.589962||P100 Cmp 124.271249||Pct Diff 0.551247843251
||Task ('OrHighLow', None)||P50 Base 2.339689||P50 Cmp 2.281732||Pct Diff -2.47712409641||P90 Base 2.633916||P90 Cmp 6.179799||Pct Diff 134.623997121||P99 Base 13.008676||P99 Cmp 21.405393||Pct Diff 64.5470530591||P999 Base 13.008676||P999 Cmp 21.405393||Pct Diff 64.5470530591||P100 Base 85.96833||P100 Cmp 250.561017||Pct Diff 191.457350631
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.171008||P50 Cmp 0.176526||Pct Diff 3.22674962575||P90 Base 0.206906||P90 Cmp 0.201011||Pct Diff -2.84911989019||P99 Base 10.302348||P99 Cmp 0.206705||Pct Diff -97.9936127182||P999 Base 10.302348||P999 Cmp 0.206705||Pct Diff -97.9936127182||P100 Base 31.661115||P100 Cmp 31.246253||Pct Diff -1.31032024614
||Task ('OrHighMed', None)||P50 Base 3.150547||P50 Cmp 3.382344||Pct Diff 7.3573573097||P90 Base 7.161036||P90 Cmp 14.057962||Pct Diff 96.3118464982||P99 Base 23.860678||P99 Cmp 26.160045||Pct Diff 9.63663731601||P999 Base 23.860678||P999 Cmp 26.160045||Pct Diff 9.63663731601||P100 Base 34.678652||P100 Cmp 35.170454||Pct Diff 1.41816931062
||Task ('IntNRQ', None)||P50 Base 3.977374||P50 Cmp 3.946243||Pct Diff -0.782702355876||P90 Base 12.385871||P90 Cmp 21.366212||Pct Diff 72.5047192886||P99 Base 96.513871||P99 Cmp 83.963158||Pct Diff -13.0040509928||P999 Base 96.513871||P999 Cmp 83.963158||Pct Diff -13.0040509928||P100 Base 125.003817||P100 Cmp 110.008535||Pct Diff -11.9958592944
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.138811||P50 Cmp 0.159333||Pct Diff 14.7841309406||P90 Base 0.207954||P90 Cmp 0.195644||Pct Diff -5.91957836829||P99 Base 0.26394||P99 Cmp 0.224063||Pct Diff -15.1083579601||P999 Base 0.26394||P999 Cmp 0.224063||Pct Diff -15.1083579601||P100 Base 0.334007||P100 Cmp 0.34246||Pct Diff 2.53078528294
||Task ('AndHighMed', None)||P50 Base 3.246598||P50 Cmp 3.199841||Pct Diff -1.44018446386||P90 Base 4.502307||P90 Cmp 4.408219||Pct Diff -2.08977308744||P99 Base 4.531969||P99 Cmp 9.428554||Pct Diff 108.045421317||P999 Base 4.531969||P999 Cmp 9.428554||Pct Diff 108.045421317||P100 Base 5.876342||P100 Cmp 10.527317||Pct Diff 79.1474526159
||Task ('OrHighNotMed', None)||P50 Base 1.846992||P50 Cmp 1.911638||Pct Diff 3.50006930187||P90 Base 4.073542||P90 Cmp 4.480048||Pct Diff 9.97917782608||P99 Base 89.269698||P99 Cmp 84.236547||Pct Diff -5.63814050318||P999 Base 89.269698||P999 Cmp 84.236547||Pct Diff -5.63814050318||P100 Base 181.626198||P100 Cmp 93.878349||Pct Diff -48.3123304712
||Task ('Prefix3', None)||P50 Base 14.27848||P50 Cmp 14.744223||Pct Diff 3.26185280226||P90 Base 97.437514||P90 Cmp 98.179806||Pct Diff 0.761813360714||P99 Base 414.451145||P99 Cmp 457.718261||Pct Diff 10.4396179193||P999 Base 414.451145||P999 Cmp 457.718261||Pct Diff 10.4396179193||P100 Base 547.998871||P100 Cmp 475.614861||Pct Diff -13.2087881619
||Task PKLookup||P50 Base 10.936594||P50 Cmp 11.233169||Pct Diff 2.71176748447||P90 Base 59.429292||P90 Cmp 60.267753||Pct Diff 1.41085476839||P99 Base 385.339243||P99 Cmp 92.249544||Pct Diff -76.0601740737||P999 Base 385.339243||P999 Cmp 92.249544||Pct Diff -76.0601740737||P100 Base 454.445975||P100 Cmp 428.266101||Pct Diff -5.76083306712
||Task ('HighTerm', None)||P50 Base 1.219334||P50 Cmp 1.220338||Pct Diff 0.0823400315254||P90 Base 2.320326||P90 Cmp 2.017085||Pct Diff -13.0688963534||P99 Base 47.240677||P99 Cmp 2.298556||Pct Diff -95.1343711692||P999 Base 47.240677||P999 Cmp 2.298556||Pct Diff -95.1343711692||P100 Base 111.900368||P100 Cmp 71.370286||Pct Diff -36.2197933076
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
BrowseDayOfYearTaxoFacets 6114.58 (3.2%) 5782.44 (3.4%) -5.4% ( -11% - 1%)
Fuzzy1 60.92 (6.1%) 57.61 (12.8%) -5.4% ( -22% - 14%)
BrowseMonthTaxoFacets 6226.73 (6.5%) 5918.97 (4.0%) -4.9% ( -14% - 5%)
HighTerm 881.96 (3.8%) 849.67 (3.4%) -3.7% ( -10% - 3%)
OrHighNotMed 594.22 (4.1%) 573.36 (6.9%) -3.5% ( -13% - 7%)
HighTermMonthSort 338.60 (9.3%) 327.79 (21.4%) -3.2% ( -31% - 30%)
Wildcard 529.08 (6.9%) 512.67 (6.3%) -3.1% ( -15% - 10%)
LowPhrase 197.12 (4.3%) 192.09 (7.7%) -2.6% ( -14% - 9%)
OrHighNotLow 679.90 (5.5%) 667.78 (5.4%) -1.8% ( -11% - 9%)
OrNotHighMed 687.57 (5.3%) 676.73 (5.3%) -1.6% ( -11% - 9%)
MedTerm 978.27 (6.4%) 964.16 (3.7%) -1.4% ( -10% - 9%)
OrHighHigh 58.46 (5.2%) 57.65 (3.7%) -1.4% ( -9% - 7%)
OrNotHighHigh 548.13 (4.3%) 540.90 (5.2%) -1.3% ( -10% - 8%)
HighTermDayOfYearSort 286.58 (9.8%) 282.81 (9.7%) -1.3% ( -18% - 20%)
HighPhrase 243.26 (3.1%) 240.72 (4.1%) -1.0% ( -7% - 6%)
Prefix3 71.24 (4.6%) 70.68 (3.4%) -0.8% ( -8% - 7%)
AndHighHigh 197.96 (3.8%) 196.50 (2.2%) -0.7% ( -6% - 5%)
PKLookup 93.34 (2.8%) 92.87 (3.7%) -0.5% ( -6% - 6%)
MedPhrase 152.26 (3.4%) 151.59 (3.3%) -0.4% ( -6% - 6%)
BrowseDateTaxoFacets 2.32 (1.2%) 2.32 (1.2%) -0.1% ( -2% - 2%)
HighSloppyPhrase 108.92 (6.2%) 108.90 (6.2%) -0.0% ( -11% - 13%)
OrHighLow 442.53 (5.2%) 442.86 (4.8%) 0.1% ( -9% - 10%)
OrNotHighLow 824.96 (4.3%) 825.99 (4.5%) 0.1% ( -8% - 9%)
OrHighNotHigh 575.83 (6.3%) 576.61 (7.2%) 0.1% ( -12% - 14%)
LowSpanNear 43.49 (2.3%) 43.59 (2.1%) 0.2% ( -4% - 4%)
IntNRQ 255.02 (1.7%) 255.66 (3.5%) 0.3% ( -4% - 5%)
MedSpanNear 121.54 (2.2%) 121.97 (2.5%) 0.4% ( -4% - 5%)
Fuzzy2 38.91 (12.1%) 39.07 (6.6%) 0.4% ( -16% - 21%)
OrHighMed 309.72 (8.0%) 311.30 (5.5%) 0.5% ( -11% - 15%)
Respell 62.32 (2.6%) 62.64 (4.2%) 0.5% ( -6% - 7%)
LowTerm 1138.19 (2.3%) 1144.13 (5.4%) 0.5% ( -6% - 8%)
HighIntervalsOrdered 55.36 (4.9%) 55.96 (1.5%) 1.1% ( -5% - 7%)
LowSloppyPhrase 62.38 (7.8%) 63.35 (5.4%) 1.6% ( -10% - 16%)
AndHighLow 764.39 (3.4%) 779.30 (4.0%) 2.0% ( -5% - 9%)
AndHighMed 303.01 (6.4%) 313.90 (4.3%) 3.6% ( -6% - 15%)
BrowseMonthSSDVFacets 12.39 (22.9%) 12.93 (23.7%) 4.4% ( -34% - 66%)
HighSpanNear 52.77 (8.8%) 55.12 (2.0%) 4.5% ( -5% - 16%)
BrowseDayOfYearSSDVFacets 10.19 (19.3%) 10.66 (18.2%) 4.7% ( -27% - 52%)
MedSloppyPhrase 120.63 (7.1%) 126.77 (2.7%) 5.1% ( -4% - 16%)
iter 9
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.9 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -5217574 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.9 -topN 10 -pk
21.6 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.9 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -5217574 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.9 -topN 10 -pk
21.2 s
Report after iter 9:
||Task ('Wildcard', None)||P50 Base 1.733563||P50 Cmp 1.87032||Pct Diff 7.88878165951||P90 Base 13.324769||P90 Cmp 14.357966||Pct Diff 7.75395806111||P99 Base 16.147747||P99 Cmp 61.813418||Pct Diff 282.799024533||P999 Base 16.147747||P999 Cmp 61.813418||Pct Diff 282.799024533||P100 Base 23.610781||P100 Cmp 81.122096||Pct Diff 243.580739663
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 3.161949||P50 Cmp 4.685225||Pct Diff 48.1752235725||P90 Base 10.094149||P90 Cmp 64.824413||Pct Diff 542.197900982||P99 Base 82.571511||P99 Cmp 84.453058||Pct Diff 2.27868786366||P999 Base 82.571511||P999 Cmp 84.453058||Pct Diff 2.27868786366||P100 Base 82.985404||P100 Cmp 90.266621||Pct Diff 8.77409357434
||Task ('MedSloppyPhrase', None)||P50 Base 7.622736||P50 Cmp 8.040092||Pct Diff 5.47514698135||P90 Base 14.478763||P90 Cmp 15.39921||Pct Diff 6.35722126262||P99 Base 31.129051||P99 Cmp 37.239232||Pct Diff 19.6285489076||P999 Base 31.129051||P999 Cmp 37.239232||Pct Diff 19.6285489076||P100 Base 340.52056||P100 Cmp 348.234447||Pct Diff 2.26532195295
||Task ('OrHighHigh', None)||P50 Base 17.37428||P50 Cmp 19.606228||Pct Diff 12.8462762198||P90 Base 82.255414||P90 Cmp 44.984133||Pct Diff -45.3116447751||P99 Base 160.373331||P99 Cmp 128.733415||Pct Diff -19.7289136558||P999 Base 160.373331||P999 Cmp 128.733415||Pct Diff -19.7289136558||P100 Base 223.218757||P100 Cmp 204.750393||Pct Diff -8.27366133931
||Task ('MedPhrase', None)||P50 Base 6.912858||P50 Cmp 6.89422||Pct Diff -0.26961352309||P90 Base 10.06112||P90 Cmp 9.169661||Pct Diff -8.86043502115||P99 Base 11.624416||P99 Cmp 11.249706||Pct Diff -3.22347376419||P999 Base 11.624416||P999 Cmp 11.249706||Pct Diff -3.22347376419||P100 Base 44.545435||P100 Cmp 62.185083||Pct Diff 39.5992271711
||Task ('LowSpanNear', None)||P50 Base 22.512715||P50 Cmp 25.801153||Pct Diff 14.6070254076||P90 Base 35.817645||P90 Cmp 36.250058||Pct Diff 1.20726250986||P99 Base 55.306978||P99 Cmp 43.303114||Pct Diff -21.7040677941||P999 Base 55.306978||P999 Cmp 43.303114||Pct Diff -21.7040677941||P100 Base 150.655661||P100 Cmp 142.730452||Pct Diff -5.26047872838
||Task ('Fuzzy2', None)||P50 Base 29.641394||P50 Cmp 31.213413||Pct Diff 5.3034584001||P90 Base 182.632128||P90 Cmp 104.163894||Pct Diff -42.9651862787||P99 Base 193.636122||P99 Cmp 188.556796||Pct Diff -2.62312937666||P999 Base 193.636122||P999 Cmp 188.556796||Pct Diff -2.62312937666||P100 Base 197.481462||P100 Cmp 193.057385||Pct Diff -2.24024926451
||Task ('OrNotHighHigh', None)||P50 Base 1.807045||P50 Cmp 1.995461||Pct Diff 10.4267464286||P90 Base 7.544094||P90 Cmp 8.039816||Pct Diff 6.57099447594||P99 Base 20.282575||P99 Cmp 25.101267||Pct Diff 23.7577920949||P999 Base 20.282575||P999 Cmp 25.101267||Pct Diff 23.7577920949||P100 Base 76.426474||P100 Cmp 96.6889||Pct Diff 26.5123129977
||Task ('OrHighNotLow', None)||P50 Base 1.65129||P50 Cmp 1.77899||Pct Diff 7.73334786742||P90 Base 4.252728||P90 Cmp 7.834578||Pct Diff 84.2247611416||P99 Base 8.989428||P99 Cmp 8.523791||Pct Diff -5.17982901693||P999 Base 8.989428||P999 Cmp 8.523791||Pct Diff -5.17982901693||P100 Base 15.393371||P100 Cmp 37.74416||Pct Diff 145.197494428
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 63.030782||P50 Cmp 62.436517||Pct Diff -0.942817114343||P90 Base 72.094304||P90 Cmp 81.179802||Pct Diff 12.6022410869||P99 Base 89.900837||P99 Cmp 82.664642||Pct Diff -8.04908523822||P999 Base 89.900837||P999 Cmp 82.664642||Pct Diff -8.04908523822||P100 Base 277.706289||P100 Cmp 264.109287||Pct Diff -4.89618079913
||Task ('Fuzzy1', None)||P50 Base 17.572499||P50 Cmp 17.549532||Pct Diff -0.13069854208||P90 Base 46.039029||P90 Cmp 90.449463||Pct Diff 96.4625774362||P99 Base 67.79386||P99 Cmp 147.990096||Pct Diff 118.294246706||P999 Base 67.79386||P999 Cmp 147.990096||Pct Diff 118.294246706||P100 Base 414.256393||P100 Cmp 359.791727||Pct Diff -13.1475740436
||Task ('HighSloppyPhrase', None)||P50 Base 8.846582||P50 Cmp 9.198808||Pct Diff 3.98149251315||P90 Base 13.172213||P90 Cmp 11.411176||Pct Diff -13.3693328524||P99 Base 14.653318||P99 Cmp 12.693211||Pct Diff -13.3765403849||P999 Base 14.653318||P999 Cmp 12.693211||Pct Diff -13.3765403849||P100 Base 14.810861||P100 Cmp 13.554013||Pct Diff -8.4859887619
||Task ('OrNotHighMed', None)||P50 Base 1.62361||P50 Cmp 1.71791||Pct Diff 5.80804503545||P90 Base 4.28448||P90 Cmp 4.765758||Pct Diff 11.2330551199||P99 Base 7.35332||P99 Cmp 6.755474||Pct Diff -8.13028672763||P999 Base 7.35332||P999 Cmp 6.755474||Pct Diff -8.13028672763||P100 Base 113.107821||P100 Cmp 144.743597||Pct Diff 27.9695742702
||Task ('LowPhrase', None)||P50 Base 5.290567||P50 Cmp 5.554738||Pct Diff 4.99324552548||P90 Base 7.393683||P90 Cmp 7.909988||Pct Diff 6.98305567063||P99 Base 14.520406||P99 Cmp 11.628713||Pct Diff -19.9146842037||P999 Base 14.520406||P999 Cmp 11.628713||Pct Diff -19.9146842037||P100 Base 119.559151||P100 Cmp 124.369248||Pct Diff 4.02319434336
||Task ('AndHighLow', None)||P50 Base 1.352892||P50 Cmp 1.434352||Pct Diff 6.02117537837||P90 Base 10.184009||P90 Cmp 10.869356||Pct Diff 6.72963859321||P99 Base 43.688537||P99 Cmp 57.530746||Pct Diff 31.6838464973||P999 Base 43.688537||P999 Cmp 57.530746||Pct Diff 31.6838464973||P100 Base 291.108194||P100 Cmp 292.976395||Pct Diff 0.64175486589
||Task ('LowTerm', None)||P50 Base 0.911213||P50 Cmp 0.919273||Pct Diff 0.884535229414||P90 Base 2.246964||P90 Cmp 2.608407||Pct Diff 16.0858384914||P99 Base 11.880342||P99 Cmp 9.470995||Pct Diff -20.2801148317||P999 Base 11.880342||P999 Cmp 9.470995||Pct Diff -20.2801148317||P100 Base 22.967231||P100 Cmp 107.035174||Pct Diff 366.034299041
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 76.188089||P50 Cmp 76.64778||Pct Diff 0.603363342005||P90 Base 78.489747||P90 Cmp 79.138647||Pct Diff 0.826732184523||P99 Base 93.17731||P99 Cmp 90.232759||Pct Diff -3.16015884125||P999 Base 93.17731||P999 Cmp 90.232759||Pct Diff -3.16015884125||P100 Base 241.752252||P100 Cmp 229.833759||Pct Diff -4.93004425043
||Task ('AndHighHigh', None)||P50 Base 5.500652||P50 Cmp 5.411988||Pct Diff -1.61188164603||P90 Base 8.4679||P90 Cmp 7.454974||Pct Diff -11.9619504245||P99 Base 10.750869||P99 Cmp 10.089023||Pct Diff -6.15620932596||P999 Base 10.750869||P999 Cmp 10.089023||Pct Diff -6.15620932596||P100 Base 38.570817||P100 Cmp 32.968589||Pct Diff -14.5245251092
||Task ('HighTermMonthSort', 'Month')||P50 Base 2.86701||P50 Cmp 4.061493||Pct Diff 41.6630217544||P90 Base 4.211837||P90 Cmp 6.981368||Pct Diff 65.7558922627||P99 Base 6.917625||P99 Cmp 8.344608||Pct Diff 20.628221391||P999 Base 6.917625||P999 Cmp 8.344608||Pct Diff 20.628221391||P100 Base 30.490078||P100 Cmp 61.385873||Pct Diff 101.330652549
||Task Respell||P50 Base 15.774821||P50 Cmp 16.763546||Pct Diff 6.26774148499||P90 Base 172.8121||P90 Cmp 169.70965||Pct Diff -1.79527359485||P99 Base 250.774097||P99 Cmp 254.664067||Pct Diff 1.5511849296||P999 Base 250.774097||P999 Cmp 254.664067||Pct Diff 1.5511849296||P100 Base 715.211881||P100 Cmp 810.554151||Pct Diff 13.3306328562
||Task ('MedTerm', None)||P50 Base 1.108659||P50 Cmp 1.078879||Pct Diff -2.68612801592||P90 Base 1.298428||P90 Cmp 1.606664||Pct Diff 23.7391676704||P99 Base 1.548941||P99 Cmp 1.901901||Pct Diff 22.7871816938||P999 Base 1.548941||P999 Cmp 1.901901||Pct Diff 22.7871816938||P100 Base 1.852073||P100 Cmp 10.633114||Pct Diff 474.119594638
||Task ('HighIntervalsOrdered', None)||P50 Base 18.248231||P50 Cmp 18.052445||Pct Diff -1.0729039982||P90 Base 27.764713||P90 Cmp 29.730848||Pct Diff 7.08141661684||P99 Base 29.829425||P99 Cmp 29.890199||Pct Diff 0.203738422715||P999 Base 29.829425||P999 Cmp 29.890199||Pct Diff 0.203738422715||P100 Base 79.291516||P100 Cmp 61.432891||Pct Diff -22.5227437952
||Task ('HighSpanNear', None)||P50 Base 18.306964||P50 Cmp 19.893888||Pct Diff 8.66841711165||P90 Base 28.050413||P90 Cmp 29.554801||Pct Diff 5.36315811108||P99 Base 28.567113||P99 Cmp 35.763413||Pct Diff 25.1908549527||P999 Base 28.567113||P999 Cmp 35.763413||Pct Diff 25.1908549527||P100 Base 122.946175||P100 Cmp 123.900832||Pct Diff 0.776483692966
||Task ('LowSloppyPhrase', None)||P50 Base 15.578877||P50 Cmp 19.626336||Pct Diff 25.9804284994||P90 Base 26.570917||P90 Cmp 25.625348||Pct Diff -3.55866152455||P99 Base 28.17535||P99 Cmp 28.886969||Pct Diff 2.52567936157||P999 Base 28.17535||P999 Cmp 28.886969||Pct Diff 2.52567936157||P100 Base 67.271841||P100 Cmp 31.042294||Pct Diff -53.8554415361
||Task ('OrHighNotHigh', None)||P50 Base 1.6649||P50 Cmp 1.826942||Pct Diff 9.73283680702||P90 Base 2.499174||P90 Cmp 2.486875||Pct Diff -0.492122597306||P99 Base 2.671061||P99 Cmp 2.813288||Pct Diff 5.32473799737||P999 Base 2.671061||P999 Cmp 2.813288||Pct Diff 5.32473799737||P100 Base 3.795438||P100 Cmp 3.931965||Pct Diff 3.59713424379
||Task ('OrNotHighLow', None)||P50 Base 1.286426||P50 Cmp 1.278515||Pct Diff -0.614959585705||P90 Base 1.940678||P90 Cmp 2.019494||Pct Diff 4.06126106443||P99 Base 4.972598||P99 Cmp 5.064594||Pct Diff 1.85005906369||P999 Base 4.972598||P999 Cmp 5.064594||Pct Diff 1.85005906369||P100 Base 30.736904||P100 Cmp 25.40957||Pct Diff -17.332044893
||Task ('MedSpanNear', None)||P50 Base 8.336468||P50 Cmp 8.402764||Pct Diff 0.795252857685||P90 Base 12.477008||P90 Cmp 9.361746||Pct Diff -24.9680211794||P99 Base 13.149508||P99 Cmp 11.991109||Pct Diff -8.80944747134||P999 Base 13.149508||P999 Cmp 11.991109||Pct Diff -8.80944747134||P100 Base 13.560248||P100 Cmp 18.263502||Pct Diff 34.6841296708
||Task ('BrowseDateTaxoFacets', None)||P50 Base 430.9514||P50 Cmp 429.518455||Pct Diff -0.332507331453||P90 Base 453.994165||P90 Cmp 440.404403||Pct Diff -2.99337811974||P99 Base 468.291146||P99 Cmp 443.585171||Pct Diff -5.2757723931||P999 Base 468.291146||P999 Cmp 443.585171||Pct Diff -5.2757723931||P100 Base 603.02675||P100 Cmp 552.576757||Pct Diff -8.3661285341
||Task ('HighPhrase', None)||P50 Base 4.277189||P50 Cmp 4.469884||Pct Diff 4.50517851795||P90 Base 18.366582||P90 Cmp 5.589678||Pct Diff -69.5660411937||P99 Base 25.544215||P99 Cmp 20.510024||Pct Diff -19.7077537908||P999 Base 25.544215||P999 Cmp 20.510024||Pct Diff -19.7077537908||P100 Base 129.958893||P100 Cmp 107.208476||Pct Diff -17.5058562556
||Task ('OrHighLow', None)||P50 Base 2.388171||P50 Cmp 2.415589||Pct Diff 1.14807524252||P90 Base 4.087598||P90 Cmp 9.39563||Pct Diff 129.856996701||P99 Base 18.489962||P99 Cmp 20.22119||Pct Diff 9.36306954011||P999 Base 18.489962||P999 Cmp 20.22119||Pct Diff 9.36306954011||P100 Base 22.084259||P100 Cmp 73.180694||Pct Diff 231.370384671
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.168934||P50 Cmp 0.183321||Pct Diff 8.51634366084||P90 Base 0.195608||P90 Cmp 0.198419||Pct Diff 1.43705778905||P99 Base 0.242601||P99 Cmp 0.215523||Pct Diff -11.1615368444||P999 Base 0.242601||P999 Cmp 0.215523||Pct Diff -11.1615368444||P100 Base 0.332674||P100 Cmp 0.361865||Pct Diff 8.7746562701
||Task ('OrHighMed', None)||P50 Base 4.101653||P50 Cmp 3.222416||Pct Diff -21.4361624448||P90 Base 19.071254||P90 Cmp 14.708851||Pct Diff -22.8742326016||P99 Base 50.633234||P99 Cmp 51.189576||Pct Diff 1.0987684492||P999 Base 50.633234||P999 Cmp 51.189576||Pct Diff 1.0987684492||P100 Base 144.278259||P100 Cmp 205.976061||Pct Diff 42.7630624514
||Task ('IntNRQ', None)||P50 Base 3.940643||P50 Cmp 4.070036||Pct Diff 3.28355042565||P90 Base 12.502179||P90 Cmp 12.581835||Pct Diff 0.63713693429||P99 Base 86.460297||P99 Cmp 86.75622||Pct Diff 0.342264611929||P999 Base 86.460297||P999 Cmp 86.75622||Pct Diff 0.342264611929||P100 Base 100.37051||P100 Cmp 88.450122||Pct Diff -11.8763848067
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.165315||P50 Cmp 0.173149||Pct Diff 4.73883192693||P90 Base 0.22886||P90 Cmp 0.19867||Pct Diff -13.1914707682||P99 Base 0.274908||P99 Cmp 0.469553||Pct Diff 70.8036870517||P999 Base 0.274908||P999 Cmp 0.469553||Pct Diff 70.8036870517||P100 Base 32.392762||P100 Cmp 40.053132||Pct Diff 23.6484002198
||Task ('AndHighMed', None)||P50 Base 3.696111||P50 Cmp 4.25466||Pct Diff 15.1118026488||P90 Base 8.642547||P90 Cmp 8.483115||Pct Diff -1.84473396558||P99 Base 24.534191||P99 Cmp 23.029919||Pct Diff -6.13132913166||P999 Base 24.534191||P999 Cmp 23.029919||Pct Diff -6.13132913166||P100 Base 30.918555||P100 Cmp 23.302968||Pct Diff -24.6311219913
||Task ('OrHighNotMed', None)||P50 Base 1.816617||P50 Cmp 2.088657||Pct Diff 14.9750883098||P90 Base 2.808072||P90 Cmp 8.827476||Pct Diff 214.360742887||P99 Base 2.964587||P99 Cmp 12.92687||Pct Diff 336.042861957||P999 Base 2.964587||P999 Cmp 12.92687||Pct Diff 336.042861957||P100 Base 7.872613||P100 Cmp 67.585969||Pct Diff 758.494746281
||Task ('Prefix3', None)||P50 Base 14.773771||P50 Cmp 15.880017||Pct Diff 7.48790542374||P90 Base 68.01795||P90 Cmp 68.69062||Pct Diff 0.988959532006||P99 Base 289.538964||P99 Cmp 290.825194||Pct Diff 0.444233819943||P999 Base 289.538964||P999 Cmp 290.825194||Pct Diff 0.444233819943||P100 Base 417.248441||P100 Cmp 431.191064||Pct Diff 3.34156383343
||Task PKLookup||P50 Base 10.960755||P50 Cmp 11.179077||Pct Diff 1.99185183867||P90 Base 11.820521||P90 Cmp 72.083578||Pct Diff 509.817266092||P99 Base 84.68662||P99 Cmp 135.081283||Pct Diff 59.5072314847||P999 Base 84.68662||P999 Cmp 135.081283||Pct Diff 59.5072314847||P100 Base 210.254867||P100 Cmp 207.661761||Pct Diff -1.23331556458
||Task ('HighTerm', None)||P50 Base 1.272887||P50 Cmp 1.230582||Pct Diff -3.32354718054||P90 Base 3.57563||P90 Cmp 2.520357||Pct Diff -29.512924995||P99 Base 4.146035||P99 Cmp 4.025825||Pct Diff -2.89939665246||P999 Base 4.146035||P999 Cmp 4.025825||Pct Diff -2.89939665246||P100 Base 80.35077||P100 Cmp 19.780477||Pct Diff -75.3823429446
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
HighTermMonthSort 339.80 (8.8%) 319.88 (21.4%) -5.9% ( -33% - 26%)
BrowseDayOfYearTaxoFacets 6116.73 (3.1%) 5770.02 (3.3%) -5.7% ( -11% - 0%)
BrowseMonthTaxoFacets 6216.87 (6.2%) 5919.17 (3.8%) -4.8% ( -13% - 5%)
Fuzzy1 60.57 (6.1%) 57.83 (12.2%) -4.5% ( -21% - 14%)
HighTermDayOfYearSort 290.51 (10.0%) 278.09 (10.3%) -4.3% ( -22% - 17%)
OrHighNotMed 591.32 (4.2%) 567.06 (7.3%) -4.1% ( -14% - 7%)
Wildcard 534.45 (7.1%) 515.58 (6.2%) -3.5% ( -15% - 10%)
HighTerm 876.81 (4.0%) 846.90 (3.3%) -3.4% ( -10% - 4%)
OrHighHigh 58.38 (4.9%) 56.62 (6.4%) -3.0% ( -13% - 8%)
LowPhrase 196.51 (4.2%) 190.97 (7.6%) -2.8% ( -14% - 9%)
OrNotHighHigh 549.63 (4.1%) 538.39 (5.1%) -2.0% ( -10% - 7%)
OrHighNotLow 675.68 (5.6%) 664.38 (5.3%) -1.7% ( -11% - 9%)
OrNotHighMed 682.33 (5.5%) 670.97 (5.6%) -1.7% ( -12% - 10%)
HighPhrase 242.80 (3.0%) 239.43 (4.2%) -1.4% ( -8% - 5%)
MedTerm 974.83 (6.2%) 962.59 (3.5%) -1.3% ( -10% - 9%)
Prefix3 70.89 (4.6%) 70.11 (4.1%) -1.1% ( -9% - 7%)
PKLookup 93.20 (2.7%) 92.54 (3.7%) -0.7% ( -6% - 5%)
LowSpanNear 43.59 (2.2%) 43.33 (2.6%) -0.6% ( -5% - 4%)
AndHighHigh 196.62 (4.2%) 195.53 (2.5%) -0.6% ( -6% - 6%)
OrHighLow 442.67 (4.9%) 440.24 (4.9%) -0.6% ( -9% - 9%)
OrHighNotHigh 579.50 (6.3%) 576.41 (6.8%) -0.5% ( -12% - 13%)
HighSloppyPhrase 109.62 (6.2%) 109.07 (5.9%) -0.5% ( -11% - 12%)
MedPhrase 151.71 (3.4%) 151.17 (3.2%) -0.4% ( -6% - 6%)
LowSloppyPhrase 62.59 (7.5%) 62.40 (6.9%) -0.3% ( -13% - 15%)
IntNRQ 255.18 (1.7%) 254.86 (3.4%) -0.1% ( -5% - 5%)
BrowseDateTaxoFacets 2.32 (1.1%) 2.32 (1.2%) -0.0% ( -2% - 2%)
Fuzzy2 38.90 (11.5%) 38.90 (6.4%) -0.0% ( -15% - 20%)
MedSpanNear 121.52 (2.1%) 121.79 (2.4%) 0.2% ( -4% - 4%)
OrNotHighLow 821.59 (4.2%) 823.96 (4.4%) 0.3% ( -8% - 9%)
LowTerm 1136.33 (2.2%) 1139.75 (5.2%) 0.3% ( -6% - 7%)
Respell 62.48 (2.6%) 62.70 (4.0%) 0.4% ( -6% - 7%)
OrHighMed 308.69 (7.7%) 311.40 (5.2%) 0.9% ( -11% - 14%)
HighIntervalsOrdered 55.28 (4.6%) 55.93 (1.4%) 1.2% ( -4% - 7%)
AndHighMed 300.36 (6.7%) 306.01 (8.9%) 1.9% ( -12% - 18%)
AndHighLow 764.80 (3.3%) 780.67 (3.9%) 2.1% ( -4% - 9%)
HighSpanNear 53.11 (8.5%) 54.78 (2.7%) 3.1% ( -7% - 15%)
MedSloppyPhrase 121.79 (7.3%) 126.50 (2.6%) 3.9% ( -5% - 14%)
BrowseDayOfYearSSDVFacets 10.48 (19.7%) 10.90 (18.1%) 4.0% ( -28% - 52%)
BrowseMonthSSDVFacets 12.74 (22.7%) 13.25 (23.1%) 4.0% ( -34% - 64%)
iter 10
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.10 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -4270698 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.10 -topN 10 -pk
21.8 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.10 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -4270698 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.10 -topN 10 -pk
22.5 s
Report after iter 10:
||Task ('Wildcard', None)||P50 Base 2.164401||P50 Cmp 2.242911||Pct Diff 3.62733153422||P90 Base 14.919023||P90 Cmp 16.642389||Pct Diff 11.5514668755||P99 Base 29.229367||P99 Cmp 28.305282||Pct Diff -3.1614950813||P999 Base 29.229367||P999 Cmp 28.305282||Pct Diff -3.1614950813||P100 Base 145.143449||P100 Cmp 162.843584||Pct Diff 12.1949251736
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 3.991072||P50 Cmp 4.983314||Pct Diff 24.8615409594||P90 Base 76.527582||P90 Cmp 77.842551||Pct Diff 1.7182941962||P99 Base 134.918228||P99 Cmp 100.629011||Pct Diff -25.4148142236||P999 Base 134.918228||P999 Cmp 100.629011||Pct Diff -25.4148142236||P100 Base 261.431061||P100 Cmp 131.298632||Pct Diff -49.7769578344
||Task ('MedSloppyPhrase', None)||P50 Base 11.138965||P50 Cmp 8.279447||Pct Diff -25.6713078818||P90 Base 13.54716||P90 Cmp 12.398545||Pct Diff -8.47864054163||P99 Base 15.279804||P99 Cmp 13.886604||Pct Diff -9.11791800471||P999 Base 15.279804||P999 Cmp 13.886604||Pct Diff -9.11791800471||P100 Base 165.624335||P100 Cmp 138.303928||Pct Diff -16.4954063061
||Task ('OrHighHigh', None)||P50 Base 17.193298||P50 Cmp 18.942963||Pct Diff 10.1764361904||P90 Base 28.462287||P90 Cmp 26.910286||Pct Diff -5.45283307698||P99 Base 32.177855||P99 Cmp 29.04484||Pct Diff -9.7365563988||P999 Base 32.177855||P999 Cmp 29.04484||Pct Diff -9.7365563988||P100 Base 47.833993||P100 Cmp 53.120989||Pct Diff 11.0528008816
||Task ('MedPhrase', None)||P50 Base 6.71747||P50 Cmp 6.607248||Pct Diff -1.64082608482||P90 Base 11.040443||P90 Cmp 12.402798||Pct Diff 12.3396769496||P99 Base 105.613151||P99 Cmp 102.866879||Pct Diff -2.60031253115||P999 Base 105.613151||P999 Cmp 102.866879||Pct Diff -2.60031253115||P100 Base 915.406047||P100 Cmp 415.995261||Pct Diff -54.5562035161
||Task ('LowSpanNear', None)||P50 Base 27.855617||P50 Cmp 24.453231||Pct Diff -12.2143623672||P90 Base 36.841599||P90 Cmp 32.610298||Pct Diff -11.4851176791||P99 Base 38.879835||P99 Cmp 36.717317||Pct Diff -5.56205549741||P999 Base 38.879835||P999 Cmp 36.717317||Pct Diff -5.56205549741||P100 Base 43.25858||P100 Cmp 42.110264||Pct Diff -2.65453928446
||Task ('Fuzzy2', None)||P50 Base 28.233998||P50 Cmp 31.746431||Pct Diff 12.4404379429||P90 Base 109.996981||P90 Cmp 127.460232||Pct Diff 15.8761184546||P99 Base 174.761433||P99 Cmp 166.120218||Pct Diff -4.94457778908||P999 Base 174.761433||P999 Cmp 166.120218||Pct Diff -4.94457778908||P100 Base 853.068364||P100 Cmp 940.924662||Pct Diff 10.2988578299
||Task ('OrNotHighHigh', None)||P50 Base 1.94978||P50 Cmp 1.92988||Pct Diff -1.02062796828||P90 Base 3.606292||P90 Cmp 4.398298||Pct Diff 21.9617823515||P99 Base 4.997206||P99 Cmp 7.727167||Pct Diff 54.6297471027||P999 Base 4.997206||P999 Cmp 7.727167||Pct Diff 54.6297471027||P100 Base 14.006655||P100 Cmp 12.103005||Pct Diff -13.5910394023
||Task ('OrHighNotLow', None)||P50 Base 1.813115||P50 Cmp 1.743222||Pct Diff -3.85485752421||P90 Base 21.628787||P90 Cmp 17.272164||Pct Diff -20.1427061074||P99 Base 38.555522||P99 Cmp 33.344364||Pct Diff -13.5159835211||P999 Base 38.555522||P999 Cmp 33.344364||Pct Diff -13.5159835211||P100 Base 79.157607||P100 Cmp 38.881474||Pct Diff -50.8809380759
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 90.898482||P50 Cmp 90.703252||Pct Diff -0.214778064171||P90 Base 110.190481||P90 Cmp 109.737503||Pct Diff -0.41108632605||P99 Base 112.226416||P99 Cmp 115.324264||Pct Diff 2.76035545856||P999 Base 112.226416||P999 Cmp 115.324264||Pct Diff 2.76035545856||P100 Base 172.343834||P100 Cmp 155.336586||Pct Diff -9.86820799171
||Task ('Fuzzy1', None)||P50 Base 21.161313||P50 Cmp 19.203503||Pct Diff -9.25183612189||P90 Base 145.842491||P90 Cmp 104.58097||Pct Diff -28.2918378019||P99 Base 166.415208||P99 Cmp 184.614261||Pct Diff 10.9359314084||P999 Base 166.415208||P999 Cmp 184.614261||Pct Diff 10.9359314084||P100 Base 320.03954||P100 Cmp 346.807072||Pct Diff 8.36382029545
||Task ('HighSloppyPhrase', None)||P50 Base 10.230452||P50 Cmp 9.432991||Pct Diff -7.79497328173||P90 Base 15.212841||P90 Cmp 13.469782||Pct Diff -11.4578138298||P99 Base 15.382913||P99 Cmp 16.392703||Pct Diff 6.56436137941||P999 Base 15.382913||P999 Cmp 16.392703||Pct Diff 6.56436137941||P100 Base 23.411912||P100 Cmp 30.311168||Pct Diff 29.4689985167
||Task ('OrNotHighMed', None)||P50 Base 1.535993||P50 Cmp 1.529675||Pct Diff -0.411329999551||P90 Base 3.094264||P90 Cmp 2.561753||Pct Diff -17.2096175375||P99 Base 3.239224||P99 Cmp 3.71312||Pct Diff 14.6299237101||P999 Base 3.239224||P999 Cmp 3.71312||Pct Diff 14.6299237101||P100 Base 277.887044||P100 Cmp 208.526211||Pct Diff -24.9600816222
||Task ('LowPhrase', None)||P50 Base 6.138253||P50 Cmp 5.764938||Pct Diff -6.08177929453||P90 Base 15.039797||P90 Cmp 25.413718||Pct Diff 68.9764695627||P99 Base 24.08516||P99 Cmp 27.583008||Pct Diff 14.5228348078||P999 Base 24.08516||P999 Cmp 27.583008||Pct Diff 14.5228348078||P100 Base 73.274214||P100 Cmp 70.166109||Pct Diff -4.2417445788
||Task ('AndHighLow', None)||P50 Base 1.365378||P50 Cmp 1.389258||Pct Diff 1.74896622034||P90 Base 2.248811||P90 Cmp 2.290519||Pct Diff 1.85466897841||P99 Base 2.622803||P99 Cmp 2.488049||Pct Diff -5.13778579634||P999 Base 2.622803||P999 Cmp 2.488049||Pct Diff -5.13778579634||P100 Base 13.916974||P100 Cmp 5.657222||Pct Diff -59.3502006974
||Task ('LowTerm', None)||P50 Base 0.849339||P50 Cmp 0.876168||Pct Diff 3.15880938||P90 Base 3.727616||P90 Cmp 3.777706||Pct Diff 1.34375429229||P99 Base 10.602658||P99 Cmp 10.644741||Pct Diff 0.396909906931||P999 Base 10.602658||P999 Cmp 10.644741||Pct Diff 0.396909906931||P100 Base 41.409093||P100 Cmp 40.603206||Pct Diff -1.94615950656
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 110.045819||P50 Cmp 109.729228||Pct Diff -0.287690166584||P90 Base 129.40251||P90 Cmp 121.471028||Pct Diff -6.12931078385||P99 Base 258.068502||P99 Cmp 240.062129||Pct Diff -6.9773617704||P999 Base 258.068502||P999 Cmp 240.062129||Pct Diff -6.9773617704||P100 Base 282.491617||P100 Cmp 276.008692||Pct Diff -2.29490880786
||Task ('AndHighHigh', None)||P50 Base 5.225027||P50 Cmp 5.648106||Pct Diff 8.09716389982||P90 Base 26.550752||P90 Cmp 23.960186||Pct Diff -9.75703437703||P99 Base 59.375843||P99 Cmp 59.859277||Pct Diff 0.814193071751||P999 Base 59.375843||P999 Cmp 59.859277||Pct Diff 0.814193071751||P100 Base 878.104669||P100 Cmp 346.164498||Pct Diff -60.5782191781
||Task ('HighTermMonthSort', 'Month')||P50 Base 3.268669||P50 Cmp 2.915967||Pct Diff -10.7903859338||P90 Base 4.636602||P90 Cmp 5.041006||Pct Diff 8.72199080275||P99 Base 43.257833||P99 Cmp 41.053875||Pct Diff -5.0949339048||P999 Base 43.257833||P999 Cmp 41.053875||Pct Diff -5.0949339048||P100 Base 72.603021||P100 Cmp 85.665321||Pct Diff 17.9914001099
||Task Respell||P50 Base 16.403495||P50 Cmp 17.63886||Pct Diff 7.53110846195||P90 Base 60.929245||P90 Cmp 43.08663||Pct Diff -29.2841557449||P99 Base 255.754976||P99 Cmp 247.713136||Pct Diff -3.14435328914||P999 Base 255.754976||P999 Cmp 247.713136||Pct Diff -3.14435328914||P100 Base 265.116422||P100 Cmp 260.170577||Pct Diff -1.86553702056
||Task ('MedTerm', None)||P50 Base 1.046263||P50 Cmp 1.096619||Pct Diff 4.81293900291||P90 Base 1.406127||P90 Cmp 1.903168||Pct Diff 35.3482295696||P99 Base 2.133682||P99 Cmp 2.456378||Pct Diff 15.1239031871||P999 Base 2.133682||P999 Cmp 2.456378||Pct Diff 15.1239031871||P100 Base 10.118025||P100 Cmp 3.421317||Pct Diff -66.1859206713
||Task ('HighIntervalsOrdered', None)||P50 Base 18.755549||P50 Cmp 17.589202||Pct Diff -6.21867693662||P90 Base 27.126171||P90 Cmp 18.870115||Pct Diff -30.4357588839||P99 Base 27.734474||P99 Cmp 19.318508||Pct Diff -30.3447831749||P999 Base 27.734474||P999 Cmp 19.318508||Pct Diff -30.3447831749||P100 Base 71.796819||P100 Cmp 81.648397||Pct Diff 13.721468635
||Task ('HighSpanNear', None)||P50 Base 20.882468||P50 Cmp 19.572308||Pct Diff -6.27397106511||P90 Base 29.014273||P90 Cmp 27.252605||Pct Diff -6.07172890391||P99 Base 30.464415||P99 Cmp 28.467515||Pct Diff -6.55486081056||P999 Base 30.464415||P999 Cmp 28.467515||Pct Diff -6.55486081056||P100 Base 170.780697||P100 Cmp 184.322044||Pct Diff 7.9290852174
||Task ('LowSloppyPhrase', None)||P50 Base 18.076343||P50 Cmp 15.922888||Pct Diff -11.9131120714||P90 Base 30.397425||P90 Cmp 25.434941||Pct Diff -16.3253433473||P99 Base 33.067491||P99 Cmp 25.759989||Pct Diff -22.0987494939||P999 Base 33.067491||P999 Cmp 25.759989||Pct Diff -22.0987494939||P100 Base 70.654184||P100 Cmp 35.661733||Pct Diff -49.526367752
||Task ('OrHighNotHigh', None)||P50 Base 1.825416||P50 Cmp 1.792039||Pct Diff -1.82845992366||P90 Base 2.774359||P90 Cmp 3.781419||Pct Diff 36.2988351544||P99 Base 10.557724||P99 Cmp 6.645244||Pct Diff -37.0579871192||P999 Base 10.557724||P999 Cmp 6.645244||Pct Diff -37.0579871192||P100 Base 11.554879||P100 Cmp 11.076026||Pct Diff -4.14416282507
||Task ('OrNotHighLow', None)||P50 Base 1.250962||P50 Cmp 1.343691||Pct Diff 7.4126152513||P90 Base 2.781252||P90 Cmp 3.78194||Pct Diff 35.9797673853||P99 Base 3.679118||P99 Cmp 7.360414||Pct Diff 100.059198971||P999 Base 3.679118||P999 Cmp 7.360414||Pct Diff 100.059198971||P100 Base 80.182184||P100 Cmp 78.238972||Pct Diff -2.42349597262
||Task ('MedSpanNear', None)||P50 Base 8.757979||P50 Cmp 8.311117||Pct Diff -5.10234153336||P90 Base 12.744637||P90 Cmp 12.622856||Pct Diff -0.95554702735||P99 Base 13.391843||P99 Cmp 17.854196||Pct Diff 33.3214255872||P999 Base 13.391843||P999 Cmp 17.854196||Pct Diff 33.3214255872||P100 Base 51.449081||P100 Cmp 51.100977||Pct Diff -0.676599063062
||Task ('BrowseDateTaxoFacets', None)||P50 Base 430.937116||P50 Cmp 427.11461||Pct Diff -0.887021762126||P90 Base 479.400118||P90 Cmp 437.759143||Pct Diff -8.68605856288||P99 Base 481.703642||P99 Cmp 495.038901||Pct Diff 2.76835336861||P999 Base 481.703642||P999 Cmp 495.038901||Pct Diff 2.76835336861||P100 Base 523.873211||P100 Cmp 531.184573||Pct Diff 1.39563578486
||Task ('HighPhrase', None)||P50 Base 4.137319||P50 Cmp 4.244071||Pct Diff 2.58022163628||P90 Base 4.822961||P90 Cmp 7.21919||Pct Diff 49.6837731012||P99 Base 5.032503||P99 Cmp 7.527307||Pct Diff 49.573820423||P999 Base 5.032503||P999 Cmp 7.527307||Pct Diff 49.573820423||P100 Base 69.050725||P100 Cmp 72.039681||Pct Diff 4.3286381135
||Task ('OrHighLow', None)||P50 Base 2.388797||P50 Cmp 2.216361||Pct Diff -7.21852882434||P90 Base 10.668715||P90 Cmp 7.743077||Pct Diff -27.4225902557||P99 Base 10.91191||P99 Cmp 10.783382||Pct Diff -1.17786895236||P999 Base 10.91191||P999 Cmp 10.783382||Pct Diff -1.17786895236||P100 Base 190.749079||P100 Cmp 289.253389||Pct Diff 51.6407788265
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.169076||P50 Cmp 0.176014||Pct Diff 4.10348009179||P90 Base 0.208322||P90 Cmp 0.208844||Pct Diff 0.250573631206||P99 Base 0.249979||P99 Cmp 12.015107||Pct Diff 4706.44654151||P999 Base 0.249979||P999 Cmp 12.015107||Pct Diff 4706.44654151||P100 Base 11.609114||P100 Cmp 23.699775||Pct Diff 104.148008194
||Task ('OrHighMed', None)||P50 Base 3.614233||P50 Cmp 3.430738||Pct Diff -5.077010807||P90 Base 4.55649||P90 Cmp 8.646088||Pct Diff 89.7532530522||P99 Base 4.79348||P99 Cmp 15.382202||Pct Diff 220.898428699||P999 Base 4.79348||P999 Cmp 15.382202||Pct Diff 220.898428699||P100 Base 14.397726||P100 Cmp 20.236849||Pct Diff 40.5558697255
||Task ('IntNRQ', None)||P50 Base 4.406247||P50 Cmp 3.892313||Pct Diff -11.6637582959||P90 Base 15.201409||P90 Cmp 13.366889||Pct Diff -12.068091846||P99 Base 95.030389||P99 Cmp 88.168875||Pct Diff -7.2203366441||P999 Base 95.030389||P999 Cmp 88.168875||Pct Diff -7.2203366441||P100 Base 98.587879||P100 Cmp 130.403357||Pct Diff 32.2711861972
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.172816||P50 Cmp 0.170583||Pct Diff -1.2921257291||P90 Base 0.191808||P90 Cmp 0.189473||Pct Diff -1.21736319653||P99 Base 0.193019||P99 Cmp 0.210512||Pct Diff 9.06283837342||P999 Base 0.193019||P999 Cmp 0.210512||Pct Diff 9.06283837342||P100 Base 31.243419||P100 Cmp 26.781047||Pct Diff -14.2825982009
||Task ('AndHighMed', None)||P50 Base 3.891164||P50 Cmp 3.579157||Pct Diff -8.01834618125||P90 Base 10.745222||P90 Cmp 4.657956||Pct Diff -56.6509095857||P99 Base 58.32982||P99 Cmp 40.446494||Pct Diff -30.6589768321||P999 Base 58.32982||P999 Cmp 40.446494||Pct Diff -30.6589768321||P100 Base 294.4149||P100 Cmp 291.86807||Pct Diff -0.865047930658
||Task ('OrHighNotMed', None)||P50 Base 1.745919||P50 Cmp 1.813417||Pct Diff 3.86604418647||P90 Base 4.159062||P90 Cmp 3.161294||Pct Diff -23.9902170249||P99 Base 6.494509||P99 Cmp 5.843033||Pct Diff -10.031181726||P999 Base 6.494509||P999 Cmp 5.843033||Pct Diff -10.031181726||P100 Base 73.780315||P100 Cmp 92.827475||Pct Diff 25.8160459196
||Task ('Prefix3', None)||P50 Base 13.97077||P50 Cmp 14.236831||Pct Diff 1.90441185418||P90 Base 17.123532||P90 Cmp 20.044378||Pct Diff 17.05749725||P99 Base 21.952334||P99 Cmp 39.644596||Pct Diff 80.593990598||P999 Base 21.952334||P999 Cmp 39.644596||Pct Diff 80.593990598||P100 Base 125.77654||P100 Cmp 83.652045||Pct Diff -33.4915358619
||Task PKLookup||P50 Base 10.312972||P50 Cmp 10.522211||Pct Diff 2.02889138068||P90 Base 110.90583||P90 Cmp 73.292064||Pct Diff -33.9150484695||P99 Base 141.89641||P99 Cmp 117.817137||Pct Diff -16.9696139599||P999 Base 141.89641||P999 Cmp 117.817137||Pct Diff -16.9696139599||P100 Base 161.958847||P100 Cmp 146.868587||Pct Diff -9.31734220113
||Task ('HighTerm', None)||P50 Base 1.200824||P50 Cmp 1.243699||Pct Diff 3.5704649474||P90 Base 1.598456||P90 Cmp 1.616055||Pct Diff 1.10099996497||P99 Base 3.734277||P99 Cmp 1.852443||Pct Diff -50.3935299926||P999 Base 3.734277||P999 Cmp 1.852443||Pct Diff -50.3935299926||P100 Base 15.278795||P100 Cmp 2.908579||Pct Diff -80.963295862
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
BrowseDayOfYearTaxoFacets 6142.12 (3.2%) 5774.38 (3.2%) -6.0% ( -11% - 0%)
HighTermMonthSort 336.58 (9.0%) 322.47 (20.8%) -4.2% ( -31% - 28%)
BrowseMonthTaxoFacets 6184.53 (6.2%) 5925.79 (3.6%) -4.2% ( -13% - 5%)
Fuzzy1 60.36 (5.9%) 57.90 (11.7%) -4.1% ( -20% - 14%)
OrHighNotMed 592.65 (4.1%) 569.05 (7.0%) -4.0% ( -14% - 7%)
HighTerm 879.63 (4.0%) 845.05 (3.2%) -3.9% ( -10% - 3%)
HighTermDayOfYearSort 288.27 (9.9%) 277.23 (10.0%) -3.8% ( -21% - 17%)
OrHighHigh 58.41 (4.7%) 56.32 (6.3%) -3.6% ( -13% - 7%)
Wildcard 527.77 (8.0%) 509.47 (7.0%) -3.5% ( -17% - 12%)
LowPhrase 194.50 (5.2%) 189.56 (7.6%) -2.5% ( -14% - 10%)
OrNotHighHigh 547.83 (4.1%) 537.54 (4.9%) -1.9% ( -10% - 7%)
MedTerm 977.12 (6.0%) 963.13 (3.3%) -1.4% ( -10% - 8%)
OrNotHighMed 683.69 (5.3%) 674.05 (5.6%) -1.4% ( -11% - 9%)
Fuzzy2 39.23 (11.2%) 38.68 (6.3%) -1.4% ( -16% - 18%)
HighPhrase 242.79 (2.8%) 239.53 (4.0%) -1.3% ( -7% - 5%)
AndHighHigh 196.99 (4.0%) 194.36 (3.1%) -1.3% ( -8% - 5%)
OrHighNotLow 666.66 (6.9%) 658.40 (5.9%) -1.2% ( -13% - 12%)
Prefix3 70.98 (4.4%) 70.17 (3.9%) -1.1% ( -9% - 7%)
PKLookup 93.57 (2.9%) 92.81 (3.6%) -0.8% ( -7% - 5%)
Respell 62.62 (2.6%) 62.31 (4.3%) -0.5% ( -7% - 6%)
OrHighNotHigh 577.26 (6.1%) 575.38 (6.6%) -0.3% ( -12% - 13%)
MedPhrase 151.79 (3.2%) 151.31 (3.1%) -0.3% ( -6% - 6%)
OrNotHighLow 824.20 (4.2%) 822.28 (4.2%) -0.2% ( -8% - 8%)
IntNRQ 256.40 (2.2%) 255.88 (3.5%) -0.2% ( -5% - 5%)
BrowseDateTaxoFacets 2.32 (1.1%) 2.32 (1.2%) 0.1% ( -2% - 2%)
OrHighLow 441.35 (4.8%) 441.76 (4.8%) 0.1% ( -9% - 10%)
LowTerm 1144.53 (3.1%) 1146.93 (5.3%) 0.2% ( -7% - 8%)
HighSloppyPhrase 108.57 (6.7%) 108.95 (5.7%) 0.4% ( -11% - 13%)
MedSpanNear 121.19 (2.2%) 121.73 (2.3%) 0.4% ( -3% - 5%)
LowSloppyPhrase 62.19 (7.5%) 62.51 (6.6%) 0.5% ( -12% - 15%)
LowSpanNear 42.88 (5.7%) 43.24 (2.6%) 0.8% ( -7% - 9%)
AndHighLow 765.03 (3.1%) 775.41 (4.3%) 1.4% ( -5% - 9%)
OrHighMed 306.83 (7.6%) 311.10 (5.0%) 1.4% ( -10% - 15%)
HighIntervalsOrdered 55.24 (4.4%) 56.04 (1.5%) 1.4% ( -4% - 7%)
AndHighMed 296.15 (7.9%) 304.86 (8.7%) 2.9% ( -12% - 21%)
HighSpanNear 52.94 (8.2%) 54.62 (2.7%) 3.2% ( -7% - 15%)
BrowseDayOfYearSSDVFacets 10.36 (19.4%) 10.74 (18.2%) 3.7% ( -28% - 51%)
BrowseMonthSSDVFacets 12.59 (22.3%) 13.05 (22.9%) 3.7% ( -33% - 62%)
MedSloppyPhrase 119.82 (8.8%) 126.43 (2.5%) 5.5% ( -5% - 18%)
iter 11
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.11 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -2110853 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.11 -topN 10 -pk
22.1 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.11 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -2110853 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.11 -topN 10 -pk
21.7 s
Report after iter 11:
||Task ('Wildcard', None)||P50 Base 2.053187||P50 Cmp 1.780302||Pct Diff -13.2908010814||P90 Base 17.524362||P90 Cmp 17.217185||Pct Diff -1.75285696563||P99 Base 25.777439||P99 Cmp 27.774998||Pct Diff 7.74925313566||P999 Base 25.777439||P999 Cmp 27.774998||Pct Diff 7.74925313566||P100 Base 256.336996||P100 Cmp 235.005797||Pct Diff -8.32154520528
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 3.833538||P50 Cmp 4.043031||Pct Diff 5.46474301285||P90 Base 99.628155||P90 Cmp 103.781771||Pct Diff 4.16911865928||P99 Base 146.664475||P99 Cmp 129.507881||Pct Diff -11.6978525304||P999 Base 146.664475||P999 Cmp 129.507881||Pct Diff -11.6978525304||P100 Base 153.638745||P100 Cmp 157.744584||Pct Diff 2.67239816363
||Task ('MedSloppyPhrase', None)||P50 Base 8.319386||P50 Cmp 8.344015||Pct Diff 0.296043482055||P90 Base 12.338251||P90 Cmp 11.963946||Pct Diff -3.03369578071||P99 Base 12.425103||P99 Cmp 12.11595||Pct Diff -2.48813229154||P999 Base 12.425103||P999 Cmp 12.11595||Pct Diff -2.48813229154||P100 Base 12.694782||P100 Cmp 12.422028||Pct Diff -2.14855205863
||Task ('OrHighHigh', None)||P50 Base 16.836461||P50 Cmp 16.519389||Pct Diff -1.88324612874||P90 Base 27.654261||P90 Cmp 28.533367||Pct Diff 3.17891698498||P99 Base 40.856046||P99 Cmp 69.688279||Pct Diff 70.5702969886||P999 Base 40.856046||P999 Cmp 69.688279||Pct Diff 70.5702969886||P100 Base 373.56897||P100 Cmp 599.443965||Pct Diff 60.4640677195
||Task ('MedPhrase', None)||P50 Base 6.51219||P50 Cmp 6.981774||Pct Diff 7.21084612089||P90 Base 7.473806||P90 Cmp 9.683054||Pct Diff 29.5598788623||P99 Base 8.508632||P99 Cmp 11.047757||Pct Diff 29.841753645||P999 Base 8.508632||P999 Cmp 11.047757||Pct Diff 29.841753645||P100 Base 10.096399||P100 Cmp 11.156179||Pct Diff 10.4966136937
||Task ('LowSpanNear', None)||P50 Base 23.667009||P50 Cmp 23.326998||Pct Diff -1.43664541641||P90 Base 36.247466||P90 Cmp 36.437491||Pct Diff 0.524243542983||P99 Base 36.302071||P99 Cmp 37.817776||Pct Diff 4.17525765954||P999 Base 36.302071||P999 Cmp 37.817776||Pct Diff 4.17525765954||P100 Base 37.381392||P100 Cmp 40.77238||Pct Diff 9.07132618282
||Task ('Fuzzy2', None)||P50 Base 29.026706||P50 Cmp 44.25271||Pct Diff 52.4551562964||P90 Base 102.910166||P90 Cmp 147.515267||Pct Diff 43.3437266052||P99 Base 344.537547||P99 Cmp 157.270344||Pct Diff -54.3532060963||P999 Base 344.537547||P999 Cmp 157.270344||Pct Diff -54.3532060963||P100 Base 693.226226||P100 Cmp 665.310258||Pct Diff -4.02696363077
||Task ('OrNotHighHigh', None)||P50 Base 2.036935||P50 Cmp 2.240054||Pct Diff 9.97179585996||P90 Base 40.290929||P90 Cmp 35.532891||Pct Diff -11.8092040022||P99 Base 54.749472||P99 Cmp 55.499637||Pct Diff 1.37017759733||P999 Base 54.749472||P999 Cmp 55.499637||Pct Diff 1.37017759733||P100 Base 292.383534||P100 Cmp 296.136354||Pct Diff 1.28352645194
||Task ('OrHighNotLow', None)||P50 Base 1.627674||P50 Cmp 1.819167||Pct Diff 11.7648251431||P90 Base 3.485429||P90 Cmp 3.328419||Pct Diff -4.50475393416||P99 Base 6.882547||P99 Cmp 11.150465||Pct Diff 62.01073527||P999 Base 6.882547||P999 Cmp 11.150465||Pct Diff 62.01073527||P100 Base 16.858677||P100 Cmp 12.462898||Pct Diff -26.0742821041
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 65.124559||P50 Cmp 64.806884||Pct Diff -0.48779600949||P90 Base 85.823084||P90 Cmp 85.15989||Pct Diff -0.772745477196||P99 Base 137.876146||P99 Cmp 132.567555||Pct Diff -3.8502606535||P999 Base 137.876146||P999 Cmp 132.567555||Pct Diff -3.8502606535||P100 Base 140.241346||P100 Cmp 139.280662||Pct Diff -0.685021947807
||Task ('Fuzzy1', None)||P50 Base 18.338662||P50 Cmp 17.663682||Pct Diff -3.68063929637||P90 Base 100.235061||P90 Cmp 100.598275||Pct Diff 0.362362227724||P99 Base 160.754775||P99 Cmp 108.378411||Pct Diff -32.5815292267||P999 Base 160.754775||P999 Cmp 108.378411||Pct Diff -32.5815292267||P100 Base 167.524988||P100 Cmp 166.392597||Pct Diff -0.675953488204
||Task ('HighSloppyPhrase', None)||P50 Base 9.679866||P50 Cmp 10.852548||Pct Diff 12.1146511739||P90 Base 16.072218||P90 Cmp 17.105169||Pct Diff 6.42693497562||P99 Base 16.077072||P99 Cmp 18.742234||Pct Diff 16.5774091203||P999 Base 16.077072||P999 Cmp 18.742234||Pct Diff 16.5774091203||P100 Base 18.284469||P100 Cmp 23.250023||Pct Diff 27.1572228868
||Task ('OrNotHighMed', None)||P50 Base 1.44429||P50 Cmp 1.480723||Pct Diff 2.52255433466||P90 Base 2.50264||P90 Cmp 2.970948||Pct Diff 18.7125595371||P99 Base 3.377247||P99 Cmp 7.309339||Pct Diff 116.428913846||P999 Base 3.377247||P999 Cmp 7.309339||Pct Diff 116.428913846||P100 Base 64.760403||P100 Cmp 54.913193||Pct Diff -15.2056033376
||Task ('LowPhrase', None)||P50 Base 5.263098||P50 Cmp 5.507605||Pct Diff 4.64568586791||P90 Base 7.201521||P90 Cmp 7.826692||Pct Diff 8.68109667388||P99 Base 9.014815||P99 Cmp 11.704175||Pct Diff 29.8326698884||P999 Base 9.014815||P999 Cmp 11.704175||Pct Diff 29.8326698884||P100 Base 13.857789||P100 Cmp 14.039035||Pct Diff 1.30789983886
||Task ('AndHighLow', None)||P50 Base 1.267711||P50 Cmp 1.330361||Pct Diff 4.94197810069||P90 Base 2.053633||P90 Cmp 3.042716||Pct Diff 48.1625976988||P99 Base 42.708593||P99 Cmp 43.04724||Pct Diff 0.792924739993||P999 Base 42.708593||P999 Cmp 43.04724||Pct Diff 0.792924739993||P100 Base 43.574719||P100 Cmp 49.611004||Pct Diff 13.8527227221
||Task ('LowTerm', None)||P50 Base 0.908964||P50 Cmp 0.925937||Pct Diff 1.86729067378||P90 Base 1.579958||P90 Cmp 3.708276||Pct Diff 134.707251712||P99 Base 18.535499||P99 Cmp 20.369783||Pct Diff 9.89605944787||P999 Base 18.535499||P999 Cmp 20.369783||Pct Diff 9.89605944787||P100 Base 22.001205||P100 Cmp 22.210692||Pct Diff 0.952161483882
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 82.235921||P50 Cmp 82.614667||Pct Diff 0.46056029457||P90 Base 84.84669||P90 Cmp 90.893438||Pct Diff 7.1266751832||P99 Base 97.69646||P99 Cmp 111.354293||Pct Diff 13.9798647771||P999 Base 97.69646||P999 Cmp 111.354293||Pct Diff 13.9798647771||P100 Base 213.553097||P100 Cmp 221.906054||Pct Diff 3.91141927574
||Task ('AndHighHigh', None)||P50 Base 5.001263||P50 Cmp 5.177813||Pct Diff 3.53010829464||P90 Base 7.808619||P90 Cmp 5.68372||Pct Diff -27.2122253628||P99 Base 20.998614||P99 Cmp 20.766141||Pct Diff -1.10708735348||P999 Base 20.998614||P999 Cmp 20.766141||Pct Diff -1.10708735348||P100 Base 159.494992||P100 Cmp 108.277413||Pct Diff -32.1123430634
||Task ('HighTermMonthSort', 'Month')||P50 Base 3.226667||P50 Cmp 3.057525||Pct Diff -5.2420035907||P90 Base 5.359125||P90 Cmp 5.01364||Pct Diff -6.44666806615||P99 Base 7.20354||P99 Cmp 6.861034||Pct Diff -4.75469005517||P999 Base 7.20354||P999 Cmp 6.861034||Pct Diff -4.75469005517||P100 Base 33.663306||P100 Cmp 13.950103||Pct Diff -58.5599138718
||Task Respell||P50 Base 15.693428||P50 Cmp 16.219923||Pct Diff 3.35487568427||P90 Base 71.836082||P90 Cmp 71.556259||Pct Diff -0.389529874416||P99 Base 258.290094||P99 Cmp 316.348638||Pct Diff 22.4780374272||P999 Base 258.290094||P999 Cmp 316.348638||Pct Diff 22.4780374272||P100 Base 278.546051||P100 Cmp 319.003776||Pct Diff 14.5246090744
||Task ('MedTerm', None)||P50 Base 1.037115||P50 Cmp 1.108522||Pct Diff 6.8851573837||P90 Base 1.270711||P90 Cmp 2.444019||Pct Diff 92.3347637661||P99 Base 4.387055||P99 Cmp 6.082178||Pct Diff 38.639201013||P999 Base 4.387055||P999 Cmp 6.082178||Pct Diff 38.639201013||P100 Base 5.378242||P100 Cmp 7.965854||Pct Diff 48.1125988752
||Task ('HighIntervalsOrdered', None)||P50 Base 17.907548||P50 Cmp 17.790905||Pct Diff -0.651362207713||P90 Base 29.09446||P90 Cmp 28.510671||Pct Diff -2.00652976546||P99 Base 29.366984||P99 Cmp 29.043437||Pct Diff -1.10173724343||P999 Base 29.366984||P999 Cmp 29.043437||Pct Diff -1.10173724343||P100 Base 69.688039||P100 Cmp 77.555124||Pct Diff 11.2890032678
||Task ('HighSpanNear', None)||P50 Base 19.635708||P50 Cmp 18.595414||Pct Diff -5.29797041186||P90 Base 28.845306||P90 Cmp 28.18368||Pct Diff -2.29370421655||P99 Base 50.632483||P99 Cmp 42.732037||Pct Diff -15.6035128674||P999 Base 50.632483||P999 Cmp 42.732037||Pct Diff -15.6035128674||P100 Base 310.165802||P100 Cmp 296.088163||Pct Diff -4.53874634445
||Task ('LowSloppyPhrase', None)||P50 Base 16.530108||P50 Cmp 16.629894||Pct Diff 0.603662117634||P90 Base 24.883138||P90 Cmp 19.242137||Pct Diff -22.6699743417||P99 Base 26.074243||P99 Cmp 23.607809||Pct Diff -9.45927365945||P999 Base 26.074243||P999 Cmp 23.607809||Pct Diff -9.45927365945||P100 Base 219.556104||P100 Cmp 161.889954||Pct Diff -26.2648812533
||Task ('OrHighNotHigh', None)||P50 Base 1.804637||P50 Cmp 1.723722||Pct Diff -4.48372719832||P90 Base 20.163925||P90 Cmp 20.922924||Pct Diff 3.76414314177||P99 Base 84.349042||P99 Cmp 51.99718||Pct Diff -38.3547474078||P999 Base 84.349042||P999 Cmp 51.99718||Pct Diff -38.3547474078||P100 Base 177.853286||P100 Cmp 206.859717||Pct Diff 16.3091903739
||Task ('OrNotHighLow', None)||P50 Base 1.177201||P50 Cmp 1.164763||Pct Diff -1.05657402602||P90 Base 1.414005||P90 Cmp 1.919949||Pct Diff 35.7809201523||P99 Base 3.585819||P99 Cmp 3.12136||Pct Diff -12.9526615816||P999 Base 3.585819||P999 Cmp 3.12136||Pct Diff -12.9526615816||P100 Base 3.7086||P100 Cmp 4.632043||Pct Diff 24.900043143
||Task ('MedSpanNear', None)||P50 Base 9.146973||P50 Cmp 8.375624||Pct Diff -8.43283346305||P90 Base 11.929127||P90 Cmp 11.262557||Pct Diff -5.58775172735||P99 Base 12.492467||P99 Cmp 11.589916||Pct Diff -7.22476193053||P999 Base 12.492467||P999 Cmp 11.589916||Pct Diff -7.22476193053||P100 Base 12.56518||P100 Cmp 12.236294||Pct Diff -2.61743962283
||Task ('BrowseDateTaxoFacets', None)||P50 Base 430.828431||P50 Cmp 433.136285||Pct Diff 0.535678203651||P90 Base 452.989543||P90 Cmp 442.680964||Pct Diff -2.27567703478||P99 Base 475.751256||P99 Cmp 451.577246||Pct Diff -5.08122883442||P999 Base 475.751256||P999 Cmp 451.577246||Pct Diff -5.08122883442||P100 Base 543.68771||P100 Cmp 550.845578||Pct Diff 1.31654033526
||Task ('HighPhrase', None)||P50 Base 4.457257||P50 Cmp 4.350255||Pct Diff -2.40062441991||P90 Base 9.212467||P90 Cmp 6.457944||Pct Diff -29.8999497095||P99 Base 50.957551||P99 Cmp 9.77163||Pct Diff -80.8239803361||P999 Base 50.957551||P999 Cmp 9.77163||Pct Diff -80.8239803361||P100 Base 146.893606||P100 Cmp 134.008584||Pct Diff -8.77166974851
||Task ('OrHighLow', None)||P50 Base 2.282083||P50 Cmp 2.435659||Pct Diff 6.72964129701||P90 Base 5.292818||P90 Cmp 3.321479||Pct Diff -37.2455467012||P99 Base 6.097143||P99 Cmp 6.440779||Pct Diff 5.63601673768||P999 Base 6.097143||P999 Cmp 6.440779||Pct Diff 5.63601673768||P100 Base 10.697209||P100 Cmp 20.536224||Pct Diff 91.9774027038
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.167469||P50 Cmp 0.189136||Pct Diff 12.9379168682||P90 Base 0.202643||P90 Cmp 0.258912||Pct Diff 27.7675518029||P99 Base 0.233649||P99 Cmp 0.318269||Pct Diff 36.2167182398||P999 Base 0.233649||P999 Cmp 0.318269||Pct Diff 36.2167182398||P100 Base 29.284395||P100 Cmp 15.17682||Pct Diff -48.174377514
||Task ('OrHighMed', None)||P50 Base 3.168683||P50 Cmp 3.307036||Pct Diff 4.36626194542||P90 Base 15.174627||P90 Cmp 5.654756||Pct Diff -62.7354530691||P99 Base 19.140903||P99 Cmp 209.123181||Pct Diff 992.546056996||P999 Base 19.140903||P999 Cmp 209.123181||Pct Diff 992.546056996||P100 Base 196.139737||P100 Cmp 227.625414||Pct Diff 16.0526762611
||Task ('IntNRQ', None)||P50 Base 3.982335||P50 Cmp 3.962135||Pct Diff -0.507240099088||P90 Base 14.364923||P90 Cmp 12.541369||Pct Diff -12.6944919928||P99 Base 74.726852||P99 Cmp 44.330461||Pct Diff -40.6766646613||P999 Base 74.726852||P999 Cmp 44.330461||Pct Diff -40.6766646613||P100 Base 105.706714||P100 Cmp 59.784406||Pct Diff -43.4431326661
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.170301||P50 Cmp 0.175786||Pct Diff 3.22076793442||P90 Base 0.20411||P90 Cmp 0.20574||Pct Diff 0.79858899613||P99 Base 17.998915||P99 Cmp 17.476855||Pct Diff -2.90050816952||P999 Base 17.998915||P999 Cmp 17.476855||Pct Diff -2.90050816952||P100 Base 68.994022||P100 Cmp 42.090626||Pct Diff -38.9938073186
||Task ('AndHighMed', None)||P50 Base 3.574074||P50 Cmp 3.328909||Pct Diff -6.85953900227||P90 Base 8.250403||P90 Cmp 6.214886||Pct Diff -24.6717281568||P99 Base 12.359911||P99 Cmp 10.318653||Pct Diff -16.5151512822||P999 Base 12.359911||P999 Cmp 10.318653||Pct Diff -16.5151512822||P100 Base 40.171008||P100 Cmp 40.833849||Pct Diff 1.65004821388
||Task ('OrHighNotMed', None)||P50 Base 1.907085||P50 Cmp 1.789111||Pct Diff -6.18609028963||P90 Base 6.174041||P90 Cmp 2.640324||Pct Diff -57.2350750505||P99 Base 8.633201||P99 Cmp 8.023261||Pct Diff -7.06505037934||P999 Base 8.633201||P999 Cmp 8.023261||Pct Diff -7.06505037934||P100 Base 207.093979||P100 Cmp 222.18115||Pct Diff 7.28518089848
||Task ('Prefix3', None)||P50 Base 13.861001||P50 Cmp 13.566828||Pct Diff -2.12230703973||P90 Base 17.134542||P90 Cmp 59.593001||Pct Diff 247.794536907||P99 Base 413.526765||P99 Cmp 218.734907||Pct Diff -47.1050182205||P999 Base 413.526765||P999 Cmp 218.734907||Pct Diff -47.1050182205||P100 Base 431.367477||P100 Cmp 606.598966||Pct Diff 40.622322809
||Task PKLookup||P50 Base 10.782833||P50 Cmp 10.731052||Pct Diff -0.480217026453||P90 Base 45.585299||P90 Cmp 11.418399||Pct Diff -74.9515759456||P99 Base 243.340234||P99 Cmp 249.140041||Pct Diff 2.38341473774||P999 Base 243.340234||P999 Cmp 249.140041||Pct Diff 2.38341473774||P100 Base 596.950372||P100 Cmp 849.133138||Pct Diff 42.2451811455
||Task ('HighTerm', None)||P50 Base 1.180828||P50 Cmp 1.162916||Pct Diff -1.51690169949||P90 Base 1.359027||P90 Cmp 3.246096||Pct Diff 138.854415696||P99 Base 1.878995||P99 Cmp 4.112823||Pct Diff 118.884190751||P999 Base 1.878995||P999 Cmp 4.112823||Pct Diff 118.884190751||P100 Base 9.878365||P100 Cmp 7.89939||Pct Diff -20.0334265843
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
BrowseDayOfYearTaxoFacets 6135.44 (3.1%) 5746.93 (3.4%) -6.3% ( -12% - 0%)
BrowseMonthTaxoFacets 6167.76 (6.0%) 5916.38 (3.5%) -4.1% ( -12% - 5%)
Fuzzy1 60.09 (5.9%) 57.89 (11.3%) -3.7% ( -19% - 14%)
Fuzzy2 39.13 (10.7%) 37.74 (9.9%) -3.5% ( -21% - 19%)
HighTerm 878.19 (3.8%) 848.85 (3.4%) -3.3% ( -10% - 4%)
HighTermMonthSort 334.51 (8.9%) 323.51 (20.0%) -3.3% ( -29% - 28%)
OrHighHigh 58.63 (4.7%) 56.77 (6.5%) -3.2% ( -13% - 8%)
OrHighNotMed 590.54 (4.1%) 571.87 (6.9%) -3.2% ( -13% - 8%)
HighTermDayOfYearSort 286.19 (9.9%) 277.37 (9.6%) -3.1% ( -20% - 18%)
LowPhrase 194.80 (5.0%) 189.57 (7.3%) -2.7% ( -14% - 10%)
Wildcard 526.37 (7.7%) 514.67 (7.5%) -2.2% ( -16% - 14%)
OrNotHighHigh 544.35 (4.5%) 534.00 (5.2%) -1.9% ( -11% - 8%)
MedTerm 979.51 (5.8%) 961.33 (3.3%) -1.9% ( -10% - 7%)
AndHighHigh 197.46 (3.9%) 194.50 (2.9%) -1.5% ( -8% - 5%)
OrNotHighMed 685.59 (5.1%) 675.71 (5.4%) -1.4% ( -11% - 9%)
HighPhrase 241.56 (3.2%) 238.89 (4.0%) -1.1% ( -8% - 6%)
Prefix3 71.13 (4.3%) 70.48 (4.0%) -0.9% ( -8% - 7%)
OrHighNotLow 662.73 (6.9%) 656.68 (5.7%) -0.9% ( -12% - 12%)
PKLookup 93.64 (2.8%) 92.85 (3.5%) -0.8% ( -6% - 5%)
Respell 62.76 (2.6%) 62.30 (4.1%) -0.7% ( -7% - 6%)
OrHighLow 443.34 (4.8%) 440.16 (4.7%) -0.7% ( -9% - 9%)
MedPhrase 151.94 (3.1%) 150.98 (3.1%) -0.6% ( -6% - 5%)
OrHighNotHigh 579.41 (6.0%) 576.25 (6.3%) -0.5% ( -12% - 12%)
IntNRQ 256.77 (2.1%) 255.61 (3.4%) -0.5% ( -5% - 5%)
OrNotHighLow 829.79 (4.5%) 826.58 (4.4%) -0.4% ( -8% - 8%)
HighSloppyPhrase 108.20 (6.5%) 107.98 (6.2%) -0.2% ( -12% - 13%)
LowSloppyPhrase 62.47 (7.3%) 62.37 (6.4%) -0.2% ( -12% - 14%)
LowTerm 1145.41 (3.0%) 1144.49 (5.2%) -0.1% ( -7% - 8%)
BrowseDateTaxoFacets 2.32 (1.0%) 2.32 (1.1%) -0.0% ( -2% - 2%)
LowSpanNear 42.83 (5.5%) 43.21 (2.5%) 0.9% ( -6% - 9%)
AndHighLow 767.57 (3.2%) 775.45 (4.1%) 1.0% ( -6% - 8%)
MedSpanNear 120.24 (3.4%) 121.58 (2.3%) 1.1% ( -4% - 6%)
OrHighMed 307.82 (7.3%) 311.49 (4.8%) 1.2% ( -10% - 14%)
HighIntervalsOrdered 55.27 (4.3%) 56.04 (1.4%) 1.4% ( -4% - 7%)
AndHighMed 297.60 (7.7%) 305.33 (8.3%) 2.6% ( -12% - 20%)
BrowseDayOfYearSSDVFacets 10.51 (18.9%) 10.85 (17.5%) 3.3% ( -27% - 48%)
BrowseMonthSSDVFacets 12.82 (21.8%) 13.25 (22.1%) 3.3% ( -33% - 60%)
HighSpanNear 52.78 (8.0%) 54.59 (2.6%) 3.4% ( -6% - 15%)
MedSloppyPhrase 120.06 (8.4%) 126.26 (2.4%) 5.2% ( -5% - 17%)
iter 12
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.12 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -9862991 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.12 -topN 10 -pk
23.2 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.12 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -9862991 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.12 -topN 10 -pk
22.5 s
Report after iter 12:
||Task ('Wildcard', None)||P50 Base 1.745725||P50 Cmp 1.939289||Pct Diff 11.0878861218||P90 Base 23.938677||P90 Cmp 23.952578||Pct Diff 0.0580692074169||P99 Base 85.196503||P99 Cmp 90.521252||Pct Diff 6.24996192625||P999 Base 85.196503||P999 Cmp 90.521252||Pct Diff 6.24996192625||P100 Base 276.809603||P100 Cmp 453.651781||Pct Diff 63.8858537
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 4.551595||P50 Cmp 4.647226||Pct Diff 2.10104370007||P90 Base 39.864698||P90 Cmp 76.138147||Pct Diff 90.9914054786||P99 Base 55.126068||P99 Cmp 78.998502||Pct Diff 43.3051637204||P999 Base 55.126068||P999 Cmp 78.998502||Pct Diff 43.3051637204||P100 Base 78.502798||P100 Cmp 136.204494||Pct Diff 73.5027253424
||Task ('MedSloppyPhrase', None)||P50 Base 8.338131||P50 Cmp 8.21824||Pct Diff -1.43786419283||P90 Base 12.221717||P90 Cmp 12.077651||Pct Diff -1.17877054427||P99 Base 12.564695||P99 Cmp 15.403325||Pct Diff 22.5921122638||P999 Base 12.564695||P999 Cmp 15.403325||Pct Diff 22.5921122638||P100 Base 22.435811||P100 Cmp 42.362422||Pct Diff 88.8160940561
||Task ('OrHighHigh', None)||P50 Base 17.114789||P50 Cmp 18.332068||Pct Diff 7.112439423||P90 Base 24.972751||P90 Cmp 30.097459||Pct Diff 20.5211992864||P99 Base 27.547784||P99 Cmp 47.839806||Pct Diff 73.6611772475||P999 Base 27.547784||P999 Cmp 47.839806||Pct Diff 73.6611772475||P100 Base 82.746191||P100 Cmp 98.751296||Pct Diff 19.3424069514
||Task ('MedPhrase', None)||P50 Base 6.756768||P50 Cmp 6.947819||Pct Diff 2.82755009496||P90 Base 10.494979||P90 Cmp 12.947959||Pct Diff 23.3728909796||P99 Base 22.343156||P99 Cmp 32.892941||Pct Diff 47.2170762268||P999 Base 22.343156||P999 Cmp 32.892941||Pct Diff 47.2170762268||P100 Base 186.796899||P100 Cmp 459.659955||Pct Diff 146.07472472
||Task ('LowSpanNear', None)||P50 Base 23.677935||P50 Cmp 22.813301||Pct Diff -3.65164445295||P90 Base 35.741474||P90 Cmp 26.990516||Pct Diff -24.4840433833||P99 Base 36.70364||P99 Cmp 33.478871||Pct Diff -8.78596509774||P999 Base 36.70364||P999 Cmp 33.478871||Pct Diff -8.78596509774||P100 Base 270.415022||P100 Cmp 265.532018||Pct Diff -1.80574435691
||Task ('Fuzzy2', None)||P50 Base 35.438546||P50 Cmp 36.612976||Pct Diff 3.31399036518||P90 Base 76.407841||P90 Cmp 77.95303||Pct Diff 2.02229114156||P99 Base 108.050119||P99 Cmp 102.884026||Pct Diff -4.78120065745||P999 Base 108.050119||P999 Cmp 102.884026||Pct Diff -4.78120065745||P100 Base 125.060043||P100 Cmp 108.516576||Pct Diff -13.2284194081
||Task ('OrNotHighHigh', None)||P50 Base 1.787998||P50 Cmp 1.906467||Pct Diff 6.62579040916||P90 Base 125.607749||P90 Cmp 125.722893||Pct Diff 0.0916695036068||P99 Base 218.53167||P99 Cmp 232.700953||Pct Diff 6.4838579232||P999 Base 218.53167||P999 Cmp 232.700953||Pct Diff 6.4838579232||P100 Base 225.100432||P100 Cmp 422.696364||Pct Diff 87.7812318015
||Task ('OrHighNotLow', None)||P50 Base 1.637501||P50 Cmp 1.546686||Pct Diff -5.54595081163||P90 Base 3.697517||P90 Cmp 4.178299||Pct Diff 13.002834064||P99 Base 21.391667||P99 Cmp 21.79757||Pct Diff 1.8974818559||P999 Base 21.391667||P999 Cmp 21.79757||Pct Diff 1.8974818559||P100 Base 297.068317||P100 Cmp 291.181403||Pct Diff -1.9816700951
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 94.077018||P50 Cmp 94.112561||Pct Diff 0.0377807468345||P90 Base 102.274091||P90 Cmp 102.320421||Pct Diff 0.0452998404063||P99 Base 114.448622||P99 Cmp 112.545963||Pct Diff -1.6624568883||P999 Base 114.448622||P999 Cmp 112.545963||Pct Diff -1.6624568883||P100 Base 171.405896||P100 Cmp 151.754977||Pct Diff -11.4645525379
||Task ('Fuzzy1', None)||P50 Base 25.718167||P50 Cmp 19.174922||Pct Diff -25.4421125736||P90 Base 224.541146||P90 Cmp 220.161525||Pct Diff -1.95047592747||P99 Base 239.541487||P99 Cmp 242.426455||Pct Diff 1.20437091551||P999 Base 239.541487||P999 Cmp 242.426455||Pct Diff 1.20437091551||P100 Base 468.195346||P100 Cmp 596.785698||Pct Diff 27.4651068403
||Task ('HighSloppyPhrase', None)||P50 Base 8.955351||P50 Cmp 9.149759||Pct Diff 2.170858518||P90 Base 14.980622||P90 Cmp 22.621523||Pct Diff 51.005231959||P99 Base 21.905738||P99 Cmp 32.151386||Pct Diff 46.7715262549||P999 Base 21.905738||P999 Cmp 32.151386||Pct Diff 46.7715262549||P100 Base 422.805249||P100 Cmp 392.657253||Pct Diff -7.13046871374
||Task ('OrNotHighMed', None)||P50 Base 1.509274||P50 Cmp 1.584011||Pct Diff 4.95185102241||P90 Base 2.640504||P90 Cmp 2.556341||Pct Diff -3.18738392368||P99 Base 3.221761||P99 Cmp 3.137709||Pct Diff -2.60888377505||P999 Base 3.221761||P999 Cmp 3.137709||Pct Diff -2.60888377505||P100 Base 5.203238||P100 Cmp 3.652592||Pct Diff -29.8015581836
||Task ('LowPhrase', None)||P50 Base 5.315435||P50 Cmp 6.116308||Pct Diff 15.0669324336||P90 Base 11.174665||P90 Cmp 12.444491||Pct Diff 11.3634368458||P99 Base 48.775965||P99 Cmp 56.618899||Pct Diff 16.0795055516||P999 Base 48.775965||P999 Cmp 56.618899||Pct Diff 16.0795055516||P100 Base 87.177652||P100 Cmp 87.911888||Pct Diff 0.842229611782
||Task ('AndHighLow', None)||P50 Base 1.330804||P50 Cmp 1.447035||Pct Diff 8.73389319539||P90 Base 6.846585||P90 Cmp 10.801523||Pct Diff 57.7651193989||P99 Base 59.165553||P99 Cmp 48.308535||Pct Diff -18.3502349754||P999 Base 59.165553||P999 Cmp 48.308535||Pct Diff -18.3502349754||P100 Base 123.658207||P100 Cmp 56.100208||Pct Diff -54.6328469731
||Task ('LowTerm', None)||P50 Base 0.919902||P50 Cmp 1.007008||Pct Diff 9.46905213816||P90 Base 39.5639||P90 Cmp 2.841782||Pct Diff -92.8172349035||P99 Base 40.390701||P99 Cmp 40.356468||Pct Diff -0.0847546567711||P999 Base 40.390701||P999 Cmp 40.356468||Pct Diff -0.0847546567711||P100 Base 108.220359||P100 Cmp 106.214976||Pct Diff -1.85305520933
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 126.448262||P50 Cmp 126.019876||Pct Diff -0.33878362045||P90 Base 139.567653||P90 Cmp 132.490857||Pct Diff -5.07051300777||P99 Base 139.679967||P99 Cmp 141.138587||Pct Diff 1.04425855141||P999 Base 139.679967||P999 Cmp 141.138587||Pct Diff 1.04425855141||P100 Base 279.843748||P100 Cmp 293.570349||Pct Diff 4.90509475309
||Task ('AndHighHigh', None)||P50 Base 4.95744||P50 Cmp 5.181431||Pct Diff 4.51827959592||P90 Base 6.72653||P90 Cmp 8.489595||Pct Diff 26.2106167667||P99 Base 6.856362||P99 Cmp 8.853899||Pct Diff 29.1340655584||P999 Base 6.856362||P999 Cmp 8.853899||Pct Diff 29.1340655584||P100 Base 45.105351||P100 Cmp 45.797024||Pct Diff 1.53346107427
||Task ('HighTermMonthSort', 'Month')||P50 Base 3.487652||P50 Cmp 3.607951||Pct Diff 3.4492833574||P90 Base 5.249394||P90 Cmp 5.45738||Pct Diff 3.96209543425||P99 Base 8.176226||P99 Cmp 5.830443||Pct Diff -28.690290606||P999 Base 8.176226||P999 Cmp 5.830443||Pct Diff -28.690290606||P100 Base 73.460005||P100 Cmp 80.713236||Pct Diff 9.87371427486
||Task Respell||P50 Base 15.861233||P50 Cmp 15.94603||Pct Diff 0.534617958137||P90 Base 56.771313||P90 Cmp 55.23887||Pct Diff -2.69932633054||P99 Base 265.235555||P99 Cmp 266.457543||Pct Diff 0.460718021006||P999 Base 265.235555||P999 Cmp 266.457543||Pct Diff 0.460718021006||P100 Base 467.498095||P100 Cmp 470.605703||Pct Diff 0.66473169265
||Task ('MedTerm', None)||P50 Base 1.024008||P50 Cmp 1.038314||Pct Diff 1.39705939797||P90 Base 1.515445||P90 Cmp 4.283643||Pct Diff 182.665685657||P99 Base 10.94847||P99 Cmp 10.831078||Pct Diff -1.0722228768||P999 Base 10.94847||P999 Cmp 10.831078||Pct Diff -1.0722228768||P100 Base 24.658843||P100 Cmp 26.945028||Pct Diff 9.27125818515
||Task ('HighIntervalsOrdered', None)||P50 Base 17.98637||P50 Cmp 19.979898||Pct Diff 11.0835482646||P90 Base 28.431043||P90 Cmp 29.603709||Pct Diff 4.12459718766||P99 Base 29.245666||P99 Cmp 29.650616||Pct Diff 1.38464960928||P999 Base 29.245666||P999 Cmp 29.650616||Pct Diff 1.38464960928||P100 Base 99.31829||P100 Cmp 90.548189||Pct Diff -8.83029802466
||Task ('HighSpanNear', None)||P50 Base 17.813105||P50 Cmp 17.848402||Pct Diff 0.19815186628||P90 Base 28.833998||P90 Cmp 29.032992||Pct Diff 0.690136692109||P99 Base 28.942126||P99 Cmp 33.430355||Pct Diff 15.5075995454||P999 Base 28.942126||P999 Cmp 33.430355||Pct Diff 15.5075995454||P100 Base 37.798872||P100 Cmp 38.066724||Pct Diff 0.708624320853
||Task ('LowSloppyPhrase', None)||P50 Base 15.592363||P50 Cmp 15.815739||Pct Diff 1.43259876646||P90 Base 25.854179||P90 Cmp 25.197871||Pct Diff -2.53849870847||P99 Base 26.526513||P99 Cmp 25.469514||Pct Diff -3.98468882812||P999 Base 26.526513||P999 Cmp 25.469514||Pct Diff -3.98468882812||P100 Base 39.548398||P100 Cmp 68.991091||Pct Diff 74.4472456255
||Task ('OrHighNotHigh', None)||P50 Base 1.74762||P50 Cmp 1.846285||Pct Diff 5.64567812225||P90 Base 11.152934||P90 Cmp 8.760799||Pct Diff -21.4484816282||P99 Base 14.528412||P99 Cmp 11.423507||Pct Diff -21.3712620485||P999 Base 14.528412||P999 Cmp 11.423507||Pct Diff -21.3712620485||P100 Base 46.262948||P100 Cmp 50.390157||Pct Diff 8.92119758559
||Task ('OrNotHighLow', None)||P50 Base 1.346165||P50 Cmp 1.372125||Pct Diff 1.92844116434||P90 Base 5.82323||P90 Cmp 4.82532||Pct Diff -17.136709352||P99 Base 14.423649||P99 Cmp 14.462002||Pct Diff 0.265903586533||P999 Base 14.423649||P999 Cmp 14.462002||Pct Diff 0.265903586533||P100 Base 29.623086||P100 Cmp 28.999158||Pct Diff -2.1062221539
||Task ('MedSpanNear', None)||P50 Base 8.189477||P50 Cmp 8.340445||Pct Diff 1.84343884231||P90 Base 12.022004||P90 Cmp 12.608729||Pct Diff 4.88042592566||P99 Base 12.286828||P99 Cmp 14.230191||Pct Diff 15.8166371337||P999 Base 12.286828||P999 Cmp 14.230191||Pct Diff 15.8166371337||P100 Base 12.878395||P100 Cmp 24.282332||Pct Diff 88.5509180298
||Task ('BrowseDateTaxoFacets', None)||P50 Base 431.560365||P50 Cmp 431.65332||Pct Diff 0.0215392810691||P90 Base 443.082507||P90 Cmp 452.816004||Pct Diff 2.19676851291||P99 Base 446.655819||P99 Cmp 453.135007||Pct Diff 1.45059970662||P999 Base 446.655819||P999 Cmp 453.135007||Pct Diff 1.45059970662||P100 Base 530.077843||P100 Cmp 729.86952||Pct Diff 37.6910070169
||Task ('HighPhrase', None)||P50 Base 4.272052||P50 Cmp 4.262914||Pct Diff -0.213901890707||P90 Base 5.926245||P90 Cmp 5.71747||Pct Diff -3.52288843948||P99 Base 7.106136||P99 Cmp 10.505745||Pct Diff 47.8404719527||P999 Base 7.106136||P999 Cmp 10.505745||Pct Diff 47.8404719527||P100 Base 36.528032||P100 Cmp 54.033222||Pct Diff 47.9226200853
||Task ('OrHighLow', None)||P50 Base 2.236858||P50 Cmp 2.548781||Pct Diff 13.9446938518||P90 Base 7.022585||P90 Cmp 4.546314||Pct Diff -35.2615311883||P99 Base 7.132426||P99 Cmp 6.205598||Pct Diff -12.9945687484||P999 Base 7.132426||P999 Cmp 6.205598||Pct Diff -12.9945687484||P100 Base 78.014438||P100 Cmp 99.711773||Pct Diff 27.8119480909
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.170683||P50 Cmp 0.193314||Pct Diff 13.2590826269||P90 Base 0.245881||P90 Cmp 0.219278||Pct Diff -10.8194614468||P99 Base 0.246944||P99 Cmp 0.267348||Pct Diff 8.26260204743||P999 Base 0.246944||P999 Cmp 0.267348||Pct Diff 8.26260204743||P100 Base 15.069649||P100 Cmp 15.26607||Pct Diff 1.30342120112
||Task ('OrHighMed', None)||P50 Base 3.427034||P50 Cmp 3.431079||Pct Diff 0.118032094225||P90 Base 6.529416||P90 Cmp 11.326026||Pct Diff 73.4615469439||P99 Base 63.774738||P99 Cmp 68.583773||Pct Diff 7.5406581835||P999 Base 63.774738||P999 Cmp 68.583773||Pct Diff 7.5406581835||P100 Base 118.063392||P100 Cmp 136.955873||Pct Diff 16.0019805292
||Task ('IntNRQ', None)||P50 Base 4.52857||P50 Cmp 4.828562||Pct Diff 6.62443111181||P90 Base 12.359936||P90 Cmp 12.420133||Pct Diff 0.487033266192||P99 Base 95.691574||P99 Cmp 95.882747||Pct Diff 0.199780390278||P999 Base 95.691574||P999 Cmp 95.882747||Pct Diff 0.199780390278||P100 Base 114.781329||P100 Cmp 126.426766||Pct Diff 10.1457589849
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.18166||P50 Cmp 0.180756||Pct Diff -0.497632940658||P90 Base 0.204548||P90 Cmp 0.224231||Pct Diff 9.62268025109||P99 Base 8.448858||P99 Cmp 8.74764||Pct Diff 3.53635958848||P999 Base 8.448858||P999 Cmp 8.74764||Pct Diff 3.53635958848||P100 Base 17.415993||P100 Cmp 17.436478||Pct Diff 0.117621774423
||Task ('AndHighMed', None)||P50 Base 3.310466||P50 Cmp 3.468133||Pct Diff 4.76268295763||P90 Base 6.744133||P90 Cmp 6.379727||Pct Diff -5.40330387909||P99 Base 203.286059||P99 Cmp 153.504765||Pct Diff -24.4882970553||P999 Base 203.286059||P999 Cmp 153.504765||Pct Diff -24.4882970553||P100 Base 240.525243||P100 Cmp 233.515911||Pct Diff -2.91417728658
||Task ('OrHighNotMed', None)||P50 Base 1.896813||P50 Cmp 1.830678||Pct Diff -3.48663784991||P90 Base 4.240436||P90 Cmp 6.390727||Pct Diff 50.7091959412||P99 Base 8.444942||P99 Cmp 8.476935||Pct Diff 0.378842151906||P999 Base 8.444942||P999 Cmp 8.476935||Pct Diff 0.378842151906||P100 Base 31.181582||P100 Cmp 16.681189||Pct Diff -46.5030703061
||Task ('Prefix3', None)||P50 Base 13.779946||P50 Cmp 17.112263||Pct Diff 24.1823661718||P90 Base 29.483902||P90 Cmp 28.341337||Pct Diff -3.87521638079||P99 Base 382.656665||P99 Cmp 405.821246||Pct Diff 6.05362015581||P999 Base 382.656665||P999 Cmp 405.821246||Pct Diff 6.05362015581||P100 Base 458.577179||P100 Cmp 621.481097||Pct Diff 35.5237734148
||Task PKLookup||P50 Base 10.422225||P50 Cmp 10.961537||Pct Diff 5.17463401529||P90 Base 72.637542||P90 Cmp 43.292874||Pct Diff -40.398762392||P99 Base 78.952622||P99 Cmp 86.367746||Pct Diff 9.39186541519||P999 Base 78.952622||P999 Cmp 86.367746||Pct Diff 9.39186541519||P100 Base 210.935602||P100 Cmp 220.608699||Pct Diff 4.58580576644
||Task ('HighTerm', None)||P50 Base 1.113717||P50 Cmp 1.186013||Pct Diff 6.4914156828||P90 Base 1.400581||P90 Cmp 2.868836||Pct Diff 104.831851924||P99 Base 1.724941||P99 Cmp 3.037282||Pct Diff 76.0803412986||P999 Base 1.724941||P999 Cmp 3.037282||Pct Diff 76.0803412986||P100 Base 3.226882||P100 Cmp 3.29191||Pct Diff 2.01519609332
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
BrowseDayOfYearTaxoFacets 6123.64 (3.0%) 5724.44 (3.5%) -6.5% ( -12% - 0%)
HighTermDayOfYearSort 285.36 (9.6%) 274.56 (9.9%) -3.8% ( -21% - 17%)
BrowseMonthTaxoFacets 6128.10 (6.2%) 5897.50 (3.6%) -3.8% ( -12% - 6%)
HighTerm 881.89 (3.9%) 849.63 (3.3%) -3.7% ( -10% - 3%)
HighTermMonthSort 331.37 (9.3%) 319.47 (19.9%) -3.6% ( -29% - 28%)
Fuzzy2 38.20 (13.5%) 36.84 (12.7%) -3.6% ( -26% - 26%)
LowPhrase 195.02 (4.8%) 188.39 (7.3%) -3.4% ( -14% - 9%)
OrHighHigh 58.65 (4.5%) 56.71 (6.3%) -3.3% ( -13% - 7%)
OrHighNotMed 587.28 (4.4%) 570.88 (6.7%) -2.8% ( -13% - 8%)
OrNotHighHigh 546.37 (4.5%) 534.04 (5.0%) -2.3% ( -11% - 7%)
Wildcard 530.00 (7.7%) 518.31 (7.5%) -2.2% ( -16% - 14%)
Fuzzy1 59.13 (8.0%) 57.83 (11.0%) -2.2% ( -19% - 18%)
Prefix3 71.38 (4.3%) 69.92 (4.7%) -2.0% ( -10% - 7%)
MedTerm 982.61 (5.6%) 963.11 (3.2%) -2.0% ( -10% - 7%)
OrHighLow 446.34 (5.1%) 438.26 (4.8%) -1.8% ( -11% - 8%)
AndHighHigh 198.03 (3.9%) 194.60 (2.8%) -1.7% ( -8% - 5%)
IntNRQ 256.30 (2.2%) 252.43 (5.4%) -1.5% ( -8% - 6%)
OrHighNotHigh 583.18 (6.1%) 574.82 (6.0%) -1.4% ( -12% - 11%)
PKLookup 93.96 (2.9%) 92.73 (3.4%) -1.3% ( -7% - 5%)
OrNotHighMed 685.14 (5.0%) 676.31 (5.2%) -1.3% ( -10% - 9%)
HighPhrase 241.36 (3.1%) 238.61 (3.8%) -1.1% ( -7% - 5%)
MedPhrase 152.02 (3.0%) 150.61 (3.1%) -0.9% ( -6% - 5%)
OrHighNotLow 661.73 (6.7%) 657.15 (5.5%) -0.7% ( -12% - 12%)
Respell 62.90 (2.6%) 62.46 (4.0%) -0.7% ( -7% - 6%)
OrNotHighLow 825.80 (4.7%) 822.55 (4.5%) -0.4% ( -9% - 9%)
LowSloppyPhrase 62.62 (7.0%) 62.47 (6.1%) -0.2% ( -12% - 13%)
HighSloppyPhrase 108.49 (6.3%) 108.25 (6.0%) -0.2% ( -11% - 12%)
BrowseDateTaxoFacets 2.32 (1.0%) 2.32 (1.1%) -0.0% ( -2% - 2%)
LowTerm 1144.33 (2.9%) 1143.81 (5.0%) -0.0% ( -7% - 8%)
AndHighLow 769.02 (3.1%) 771.61 (4.3%) 0.3% ( -6% - 7%)
HighIntervalsOrdered 55.35 (4.1%) 55.85 (1.8%) 0.9% ( -4% - 7%)
MedSpanNear 120.44 (3.3%) 121.59 (2.2%) 0.9% ( -4% - 6%)
LowSpanNear 42.75 (5.3%) 43.29 (2.5%) 1.3% ( -6% - 9%)
OrHighMed 306.71 (7.2%) 311.16 (4.6%) 1.5% ( -9% - 14%)
AndHighMed 298.28 (7.4%) 304.96 (8.0%) 2.2% ( -12% - 18%)
BrowseDayOfYearSSDVFacets 10.31 (19.7%) 10.63 (18.7%) 3.1% ( -29% - 51%)
BrowseMonthSSDVFacets 12.65 (21.7%) 13.05 (22.2%) 3.1% ( -33% - 59%)
HighSpanNear 53.07 (7.9%) 54.75 (2.7%) 3.2% ( -6% - 14%)
MedSloppyPhrase 120.33 (8.1%) 125.91 (2.6%) 4.6% ( -5% - 16%)
iter 13
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.13 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -8968737 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.13 -topN 10 -pk
21.9 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.13 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -8968737 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.13 -topN 10 -pk
21.7 s
Report after iter 13:
||Task ('Wildcard', None)||P50 Base 2.246774||P50 Cmp 2.214484||Pct Diff -1.43717169595||P90 Base 16.393891||P90 Cmp 14.57912||Pct Diff -11.0698003299||P99 Base 28.451022||P99 Cmp 28.076437||Pct Diff -1.3165959381||P999 Base 28.451022||P999 Cmp 28.076437||Pct Diff -1.3165959381||P100 Base 205.810719||P100 Cmp 267.448051||Pct Diff 29.948552874
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 3.236744||P50 Cmp 3.495395||Pct Diff 7.99108610381||P90 Base 12.841258||P90 Cmp 10.347387||Pct Diff -19.4207685882||P99 Base 73.971058||P99 Cmp 75.663989||Pct Diff 2.28863970014||P999 Base 73.971058||P999 Cmp 75.663989||Pct Diff 2.28863970014||P100 Base 104.093801||P100 Cmp 121.8582||Pct Diff 17.0657607171
||Task ('MedSloppyPhrase', None)||P50 Base 8.00801||P50 Cmp 7.714605||Pct Diff -3.66389402611||P90 Base 12.386814||P90 Cmp 11.483508||Pct Diff -7.29248053616||P99 Base 12.577312||P99 Cmp 12.062994||Pct Diff -4.08925213909||P999 Base 12.577312||P999 Cmp 12.062994||Pct Diff -4.08925213909||P100 Base 92.130518||P100 Cmp 155.481749||Pct Diff 68.762482156
||Task ('OrHighHigh', None)||P50 Base 16.506187||P50 Cmp 17.82791||Pct Diff 8.00743987694||P90 Base 37.811792||P90 Cmp 28.807101||Pct Diff -23.814504745||P99 Base 70.120839||P99 Cmp 56.190021||Pct Diff -19.8668729563||P999 Base 70.120839||P999 Cmp 56.190021||Pct Diff -19.8668729563||P100 Base 309.479514||P100 Cmp 220.5857||Pct Diff -28.7236505095
||Task ('MedPhrase', None)||P50 Base 6.271142||P50 Cmp 6.545408||Pct Diff 4.37346180329||P90 Base 7.581631||P90 Cmp 8.67573||Pct Diff 14.4309186242||P99 Base 10.047373||P99 Cmp 9.2069||Pct Diff -8.36510200228||P999 Base 10.047373||P999 Cmp 9.2069||Pct Diff -8.36510200228||P100 Base 82.164202||P100 Cmp 10.478994||Pct Diff -87.2462778863
||Task ('LowSpanNear', None)||P50 Base 22.438611||P50 Cmp 22.854171||Pct Diff 1.85198629273||P90 Base 32.124165||P90 Cmp 31.20419||Pct Diff -2.86380984533||P99 Base 34.926091||P99 Cmp 32.292139||Pct Diff -7.54150242579||P999 Base 34.926091||P999 Cmp 32.292139||Pct Diff -7.54150242579||P100 Base 35.364936||P100 Cmp 34.368809||Pct Diff -2.81670805229
||Task ('Fuzzy2', None)||P50 Base 44.946252||P50 Cmp 35.331372||Pct Diff -21.3919505457||P90 Base 330.168712||P90 Cmp 333.198773||Pct Diff 0.917731114389||P99 Base 336.833599||P99 Cmp 350.244583||Pct Diff 3.98148641935||P999 Base 336.833599||P999 Cmp 350.244583||Pct Diff 3.98148641935||P100 Base 846.635405||P100 Cmp 585.03908||Pct Diff -30.8983446068
||Task ('OrNotHighHigh', None)||P50 Base 2.093246||P50 Cmp 1.978241||Pct Diff -5.49409863915||P90 Base 11.022842||P90 Cmp 2.599249||Pct Diff -76.4194297623||P99 Base 39.534225||P99 Cmp 39.519251||Pct Diff -0.0378760428464||P999 Base 39.534225||P999 Cmp 39.519251||Pct Diff -0.0378760428464||P100 Base 150.358826||P100 Cmp 149.40583||Pct Diff -0.633814472587
||Task ('OrHighNotLow', None)||P50 Base 1.787097||P50 Cmp 1.738775||Pct Diff -2.70393828651||P90 Base 3.287326||P90 Cmp 2.799701||Pct Diff -14.8334847228||P99 Base 4.358171||P99 Cmp 4.303933||Pct Diff -1.24451289314||P999 Base 4.358171||P999 Cmp 4.303933||Pct Diff -1.24451289314||P100 Base 4.477693||P100 Cmp 4.540843||Pct Diff 1.41032446843
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 62.101528||P50 Cmp 62.470792||Pct Diff 0.594613388579||P90 Base 63.69688||P90 Cmp 75.467105||Pct Diff 18.478495336||P99 Base 71.198283||P99 Cmp 76.761687||Pct Diff 7.81395809784||P999 Base 71.198283||P999 Cmp 76.761687||Pct Diff 7.81395809784||P100 Base 237.966415||P100 Cmp 271.270404||Pct Diff 13.9952476067
||Task ('Fuzzy1', None)||P50 Base 16.219768||P50 Cmp 16.557643||Pct Diff 2.08310624418||P90 Base 64.750795||P90 Cmp 97.976402||Pct Diff 51.3130487433||P99 Base 100.851412||P99 Cmp 188.877003||Pct Diff 87.2824576814||P999 Base 100.851412||P999 Cmp 188.877003||Pct Diff 87.2824576814||P100 Base 218.318606||P100 Cmp 216.026839||Pct Diff -1.04973508305
||Task ('HighSloppyPhrase', None)||P50 Base 9.401456||P50 Cmp 8.991901||Pct Diff -4.35629332308||P90 Base 11.331823||P90 Cmp 12.032718||Pct Diff 6.18519191484||P99 Base 11.468109||P99 Cmp 15.486031||Pct Diff 35.0356104917||P999 Base 11.468109||P999 Cmp 15.486031||Pct Diff 35.0356104917||P100 Base 15.96028||P100 Cmp 17.374662||Pct Diff 8.86188713481
||Task ('OrNotHighMed', None)||P50 Base 1.508023||P50 Cmp 1.498672||Pct Diff -0.620083380691||P90 Base 3.494542||P90 Cmp 3.572709||Pct Diff 2.23683103537||P99 Base 5.397036||P99 Cmp 5.298455||Pct Diff -1.82657666171||P999 Base 5.397036||P999 Cmp 5.298455||Pct Diff -1.82657666171||P100 Base 54.536734||P100 Cmp 93.941379||Pct Diff 72.2534007995
||Task ('LowPhrase', None)||P50 Base 4.94387||P50 Cmp 7.048467||Pct Diff 42.5698288992||P90 Base 12.988726||P90 Cmp 7.653008||Pct Diff -41.0796101173||P99 Base 13.263257||P99 Cmp 14.33792||Pct Diff 8.10255731303||P999 Base 13.263257||P999 Cmp 14.33792||Pct Diff 8.10255731303||P100 Base 16.144551||P100 Cmp 29.328683||Pct Diff 81.663045321
||Task ('AndHighLow', None)||P50 Base 1.363036||P50 Cmp 1.392747||Pct Diff 2.17976634513||P90 Base 2.037759||P90 Cmp 4.289173||Pct Diff 110.484802177||P99 Base 4.553371||P99 Cmp 4.515538||Pct Diff -0.830878924647||P999 Base 4.553371||P999 Cmp 4.515538||Pct Diff -0.830878924647||P100 Base 6.179696||P100 Cmp 6.284827||Pct Diff 1.70123255254
||Task ('LowTerm', None)||P50 Base 0.896696||P50 Cmp 0.908644||Pct Diff 1.33244711697||P90 Base 1.049336||P90 Cmp 8.565047||Pct Diff 716.234933329||P99 Base 1.641472||P99 Cmp 10.429078||Pct Diff 535.349125663||P999 Base 1.641472||P999 Cmp 10.429078||Pct Diff 535.349125663||P100 Base 46.785764||P100 Cmp 39.461384||Pct Diff -15.6551467237
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 76.7936||P50 Cmp 77.101156||Pct Diff 0.40049691641||P90 Base 78.557566||P90 Cmp 96.047236||Pct Diff 22.2635080114||P99 Base 97.705683||P99 Cmp 143.151263||Pct Diff 46.5127294591||P999 Base 97.705683||P999 Cmp 143.151263||Pct Diff 46.5127294591||P100 Base 235.903164||P100 Cmp 239.575139||Pct Diff 1.55656030116
||Task ('AndHighHigh', None)||P50 Base 4.865632||P50 Cmp 4.92719||Pct Diff 1.26515938731||P90 Base 14.50998||P90 Cmp 22.288638||Pct Diff 53.6090194473||P99 Base 71.515926||P99 Cmp 71.974465||Pct Diff 0.641170471595||P999 Base 71.515926||P999 Cmp 71.974465||Pct Diff 0.641170471595||P100 Base 562.085518||P100 Cmp 477.509076||Pct Diff -15.0468993225
||Task ('HighTermMonthSort', 'Month')||P50 Base 2.381071||P50 Cmp 2.466084||Pct Diff 3.57036812426||P90 Base 6.339715||P90 Cmp 4.696163||Pct Diff -25.9246985077||P99 Base 31.893869||P99 Cmp 24.272735||Pct Diff -23.8952947352||P999 Base 31.893869||P999 Cmp 24.272735||Pct Diff -23.8952947352||P100 Base 105.516287||P100 Cmp 65.407539||Pct Diff -38.0119023711
||Task Respell||P50 Base 15.627815||P50 Cmp 17.519932||Pct Diff 12.1073675367||P90 Base 127.847574||P90 Cmp 75.296573||Pct Diff -41.1044178281||P99 Base 212.583222||P99 Cmp 149.832904||Pct Diff -29.5180011901||P999 Base 212.583222||P999 Cmp 149.832904||Pct Diff -29.5180011901||P100 Base 253.964696||P100 Cmp 330.311236||Pct Diff 30.0618712768
||Task ('MedTerm', None)||P50 Base 0.979655||P50 Cmp 1.056266||Pct Diff 7.82020200989||P90 Base 3.688653||P90 Cmp 3.519827||Pct Diff -4.57690110726||P99 Base 5.326215||P99 Cmp 22.212156||Pct Diff 317.034535782||P999 Base 5.326215||P999 Cmp 22.212156||Pct Diff 317.034535782||P100 Base 20.912267||P100 Cmp 65.055513||Pct Diff 211.087807936
||Task ('HighIntervalsOrdered', None)||P50 Base 17.132158||P50 Cmp 17.776976||Pct Diff 3.76378737576||P90 Base 23.811886||P90 Cmp 27.221892||Pct Diff 14.3206044242||P99 Base 28.331159||P99 Cmp 28.89826||Pct Diff 2.00168655296||P999 Base 28.331159||P999 Cmp 28.89826||Pct Diff 2.00168655296||P100 Base 458.04257||P100 Cmp 424.815471||Pct Diff -7.25415085327
||Task ('HighSpanNear', None)||P50 Base 17.712546||P50 Cmp 17.967615||Pct Diff 1.44004707172||P90 Base 20.183063||P90 Cmp 27.947753||Pct Diff 38.4713162715||P99 Base 28.59821||P99 Cmp 28.880835||Pct Diff 0.988261153408||P999 Base 28.59821||P999 Cmp 28.880835||Pct Diff 0.988261153408||P100 Base 162.05487||P100 Cmp 236.277004||Pct Diff 45.8006192594
||Task ('LowSloppyPhrase', None)||P50 Base 15.599973||P50 Cmp 15.556012||Pct Diff -0.281801769785||P90 Base 25.4868||P90 Cmp 25.322295||Pct Diff -0.645451763266||P99 Base 33.487639||P99 Cmp 34.146556||Pct Diff 1.96764244861||P999 Base 33.487639||P999 Cmp 34.146556||Pct Diff 1.96764244861||P100 Base 69.286033||P100 Cmp 70.120612||Pct Diff 1.20454146942
||Task ('OrHighNotHigh', None)||P50 Base 1.994183||P50 Cmp 1.738889||Pct Diff -12.8019344263||P90 Base 2.871508||P90 Cmp 7.265775||Pct Diff 153.029941062||P99 Base 6.764703||P99 Cmp 10.659773||Pct Diff 57.579320186||P999 Base 6.764703||P999 Cmp 10.659773||Pct Diff 57.579320186||P100 Base 13.393555||P100 Cmp 74.060893||Pct Diff 452.959188207
||Task ('OrNotHighLow', None)||P50 Base 1.537525||P50 Cmp 1.258162||Pct Diff -18.169655778||P90 Base 5.061305||P90 Cmp 3.236435||Pct Diff -36.0553256522||P99 Base 9.933878||P99 Cmp 3.29205||Pct Diff -66.8603741661||P999 Base 9.933878||P999 Cmp 3.29205||Pct Diff -66.8603741661||P100 Base 56.922033||P100 Cmp 4.222639||Pct Diff -92.5817143601
||Task ('MedSpanNear', None)||P50 Base 8.405811||P50 Cmp 8.329578||Pct Diff -0.90690832806||P90 Base 41.676991||P90 Cmp 39.119288||Pct Diff -6.13696655788||P99 Base 96.711553||P99 Cmp 97.449931||Pct Diff 0.763484792763||P999 Base 96.711553||P999 Cmp 97.449931||Pct Diff 0.763484792763||P100 Base 110.898972||P100 Cmp 109.795237||Pct Diff -0.995261705402
||Task ('BrowseDateTaxoFacets', None)||P50 Base 434.583423||P50 Cmp 430.805316||Pct Diff -0.869362888699||P90 Base 444.721852||P90 Cmp 459.151511||Pct Diff 3.24464807275||P99 Base 453.639259||P99 Cmp 502.67864||Pct Diff 10.8102153919||P999 Base 453.639259||P999 Cmp 502.67864||Pct Diff 10.8102153919||P100 Base 596.143569||P100 Cmp 684.131558||Pct Diff 14.7595300152
||Task ('HighPhrase', None)||P50 Base 4.477956||P50 Cmp 4.126473||Pct Diff -7.84918386871||P90 Base 11.153107||P90 Cmp 6.664059||Pct Diff -40.2493045212||P99 Base 11.859451||P99 Cmp 9.791222||Pct Diff -17.4395003614||P999 Base 11.859451||P999 Cmp 9.791222||Pct Diff -17.4395003614||P100 Base 119.352221||P100 Cmp 168.460964||Pct Diff 41.1460654762
||Task ('OrHighLow', None)||P50 Base 2.279336||P50 Cmp 2.298793||Pct Diff 0.853625792775||P90 Base 2.761877||P90 Cmp 5.191933||Pct Diff 87.9856706146||P99 Base 3.558457||P99 Cmp 11.682133||Pct Diff 228.292094017||P999 Base 3.558457||P999 Cmp 11.682133||Pct Diff 228.292094017||P100 Base 20.615919||P100 Cmp 25.205834||Pct Diff 22.2639359419
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.171304||P50 Cmp 0.180445||Pct Diff 5.33612758605||P90 Base 0.288024||P90 Cmp 0.320278||Pct Diff 11.1983723579||P99 Base 9.705337||P99 Cmp 9.138956||Pct Diff -5.83576850551||P999 Base 9.705337||P999 Cmp 9.138956||Pct Diff -5.83576850551||P100 Base 23.212615||P100 Cmp 23.70211||Pct Diff 2.10874561095
||Task ('OrHighMed', None)||P50 Base 3.481295||P50 Cmp 4.184074||Pct Diff 20.1872866275||P90 Base 12.350945||P90 Cmp 16.968534||Pct Diff 37.3865238652||P99 Base 24.339825||P99 Cmp 24.636623||Pct Diff 1.21939249769||P999 Base 24.339825||P999 Cmp 24.636623||Pct Diff 1.21939249769||P100 Base 55.364124||P100 Cmp 76.462994||Pct Diff 38.1092817435
||Task ('IntNRQ', None)||P50 Base 3.988971||P50 Cmp 4.057643||Pct Diff 1.72154673473||P90 Base 11.909225||P90 Cmp 12.778008||Pct Diff 7.29504228865||P99 Base 70.914507||P99 Cmp 71.255103||Pct Diff 0.480291007311||P999 Base 70.914507||P999 Cmp 71.255103||Pct Diff 0.480291007311||P100 Base 167.289439||P100 Cmp 90.171652||Pct Diff -46.0984192792
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.172621||P50 Cmp 0.166666||Pct Diff -3.44975408554||P90 Base 0.218||P90 Cmp 0.238532||Pct Diff 9.41834862385||P99 Base 0.221822||P99 Cmp 0.29732||Pct Diff 34.0353977514||P999 Base 0.221822||P999 Cmp 0.29732||Pct Diff 34.0353977514||P100 Base 27.163413||P100 Cmp 23.501414||Pct Diff -13.4813655412
||Task ('AndHighMed', None)||P50 Base 3.236948||P50 Cmp 3.089999||Pct Diff -4.53973928528||P90 Base 6.664744||P90 Cmp 5.42146||Pct Diff -18.6546399982||P99 Base 10.771476||P99 Cmp 14.536892||Pct Diff 34.9572890475||P999 Base 10.771476||P999 Cmp 14.536892||Pct Diff 34.9572890475||P100 Base 12.480685||P100 Cmp 32.679172||Pct Diff 161.837968028
||Task ('OrHighNotMed', None)||P50 Base 1.850786||P50 Cmp 1.803027||Pct Diff -2.58047121601||P90 Base 10.831679||P90 Cmp 1.958788||Pct Diff -81.9161184522||P99 Base 14.886005||P99 Cmp 2.308278||Pct Diff -84.4936368085||P999 Base 14.886005||P999 Cmp 2.308278||Pct Diff -84.4936368085||P100 Base 21.792811||P100 Cmp 3.607304||Pct Diff -83.4472753423
||Task ('Prefix3', None)||P50 Base 13.792416||P50 Cmp 14.500622||Pct Diff 5.13474941591||P90 Base 21.19848||P90 Cmp 24.326854||Pct Diff 14.7575392198||P99 Base 287.119298||P99 Cmp 359.860741||Pct Diff 25.334919494||P999 Base 287.119298||P999 Cmp 359.860741||Pct Diff 25.334919494||P100 Base 434.343162||P100 Cmp 447.462647||Pct Diff 3.02053448697
||Task PKLookup||P50 Base 10.737063||P50 Cmp 12.026601||Pct Diff 12.0101558499||P90 Base 11.227873||P90 Cmp 59.64726||Pct Diff 431.242738496||P99 Base 108.170119||P99 Cmp 86.44546||Pct Diff -20.0837894983||P999 Base 108.170119||P999 Cmp 86.44546||Pct Diff -20.0837894983||P100 Base 177.044044||P100 Cmp 190.878307||Pct Diff 7.81402338505
||Task ('HighTerm', None)||P50 Base 1.083012||P50 Cmp 1.182835||Pct Diff 9.21716472209||P90 Base 1.399262||P90 Cmp 1.755468||Pct Diff 25.4567050345||P99 Base 1.885072||P99 Cmp 4.356212||Pct Diff 131.089953063||P999 Base 1.885072||P999 Cmp 4.356212||Pct Diff 131.089953063||P100 Base 10.732633||P100 Cmp 7.955149||Pct Diff -25.8788686802
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
BrowseDayOfYearTaxoFacets 6123.24 (2.9%) 5721.98 (3.4%) -6.6% ( -12% - 0%)
LowPhrase 196.01 (5.0%) 187.65 (7.1%) -4.3% ( -15% - 8%)
HighTerm 886.81 (4.3%) 851.56 (3.2%) -4.0% ( -11% - 3%)
BrowseMonthTaxoFacets 6118.06 (6.0%) 5906.94 (3.5%) -3.5% ( -12% - 6%)
HighTermMonthSort 338.00 (11.3%) 326.45 (20.2%) -3.4% ( -31% - 31%)
HighTermDayOfYearSort 288.06 (9.7%) 278.48 (10.6%) -3.3% ( -21% - 18%)
OrHighHigh 58.82 (4.4%) 56.95 (6.2%) -3.2% ( -13% - 7%)
OrHighNotMed 586.52 (4.3%) 571.25 (6.5%) -2.6% ( -12% - 8%)
Fuzzy2 37.62 (14.4%) 36.67 (12.6%) -2.5% ( -25% - 28%)
MedTerm 987.16 (5.6%) 962.74 (3.1%) -2.5% ( -10% - 6%)
Prefix3 71.46 (4.1%) 69.86 (4.5%) -2.2% ( -10% - 6%)
Fuzzy1 59.39 (7.9%) 58.13 (10.7%) -2.1% ( -19% - 17%)
Wildcard 524.72 (8.3%) 514.09 (7.9%) -2.0% ( -16% - 15%)
OrNotHighHigh 543.00 (4.9%) 532.77 (4.9%) -1.9% ( -11% - 8%)
OrHighLow 446.74 (5.0%) 438.41 (4.6%) -1.9% ( -10% - 8%)
PKLookup 94.04 (2.8%) 92.29 (3.6%) -1.9% ( -8% - 4%)
AndHighHigh 198.61 (3.9%) 195.49 (3.2%) -1.6% ( -8% - 5%)
Respell 63.03 (2.6%) 62.21 (4.1%) -1.3% ( -7% - 5%)
OrNotHighMed 685.52 (4.8%) 676.71 (5.0%) -1.3% ( -10% - 8%)
MedPhrase 152.81 (3.4%) 150.94 (3.0%) -1.2% ( -7% - 5%)
IntNRQ 256.03 (2.1%) 253.17 (5.3%) -1.1% ( -8% - 6%)
OrHighNotHigh 580.98 (6.1%) 575.09 (5.8%) -1.0% ( -12% - 11%)
OrHighNotLow 656.93 (7.0%) 652.09 (6.0%) -0.7% ( -12% - 13%)
HighPhrase 239.68 (3.9%) 238.91 (3.8%) -0.3% ( -7% - 7%)
LowSloppyPhrase 62.74 (6.8%) 62.66 (6.0%) -0.1% ( -12% - 13%)
LowTerm 1142.67 (2.8%) 1142.01 (4.8%) -0.1% ( -7% - 7%)
BrowseDateTaxoFacets 2.32 (1.0%) 2.32 (1.0%) -0.0% ( -1% - 2%)
AndHighLow 768.61 (3.0%) 768.97 (4.3%) 0.0% ( -7% - 7%)
HighSloppyPhrase 108.40 (6.1%) 108.57 (5.9%) 0.2% ( -11% - 12%)
OrHighMed 306.68 (6.9%) 307.33 (6.3%) 0.2% ( -12% - 14%)
OrNotHighLow 821.11 (5.0%) 823.06 (4.4%) 0.2% ( -8% - 10%)
HighIntervalsOrdered 55.57 (4.2%) 55.98 (2.0%) 0.8% ( -5% - 7%)
LowSpanNear 42.90 (5.2%) 43.34 (2.5%) 1.0% ( -6% - 9%)
MedSpanNear 120.50 (3.2%) 121.81 (2.2%) 1.1% ( -4% - 6%)
AndHighMed 299.60 (7.3%) 306.66 (7.9%) 2.4% ( -11% - 18%)
BrowseDayOfYearSSDVFacets 10.51 (19.8%) 10.80 (18.6%) 2.8% ( -29% - 51%)
BrowseMonthSSDVFacets 12.90 (21.6%) 13.26 (21.8%) 2.8% ( -33% - 58%)
HighSpanNear 53.32 (7.7%) 54.84 (2.7%) 2.8% ( -7% - 14%)
MedSloppyPhrase 120.80 (7.9%) 126.33 (2.7%) 4.6% ( -5% - 16%)
iter 14
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.14 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -98782 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.14 -topN 10 -pk
21.3 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.14 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -98782 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.14 -topN 10 -pk
21.0 s
Report after iter 14:
||Task ('Wildcard', None)||P50 Base 1.826192||P50 Cmp 1.81915||Pct Diff -0.385611151511||P90 Base 17.024828||P90 Cmp 2.552856||Pct Diff -85.005099611||P99 Base 27.90228||P99 Cmp 16.596774||Pct Diff -40.5182157157||P999 Base 27.90228||P999 Cmp 16.596774||Pct Diff -40.5182157157||P100 Base 152.446649||P100 Cmp 95.551288||Pct Diff -37.3214900906
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 2.999183||P50 Cmp 3.410323||Pct Diff 13.7083999209||P90 Base 75.952682||P90 Cmp 88.284165||Pct Diff 16.235743986||P99 Base 87.456702||P99 Cmp 104.657562||Pct Diff 19.6678580448||P999 Base 87.456702||P999 Cmp 104.657562||Pct Diff 19.6678580448||P100 Base 125.955105||P100 Cmp 132.065999||Pct Diff 4.85164456018
||Task ('MedSloppyPhrase', None)||P50 Base 8.182656||P50 Cmp 8.195719||Pct Diff 0.159642541493||P90 Base 12.576031||P90 Cmp 14.453067||Pct Diff 14.9255039209||P99 Base 12.633269||P99 Cmp 20.47441||Pct Diff 62.0673952245||P999 Base 12.633269||P999 Cmp 20.47441||Pct Diff 62.0673952245||P100 Base 55.653368||P100 Cmp 44.363829||Pct Diff -20.2854551408
||Task ('OrHighHigh', None)||P50 Base 17.228415||P50 Cmp 16.713194||Pct Diff -2.99053046958||P90 Base 30.694973||P90 Cmp 26.906723||Pct Diff -12.3415974336||P99 Base 33.893369||P99 Cmp 31.367713||Pct Diff -7.4517702858||P999 Base 33.893369||P999 Cmp 31.367713||Pct Diff -7.4517702858||P100 Base 179.44146||P100 Cmp 109.550959||Pct Diff -38.9489145931
||Task ('MedPhrase', None)||P50 Base 6.772893||P50 Cmp 6.399417||Pct Diff -5.51427580504||P90 Base 7.856607||P90 Cmp 11.672274||Pct Diff 48.5663467703||P99 Base 11.383118||P99 Cmp 12.336321||Pct Diff 8.37383043908||P999 Base 11.383118||P999 Cmp 12.336321||Pct Diff 8.37383043908||P100 Base 63.423793||P100 Cmp 63.11793||Pct Diff -0.482252772236
||Task ('LowSpanNear', None)||P50 Base 25.230493||P50 Cmp 23.014741||Pct Diff -8.78204004971||P90 Base 36.98101||P90 Cmp 30.718438||Pct Diff -16.9345618197||P99 Base 37.272039||P99 Cmp 31.027245||Pct Diff -16.7546347545||P999 Base 37.272039||P999 Cmp 31.027245||Pct Diff -16.7546347545||P100 Base 73.498525||P100 Cmp 36.039348||Pct Diff -50.9658894515
||Task ('Fuzzy2', None)||P50 Base 29.202616||P50 Cmp 30.520276||Pct Diff 4.51213000917||P90 Base 107.658647||P90 Cmp 101.024576||Pct Diff -6.16213484459||P99 Base 112.018789||P99 Cmp 107.189209||Pct Diff -4.31140172387||P999 Base 112.018789||P999 Cmp 107.189209||Pct Diff -4.31140172387||P100 Base 507.055268||P100 Cmp 793.276421||Pct Diff 56.4477229729
||Task ('OrNotHighHigh', None)||P50 Base 1.896781||P50 Cmp 1.765872||Pct Diff -6.9016401999||P90 Base 6.848834||P90 Cmp 7.150968||Pct Diff 4.41146624374||P99 Base 39.395186||P99 Cmp 40.610769||Pct Diff 3.08561304927||P999 Base 39.395186||P999 Cmp 40.610769||Pct Diff 3.08561304927||P100 Base 63.454048||P100 Cmp 60.820584||Pct Diff -4.15019070178
||Task ('OrHighNotLow', None)||P50 Base 1.661729||P50 Cmp 1.503417||Pct Diff -9.52694452585||P90 Base 5.735538||P90 Cmp 5.367465||Pct Diff -6.4174101889||P99 Base 8.662087||P99 Cmp 9.314061||Pct Diff 7.52675423371||P999 Base 8.662087||P999 Cmp 9.314061||Pct Diff 7.52675423371||P100 Base 69.87614||P100 Cmp 68.501008||Pct Diff -1.96795644407
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 62.462976||P50 Cmp 61.763261||Pct Diff -1.12020759305||P90 Base 78.144691||P90 Cmp 82.701422||Pct Diff 5.83114596998||P99 Base 82.286215||P99 Cmp 100.038637||Pct Diff 21.5739926791||P999 Base 82.286215||P999 Cmp 100.038637||Pct Diff 21.5739926791||P100 Base 252.046748||P100 Cmp 295.875735||Pct Diff 17.3892293187
||Task ('Fuzzy1', None)||P50 Base 19.249245||P50 Cmp 20.908276||Pct Diff 8.61868088852||P90 Base 46.45593||P90 Cmp 45.66671||Pct Diff -1.69885739022||P99 Base 135.306624||P99 Cmp 242.859493||Pct Diff 79.4882510704||P999 Base 135.306624||P999 Cmp 242.859493||Pct Diff 79.4882510704||P100 Base 205.072153||P100 Cmp 246.803357||Pct Diff 20.349522541
||Task ('HighSloppyPhrase', None)||P50 Base 9.641752||P50 Cmp 9.733675||Pct Diff 0.953384820518||P90 Base 12.890322||P90 Cmp 14.677797||Pct Diff 13.8667986727||P99 Base 17.331869||P99 Cmp 15.954658||Pct Diff -7.9461193712||P999 Base 17.331869||P999 Cmp 15.954658||Pct Diff -7.9461193712||P100 Base 74.559212||P100 Cmp 27.973613||Pct Diff -62.4813456988
||Task ('OrNotHighMed', None)||P50 Base 1.546638||P50 Cmp 1.340051||Pct Diff -13.3571656716||P90 Base 2.184576||P90 Cmp 2.823431||Pct Diff 29.2438898898||P99 Base 22.711152||P99 Cmp 14.155771||Pct Diff -37.6703964643||P999 Base 22.711152||P999 Cmp 14.155771||Pct Diff -37.6703964643||P100 Base 33.08326||P100 Cmp 22.977868||Pct Diff -30.5453331987
||Task ('LowPhrase', None)||P50 Base 5.493062||P50 Cmp 4.880576||Pct Diff -11.1501745293||P90 Base 8.856751||P90 Cmp 22.932521||Pct Diff 158.92701511||P99 Base 21.879804||P99 Cmp 26.327847||Pct Diff 20.3294462784||P999 Base 21.879804||P999 Cmp 26.327847||Pct Diff 20.3294462784||P100 Base 104.073231||P100 Cmp 127.180215||Pct Diff 22.2026199994
||Task ('AndHighLow', None)||P50 Base 1.407332||P50 Cmp 1.291694||Pct Diff -8.21682445933||P90 Base 3.931793||P90 Cmp 4.418295||Pct Diff 12.3735405196||P99 Base 5.394403||P99 Cmp 5.456912||Pct Diff 1.15877512303||P999 Base 5.394403||P999 Cmp 5.456912||Pct Diff 1.15877512303||P100 Base 108.01162||P100 Cmp 23.757923||Pct Diff -78.0042897236
||Task ('LowTerm', None)||P50 Base 0.868936||P50 Cmp 0.787478||Pct Diff -9.37445335445||P90 Base 1.104414||P90 Cmp 1.754375||Pct Diff 58.8512097818||P99 Base 2.634233||P99 Cmp 2.591666||Pct Diff -1.61591628379||P999 Base 2.634233||P999 Cmp 2.591666||Pct Diff -1.61591628379||P100 Base 5.376007||P100 Cmp 4.379851||Pct Diff -18.5296633728
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 76.970403||P50 Cmp 76.730301||Pct Diff -0.311940681927||P90 Base 86.85257||P90 Cmp 83.532556||Pct Diff -3.82258579107||P99 Base 90.684493||P99 Cmp 86.249203||Pct Diff -4.89090235086||P999 Base 90.684493||P999 Cmp 86.249203||Pct Diff -4.89090235086||P100 Base 416.313697||P100 Cmp 342.918621||Pct Diff -17.6297528832
||Task ('AndHighHigh', None)||P50 Base 5.067786||P50 Cmp 5.048576||Pct Diff -0.379060994288||P90 Base 7.028267||P90 Cmp 8.976541||Pct Diff 27.7205461887||P99 Base 21.105669||P99 Cmp 22.086317||Pct Diff 4.64637249831||P999 Base 21.105669||P999 Cmp 22.086317||Pct Diff 4.64637249831||P100 Base 114.284456||P100 Cmp 106.998853||Pct Diff -6.37497281345
||Task ('HighTermMonthSort', 'Month')||P50 Base 3.119856||P50 Cmp 3.042324||Pct Diff -2.4851146976||P90 Base 7.176149||P90 Cmp 8.671923||Pct Diff 20.8436864954||P99 Base 10.806741||P99 Cmp 10.887217||Pct Diff 0.744683341629||P999 Base 10.806741||P999 Cmp 10.887217||Pct Diff 0.744683341629||P100 Base 23.735376||P100 Cmp 24.00876||Pct Diff 1.15179974398
||Task Respell||P50 Base 18.137105||P50 Cmp 15.364231||Pct Diff -15.2884046269||P90 Base 123.914691||P90 Cmp 222.148667||Pct Diff 79.2754880049||P99 Base 263.648672||P99 Cmp 265.486134||Pct Diff 0.696935807058||P999 Base 263.648672||P999 Cmp 265.486134||Pct Diff 0.696935807058||P100 Base 594.142119||P100 Cmp 1038.775827||Pct Diff 74.8362544551
||Task ('MedTerm', None)||P50 Base 1.090618||P50 Cmp 1.011131||Pct Diff -7.2882530822||P90 Base 1.98715||P90 Cmp 1.313814||Pct Diff -33.8845079637||P99 Base 2.936507||P99 Cmp 2.152171||Pct Diff -26.7098290588||P999 Base 2.936507||P999 Cmp 2.152171||Pct Diff -26.7098290588||P100 Base 4.124135||P100 Cmp 2.838985||Pct Diff -31.1616860263
||Task ('HighIntervalsOrdered', None)||P50 Base 17.912247||P50 Cmp 17.961404||Pct Diff 0.274432347879||P90 Base 28.964266||P90 Cmp 29.95843||Pct Diff 3.43238112784||P99 Base 31.514893||P99 Cmp 31.926216||Pct Diff 1.30517022539||P999 Base 31.514893||P999 Cmp 31.926216||Pct Diff 1.30517022539||P100 Base 74.312673||P100 Cmp 84.153313||Pct Diff 13.2422097103
||Task ('HighSpanNear', None)||P50 Base 19.10036||P50 Cmp 18.923613||Pct Diff -0.925359522019||P90 Base 27.511472||P90 Cmp 25.501979||Pct Diff -7.304200226||P99 Base 28.751582||P99 Cmp 29.029107||Pct Diff 0.965251233828||P999 Base 28.751582||P999 Cmp 29.029107||Pct Diff 0.965251233828||P100 Base 318.840342||P100 Cmp 371.69418||Pct Diff 16.5768979134
||Task ('LowSloppyPhrase', None)||P50 Base 16.068966||P50 Cmp 23.903506||Pct Diff 48.7557195653||P90 Base 27.503773||P90 Cmp 28.185346||Pct Diff 2.47810727641||P99 Base 78.495565||P99 Cmp 74.165379||Pct Diff -5.51647217266||P999 Base 78.495565||P999 Cmp 74.165379||Pct Diff -5.51647217266||P100 Base 165.743513||P100 Cmp 147.789383||Pct Diff -10.8324782521
||Task ('OrHighNotHigh', None)||P50 Base 1.792538||P50 Cmp 1.730853||Pct Diff -3.44121017239||P90 Base 3.104754||P90 Cmp 3.381543||Pct Diff 8.91500582655||P99 Base 4.165463||P99 Cmp 4.643803||Pct Diff 11.4834773469||P999 Base 4.165463||P999 Cmp 4.643803||Pct Diff 11.4834773469||P100 Base 15.152508||P100 Cmp 9.579632||Pct Diff -36.7785715738
||Task ('OrNotHighLow', None)||P50 Base 1.160372||P50 Cmp 1.114178||Pct Diff -3.98096472511||P90 Base 1.801446||P90 Cmp 3.084059||Pct Diff 71.1990811826||P99 Base 2.989668||P99 Cmp 4.133801||Pct Diff 38.2695670556||P999 Base 2.989668||P999 Cmp 4.133801||Pct Diff 38.2695670556||P100 Base 3.093394||P100 Cmp 4.164026||Pct Diff 34.6102694969
||Task ('MedSpanNear', None)||P50 Base 8.724508||P50 Cmp 8.080806||Pct Diff -7.37808940057||P90 Base 10.738555||P90 Cmp 11.838928||Pct Diff 10.2469373207||P99 Base 11.839634||P99 Cmp 11.877499||Pct Diff 0.319815629436||P999 Base 11.839634||P999 Cmp 11.877499||Pct Diff 0.319815629436||P100 Base 13.716213||P100 Cmp 13.18645||Pct Diff -3.86231243274
||Task ('BrowseDateTaxoFacets', None)||P50 Base 430.276711||P50 Cmp 430.987007||Pct Diff 0.165078885713||P90 Base 442.194432||P90 Cmp 444.873405||Pct Diff 0.605835986646||P99 Base 442.41214||P99 Cmp 445.821879||Pct Diff 0.770715514271||P999 Base 442.41214||P999 Cmp 445.821879||Pct Diff 0.770715514271||P100 Base 590.230808||P100 Cmp 590.194338||Pct Diff -0.00617893873137
||Task ('HighPhrase', None)||P50 Base 4.271622||P50 Cmp 4.21819||Pct Diff -1.25085974368||P90 Base 9.471189||P90 Cmp 11.417595||Pct Diff 20.5508094074||P99 Base 10.740288||P99 Cmp 13.262844||Pct Diff 23.4868562184||P999 Base 10.740288||P999 Cmp 13.262844||Pct Diff 23.4868562184||P100 Base 23.206907||P100 Cmp 24.453822||Pct Diff 5.3730339851
||Task ('OrHighLow', None)||P50 Base 2.326153||P50 Cmp 2.207999||Pct Diff -5.07937354078||P90 Base 3.094189||P90 Cmp 11.225136||Pct Diff 262.781200502||P99 Base 3.38087||P99 Cmp 44.557558||Pct Diff 1217.9317158||P999 Base 3.38087||P999 Cmp 44.557558||Pct Diff 1217.9317158||P100 Base 172.686179||P100 Cmp 49.437576||Pct Diff -71.3714344215
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.165003||P50 Cmp 0.149281||Pct Diff -9.52831160646||P90 Base 0.206381||P90 Cmp 0.230397||Pct Diff 11.6367301254||P99 Base 0.214318||P99 Cmp 0.254078||Pct Diff 18.551871518||P999 Base 0.214318||P999 Cmp 0.254078||Pct Diff 18.551871518||P100 Base 0.335207||P100 Cmp 0.325534||Pct Diff -2.885679595
||Task ('OrHighMed', None)||P50 Base 3.226087||P50 Cmp 2.987553||Pct Diff -7.39391095156||P90 Base 12.690066||P90 Cmp 4.989538||Pct Diff -60.6815441307||P99 Base 49.800044||P99 Cmp 5.710046||Pct Diff -88.5340543073||P999 Base 49.800044||P999 Cmp 5.710046||Pct Diff -88.5340543073||P100 Base 163.385251||P100 Cmp 166.700754||Pct Diff 2.02925477037
||Task ('IntNRQ', None)||P50 Base 3.922804||P50 Cmp 3.950769||Pct Diff 0.71288292762||P90 Base 12.035084||P90 Cmp 16.065146||Pct Diff 33.4859482493||P99 Base 70.266683||P99 Cmp 93.067458||Pct Diff 32.4489132353||P999 Base 70.266683||P999 Cmp 93.067458||Pct Diff 32.4489132353||P100 Base 96.041843||P100 Cmp 100.570396||Pct Diff 4.71518752509
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.16522||P50 Cmp 0.170595||Pct Diff 3.25323810677||P90 Base 0.232477||P90 Cmp 0.276964||Pct Diff 19.1360865806||P99 Base 0.23408||P99 Cmp 0.283452||Pct Diff 21.0919343814||P999 Base 0.23408||P999 Cmp 0.283452||Pct Diff 21.0919343814||P100 Base 32.184278||P100 Cmp 32.176487||Pct Diff -0.0242074717351
||Task ('AndHighMed', None)||P50 Base 3.212288||P50 Cmp 3.468678||Pct Diff 7.98153839257||P90 Base 102.247434||P90 Cmp 102.687266||Pct Diff 0.430164340359||P99 Base 166.78388||P99 Cmp 158.948353||Pct Diff -4.69801218199||P999 Base 166.78388||P999 Cmp 158.948353||Pct Diff -4.69801218199||P100 Base 297.622673||P100 Cmp 296.449863||Pct Diff -0.394059359853
||Task ('OrHighNotMed', None)||P50 Base 1.833203||P50 Cmp 1.655299||Pct Diff -9.70454445034||P90 Base 2.894455||P90 Cmp 3.128537||Pct Diff 8.08725649561||P99 Base 7.697203||P99 Cmp 3.877999||Pct Diff -49.6180755529||P999 Base 7.697203||P999 Cmp 3.877999||Pct Diff -49.6180755529||P100 Base 33.343297||P100 Cmp 34.050153||Pct Diff 2.11993433043
||Task ('Prefix3', None)||P50 Base 13.827844||P50 Cmp 13.953675||Pct Diff 0.909982785458||P90 Base 19.383458||P90 Cmp 20.063012||Pct Diff 3.50584503549||P99 Base 33.963586||P99 Cmp 28.855405||Pct Diff -15.0401697865||P999 Base 33.963586||P999 Cmp 28.855405||Pct Diff -15.0401697865||P100 Base 228.338299||P100 Cmp 205.255541||Pct Diff -10.109017235
||Task PKLookup||P50 Base 10.616489||P50 Cmp 10.30713||Pct Diff -2.91394829308||P90 Base 45.408862||P90 Cmp 70.989695||Pct Diff 56.334450751||P99 Base 86.121046||P99 Cmp 115.339388||Pct Diff 33.9270635426||P999 Base 86.121046||P999 Cmp 115.339388||Pct Diff 33.9270635426||P100 Base 226.285505||P100 Cmp 299.536086||Pct Diff 32.3708675021
||Task ('HighTerm', None)||P50 Base 1.249488||P50 Cmp 1.235651||Pct Diff -1.10741359661||P90 Base 2.558078||P90 Cmp 2.236707||Pct Diff -12.5629867424||P99 Base 3.472763||P99 Cmp 2.466619||Pct Diff -28.9724349171||P999 Base 3.472763||P999 Cmp 2.466619||Pct Diff -28.9724349171||P100 Base 5.305677||P100 Cmp 3.570945||Pct Diff -32.6957709638
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
BrowseDayOfYearTaxoFacets 6138.16 (3.0%) 5791.73 (5.3%) -5.6% ( -13% - 2%)
HighTermDayOfYearSort 291.41 (10.2%) 280.78 (10.6%) -3.6% ( -22% - 19%)
LowPhrase 195.72 (4.8%) 189.05 (7.4%) -3.4% ( -14% - 9%)
BrowseMonthTaxoFacets 6126.76 (5.8%) 5919.44 (3.5%) -3.4% ( -11% - 6%)
HighTerm 881.91 (4.6%) 852.08 (3.2%) -3.4% ( -10% - 4%)
HighTermMonthSort 336.86 (11.0%) 326.75 (19.6%) -3.0% ( -30% - 30%)
OrHighHigh 58.80 (4.3%) 57.21 (6.2%) -2.7% ( -12% - 8%)
Prefix3 71.55 (4.0%) 70.03 (4.4%) -2.1% ( -10% - 6%)
Fuzzy1 59.13 (7.8%) 57.89 (10.5%) -2.1% ( -18% - 17%)
OrHighNotMed 586.81 (4.1%) 575.25 (6.8%) -2.0% ( -12% - 9%)
Wildcard 526.73 (8.2%) 516.59 (7.8%) -1.9% ( -16% - 15%)
MedTerm 986.00 (5.5%) 967.61 (3.5%) -1.9% ( -10% - 7%)
Fuzzy2 37.87 (14.0%) 37.18 (13.1%) -1.8% ( -25% - 29%)
PKLookup 94.09 (2.7%) 92.68 (3.8%) -1.5% ( -7% - 5%)
AndHighHigh 198.63 (3.7%) 195.90 (3.1%) -1.4% ( -7% - 5%)
OrNotHighHigh 543.89 (4.7%) 537.46 (5.7%) -1.2% ( -11% - 9%)
IntNRQ 256.21 (2.1%) 253.35 (5.1%) -1.1% ( -8% - 6%)
OrHighLow 446.30 (4.8%) 441.63 (5.2%) -1.0% ( -10% - 9%)
OrHighNotHigh 581.54 (5.9%) 576.55 (5.7%) -0.9% ( -11% - 11%)
MedPhrase 152.58 (3.4%) 151.34 (3.1%) -0.8% ( -7% - 5%)
OrNotHighMed 686.87 (4.7%) 681.63 (5.5%) -0.8% ( -10% - 9%)
LowSloppyPhrase 62.72 (6.5%) 62.34 (6.1%) -0.6% ( -12% - 12%)
Respell 62.83 (2.8%) 62.47 (4.3%) -0.6% ( -7% - 6%)
OrHighNotLow 656.99 (6.7%) 655.02 (6.1%) -0.3% ( -12% - 13%)
BrowseDateTaxoFacets 2.32 (0.9%) 2.32 (1.0%) -0.0% ( -1% - 1%)
HighPhrase 239.48 (3.8%) 239.69 (3.8%) 0.1% ( -7% - 8%)
HighSloppyPhrase 108.10 (6.0%) 108.26 (5.8%) 0.1% ( -10% - 12%)
HighIntervalsOrdered 55.64 (4.1%) 55.94 (1.9%) 0.5% ( -5% - 6%)
LowTerm 1145.08 (2.8%) 1151.32 (5.6%) 0.5% ( -7% - 9%)
OrHighMed 307.75 (6.8%) 309.49 (6.6%) 0.6% ( -12% - 15%)
OrNotHighLow 825.45 (5.2%) 832.71 (6.1%) 0.9% ( -9% - 12%)
AndHighLow 767.58 (3.0%) 775.57 (5.3%) 1.0% ( -6% - 9%)
MedSpanNear 120.39 (3.1%) 122.01 (2.2%) 1.3% ( -3% - 6%)
LowSpanNear 42.70 (5.4%) 43.35 (2.4%) 1.5% ( -5% - 9%)
AndHighMed 300.79 (7.1%) 306.37 (7.6%) 1.9% ( -12% - 17%)
BrowseDayOfYearSSDVFacets 10.67 (19.7%) 10.95 (18.5%) 2.6% ( -29% - 50%)
BrowseMonthSSDVFacets 13.11 (21.4%) 13.46 (21.5%) 2.6% ( -33% - 57%)
HighSpanNear 53.30 (7.5%) 54.77 (2.6%) 2.7% ( -6% - 13%)
MedSloppyPhrase 121.36 (7.8%) 126.12 (2.7%) 3.9% ( -6% - 15%)
iter 15
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.15 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -6079174 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.15 -topN 10 -pk
21.8 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.15 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -6079174 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.15 -topN 10 -pk
22.1 s
Report after iter 15:
||Task ('Wildcard', None)||P50 Base 1.880923||P50 Cmp 1.770217||Pct Diff -5.88572737959||P90 Base 9.80818||P90 Cmp 9.930767||Pct Diff 1.24984451754||P99 Base 14.151967||P99 Cmp 16.474153||Pct Diff 16.4089274657||P999 Base 14.151967||P999 Cmp 16.474153||Pct Diff 16.4089274657||P100 Base 314.766134||P100 Cmp 179.877138||Pct Diff -42.8537194538
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 4.266227||P50 Cmp 3.493275||Pct Diff -18.117929496||P90 Base 9.176884||P90 Cmp 7.378861||Pct Diff -19.5929576968||P99 Base 98.444775||P99 Cmp 129.226323||Pct Diff 31.2678331582||P999 Base 98.444775||P999 Cmp 129.226323||Pct Diff 31.2678331582||P100 Base 142.97011||P100 Cmp 132.63216||Pct Diff -7.23084706307
||Task ('MedSloppyPhrase', None)||P50 Base 7.523641||P50 Cmp 7.912366||Pct Diff 5.16671382912||P90 Base 12.264132||P90 Cmp 11.909042||Pct Diff -2.89535370298||P99 Base 14.795098||P99 Cmp 12.910768||Pct Diff -12.7361778881||P999 Base 14.795098||P999 Cmp 12.910768||Pct Diff -12.7361778881||P100 Base 389.634989||P100 Cmp 133.091241||Pct Diff -65.8420714881
||Task ('OrHighHigh', None)||P50 Base 17.064606||P50 Cmp 19.156745||Pct Diff 12.2601072653||P90 Base 21.836934||P90 Cmp 30.382126||Pct Diff 39.1318305033||P99 Base 30.693452||P99 Cmp 32.501089||Pct Diff 5.88932453736||P999 Base 30.693452||P999 Cmp 32.501089||Pct Diff 5.88932453736||P100 Base 134.185466||P100 Cmp 83.186847||Pct Diff -38.0060676616
||Task ('MedPhrase', None)||P50 Base 6.484697||P50 Cmp 6.387318||Pct Diff -1.50167386387||P90 Base 9.127559||P90 Cmp 32.758352||Pct Diff 258.894990435||P99 Base 36.272587||P99 Cmp 44.113298||Pct Diff 21.6160788311||P999 Base 36.272587||P999 Cmp 44.113298||Pct Diff 21.6160788311||P100 Base 43.44735||P100 Cmp 65.954311||Pct Diff 51.8028395288
||Task ('LowSpanNear', None)||P50 Base 23.313012||P50 Cmp 23.614376||Pct Diff 1.29268581855||P90 Base 29.776449||P90 Cmp 31.884496||Pct Diff 7.0795782264||P99 Base 30.291263||P99 Cmp 37.738333||Pct Diff 24.5848778243||P999 Base 30.291263||P999 Cmp 37.738333||Pct Diff 24.5848778243||P100 Base 32.601519||P100 Cmp 42.05426||Pct Diff 28.994787022
||Task ('Fuzzy2', None)||P50 Base 25.571929||P50 Cmp 25.043607||Pct Diff -2.06602325542||P90 Base 152.998071||P90 Cmp 136.915456||Pct Diff -10.5116456011||P99 Base 166.575071||P99 Cmp 147.895261||Pct Diff -11.2140489497||P999 Base 166.575071||P999 Cmp 147.895261||Pct Diff -11.2140489497||P100 Base 206.938794||P100 Cmp 173.076454||Pct Diff -16.3634567233
||Task ('OrNotHighHigh', None)||P50 Base 1.82736||P50 Cmp 1.788322||Pct Diff -2.13630592768||P90 Base 2.593914||P90 Cmp 2.476629||Pct Diff -4.52154543289||P99 Base 3.845263||P99 Cmp 4.451599||Pct Diff 15.7683882741||P999 Base 3.845263||P999 Cmp 4.451599||Pct Diff 15.7683882741||P100 Base 4.278953||P100 Cmp 14.464909||Pct Diff 238.047858904
||Task ('OrHighNotLow', None)||P50 Base 1.658744||P50 Cmp 1.577262||Pct Diff -4.91227097129||P90 Base 3.632449||P90 Cmp 4.221929||Pct Diff 16.2281700307||P99 Base 3.933183||P99 Cmp 22.013953||Pct Diff 459.69816304||P999 Base 3.933183||P999 Cmp 22.013953||Pct Diff 459.69816304||P100 Base 187.832255||P100 Cmp 91.92713||Pct Diff -51.0589222282
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 64.429979||P50 Cmp 64.921062||Pct Diff 0.762196430329||P90 Base 65.975394||P90 Cmp 73.269887||Pct Diff 11.0563841422||P99 Base 182.924245||P99 Cmp 149.169608||Pct Diff -18.4527955821||P999 Base 182.924245||P999 Cmp 149.169608||Pct Diff -18.4527955821||P100 Base 224.088593||P100 Cmp 253.590702||Pct Diff 13.1653774095
||Task ('Fuzzy1', None)||P50 Base 20.084755||P50 Cmp 22.429024||Pct Diff 11.67188248||P90 Base 55.268257||P90 Cmp 52.569591||Pct Diff -4.88284984272||P99 Base 170.11687||P99 Cmp 171.765958||Pct Diff 0.969385340795||P999 Base 170.11687||P999 Cmp 171.765958||Pct Diff 0.969385340795||P100 Base 177.242839||P100 Cmp 315.471455||Pct Diff 77.9882655795
||Task ('HighSloppyPhrase', None)||P50 Base 9.539726||P50 Cmp 10.304148||Pct Diff 8.01303936822||P90 Base 13.717764||P90 Cmp 16.158418||Pct Diff 17.7919229402||P99 Base 15.727265||P99 Cmp 16.978727||Pct Diff 7.95727674201||P999 Base 15.727265||P999 Cmp 16.978727||Pct Diff 7.95727674201||P100 Base 20.472483||P100 Cmp 21.271766||Pct Diff 3.90418201837
||Task ('OrNotHighMed', None)||P50 Base 1.510955||P50 Cmp 1.574734||Pct Diff 4.22110519506||P90 Base 7.228878||P90 Cmp 2.834262||Pct Diff -60.7925047289||P99 Base 14.838131||P99 Cmp 5.961419||Pct Diff -59.8236529924||P999 Base 14.838131||P999 Cmp 5.961419||Pct Diff -59.8236529924||P100 Base 28.775975||P100 Cmp 15.030049||Pct Diff -47.7687584869
||Task ('LowPhrase', None)||P50 Base 4.916025||P50 Cmp 5.102623||Pct Diff 3.7957089315||P90 Base 7.451824||P90 Cmp 6.795343||Pct Diff -8.80966861268||P99 Base 7.532161||P99 Cmp 7.549428||Pct Diff 0.229243639375||P999 Base 7.532161||P999 Cmp 7.549428||Pct Diff 0.229243639375||P100 Base 25.421624||P100 Cmp 27.345681||Pct Diff 7.56858413137
||Task ('AndHighLow', None)||P50 Base 1.322601||P50 Cmp 1.34878||Pct Diff 1.97935734209||P90 Base 2.404892||P90 Cmp 2.497955||Pct Diff 3.8697371857||P99 Base 9.224323||P99 Cmp 9.809529||Pct Diff 6.34416205937||P999 Base 9.224323||P999 Cmp 9.809529||Pct Diff 6.34416205937||P100 Base 24.558465||P100 Cmp 29.934457||Pct Diff 21.8905864027
||Task ('LowTerm', None)||P50 Base 0.883438||P50 Cmp 0.876374||Pct Diff -0.799603367752||P90 Base 2.756139||P90 Cmp 1.402962||Pct Diff -49.0968343759||P99 Base 4.308192||P99 Cmp 6.050827||Pct Diff 40.4493346629||P999 Base 4.308192||P999 Cmp 6.050827||Pct Diff 40.4493346629||P100 Base 45.745209||P100 Cmp 40.508328||Pct Diff -11.4479332688
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 82.435567||P50 Cmp 82.526022||Pct Diff 0.109728122571||P90 Base 95.080602||P90 Cmp 101.460362||Pct Diff 6.709843928||P99 Base 102.424692||P99 Cmp 138.974786||Pct Diff 35.6848463845||P999 Base 102.424692||P999 Cmp 138.974786||Pct Diff 35.6848463845||P100 Base 227.713546||P100 Cmp 264.120476||Pct Diff 15.9880387616
||Task ('AndHighHigh', None)||P50 Base 5.423305||P50 Cmp 5.470437||Pct Diff 0.869064159217||P90 Base 37.096515||P90 Cmp 26.3328||Pct Diff -29.0154344687||P99 Base 40.296307||P99 Cmp 37.018282||Pct Diff -8.13480252669||P999 Base 40.296307||P999 Cmp 37.018282||Pct Diff -8.13480252669||P100 Base 292.236201||P100 Cmp 297.951916||Pct Diff 1.95585453836
||Task ('HighTermMonthSort', 'Month')||P50 Base 2.98745||P50 Cmp 2.519286||Pct Diff -15.6710237828||P90 Base 5.188648||P90 Cmp 3.661336||Pct Diff -29.4356448925||P99 Base 7.542608||P99 Cmp 3.721442||Pct Diff -50.6610710778||P999 Base 7.542608||P999 Cmp 3.721442||Pct Diff -50.6610710778||P100 Base 10.122696||P100 Cmp 25.168489||Pct Diff 148.63424724
||Task Respell||P50 Base 15.837757||P50 Cmp 15.253708||Pct Diff -3.68770022169||P90 Base 113.406285||P90 Cmp 132.352933||Pct Diff 16.7068765192||P99 Base 255.453517||P99 Cmp 248.51979||Pct Diff -2.71428128351||P999 Base 255.453517||P999 Cmp 248.51979||Pct Diff -2.71428128351||P100 Base 316.715252||P100 Cmp 450.617461||Pct Diff 42.2784214383
||Task ('MedTerm', None)||P50 Base 1.099184||P50 Cmp 1.093535||Pct Diff -0.513926694712||P90 Base 21.345629||P90 Cmp 21.321236||Pct Diff -0.11427632327||P99 Base 62.47713||P99 Cmp 48.050541||Pct Diff -23.0909918557||P999 Base 62.47713||P999 Cmp 48.050541||Pct Diff -23.0909918557||P100 Base 68.108619||P100 Cmp 69.83208||Pct Diff 2.53045947092
||Task ('HighIntervalsOrdered', None)||P50 Base 17.428338||P50 Cmp 17.53764||Pct Diff 0.627151022662||P90 Base 28.348279||P90 Cmp 28.339492||Pct Diff -0.0309965906572||P99 Base 29.139116||P99 Cmp 29.569057||Pct Diff 1.47547715586||P999 Base 29.139116||P999 Cmp 29.569057||Pct Diff 1.47547715586||P100 Base 116.344524||P100 Cmp 83.754527||Pct Diff -28.0116294945
||Task ('HighSpanNear', None)||P50 Base 18.620916||P50 Cmp 18.3753||Pct Diff -1.31903285531||P90 Base 25.088022||P90 Cmp 28.940423||Pct Diff 15.3555389899||P99 Base 30.324882||P99 Cmp 30.506416||Pct Diff 0.598630523937||P999 Base 30.324882||P999 Cmp 30.506416||Pct Diff 0.598630523937||P100 Base 191.803377||P100 Cmp 193.271148||Pct Diff 0.765247735967
||Task ('LowSloppyPhrase', None)||P50 Base 15.688237||P50 Cmp 16.607559||Pct Diff 5.85994461965||P90 Base 25.264961||P90 Cmp 25.026892||Pct Diff -0.942289204404||P99 Base 25.387748||P99 Cmp 26.502426||Pct Diff 4.39061392921||P999 Base 25.387748||P999 Cmp 26.502426||Pct Diff 4.39061392921||P100 Base 44.921033||P100 Cmp 27.59134||Pct Diff -38.5781266428
||Task ('OrHighNotHigh', None)||P50 Base 1.7902||P50 Cmp 1.807728||Pct Diff 0.979108479499||P90 Base 6.556339||P90 Cmp 4.630038||Pct Diff -29.3807412948||P99 Base 6.998219||P99 Cmp 6.300779||Pct Diff -9.96596419746||P999 Base 6.998219||P999 Cmp 6.300779||Pct Diff -9.96596419746||P100 Base 11.95421||P100 Cmp 11.234689||Pct Diff -6.0189757416
||Task ('OrNotHighLow', None)||P50 Base 1.19029||P50 Cmp 1.281849||Pct Diff 7.69215905368||P90 Base 9.840069||P90 Cmp 7.961482||Pct Diff -19.0911974296||P99 Base 49.310066||P99 Cmp 50.853095||Pct Diff 3.12923734476||P999 Base 49.310066||P999 Cmp 50.853095||Pct Diff 3.12923734476||P100 Base 105.825676||P100 Cmp 104.549548||Pct Diff -1.20587748478
||Task ('MedSpanNear', None)||P50 Base 8.542246||P50 Cmp 8.253336||Pct Diff -3.3821315846||P90 Base 11.917465||P90 Cmp 12.482526||Pct Diff 4.74145298518||P99 Base 16.269498||P99 Cmp 16.931095||Pct Diff 4.06648687009||P999 Base 16.269498||P999 Cmp 16.931095||Pct Diff 4.06648687009||P100 Base 19.790277||P100 Cmp 17.080268||Pct Diff -13.6936385479
||Task ('BrowseDateTaxoFacets', None)||P50 Base 432.088795||P50 Cmp 439.065651||Pct Diff 1.61468107499||P90 Base 451.961561||P90 Cmp 452.403576||Pct Diff 0.0977992462505||P99 Base 463.19048||P99 Cmp 465.545753||Pct Diff 0.508489077755||P999 Base 463.19048||P999 Cmp 465.545753||Pct Diff 0.508489077755||P100 Base 534.930733||P100 Cmp 537.232882||Pct Diff 0.430363943961
||Task ('HighPhrase', None)||P50 Base 3.982498||P50 Cmp 3.964565||Pct Diff -0.450295266941||P90 Base 5.307198||P90 Cmp 4.688413||Pct Diff -11.6593539566||P99 Base 37.103616||P99 Cmp 36.777588||Pct Diff -0.878696027902||P999 Base 37.103616||P999 Cmp 36.777588||Pct Diff -0.878696027902||P100 Base 1226.686183||P100 Cmp 879.543282||Pct Diff -28.2992427738
||Task ('OrHighLow', None)||P50 Base 2.17998||P50 Cmp 2.363568||Pct Diff 8.42154515179||P90 Base 3.468689||P90 Cmp 3.482541||Pct Diff 0.399343959634||P99 Base 10.45428||P99 Cmp 6.36134||Pct Diff -39.1508549608||P999 Base 10.45428||P999 Cmp 6.36134||Pct Diff -39.1508549608||P100 Base 15.15939||P100 Cmp 22.009739||Pct Diff 45.1888169643
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.163592||P50 Cmp 0.165416||Pct Diff 1.11496894714||P90 Base 0.198775||P90 Cmp 0.206869||Pct Diff 4.0719406364||P99 Base 0.246398||P99 Cmp 0.54187||Pct Diff 119.916557764||P999 Base 0.246398||P999 Cmp 0.54187||Pct Diff 119.916557764||P100 Base 14.985336||P100 Cmp 14.378519||Pct Diff -4.04940536535
||Task ('OrHighMed', None)||P50 Base 3.137713||P50 Cmp 3.246102||Pct Diff 3.45439496856||P90 Base 23.960515||P90 Cmp 22.915193||Pct Diff -4.36268586047||P99 Base 51.340133||P99 Cmp 48.233263||Pct Diff -6.05154256223||P999 Base 51.340133||P999 Cmp 48.233263||Pct Diff -6.05154256223||P100 Base 1230.702756||P100 Cmp 851.210081||Pct Diff -30.8354452893
||Task ('IntNRQ', None)||P50 Base 4.245989||P50 Cmp 4.040366||Pct Diff -4.84275866||P90 Base 32.333157||P90 Cmp 31.800151||Pct Diff -1.64848115512||P99 Base 91.862035||P99 Cmp 108.836105||Pct Diff 18.477785736||P999 Base 91.862035||P999 Cmp 108.836105||Pct Diff 18.477785736||P100 Base 105.986882||P100 Cmp 120.414254||Pct Diff 13.6124129022
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.168375||P50 Cmp 0.176602||Pct Diff 4.8861172977||P90 Base 0.200476||P90 Cmp 0.222266||Pct Diff 10.8691314671||P99 Base 0.209166||P99 Cmp 0.225531||Pct Diff 7.8239293193||P999 Base 0.209166||P999 Cmp 0.225531||Pct Diff 7.8239293193||P100 Base 8.284161||P100 Cmp 8.334407||Pct Diff 0.606530945017
||Task ('AndHighMed', None)||P50 Base 3.311509||P50 Cmp 3.307377||Pct Diff -0.124776952139||P90 Base 7.338503||P90 Cmp 5.829661||Pct Diff -20.5606238766||P99 Base 7.806364||P99 Cmp 6.940223||Pct Diff -11.0953191524||P999 Base 7.806364||P999 Cmp 6.940223||Pct Diff -11.0953191524||P100 Base 79.024896||P100 Cmp 75.462001||Pct Diff -4.50857284266
||Task ('OrHighNotMed', None)||P50 Base 1.91351||P50 Cmp 1.931509||Pct Diff 0.940627433355||P90 Base 25.807215||P90 Cmp 25.208972||Pct Diff -2.31812305202||P99 Base 57.360213||P99 Cmp 55.611299||Pct Diff -3.04900192752||P999 Base 57.360213||P999 Cmp 55.611299||Pct Diff -3.04900192752||P100 Base 102.77787||P100 Cmp 96.888629||Pct Diff -5.73006718275
||Task ('Prefix3', None)||P50 Base 14.040569||P50 Cmp 14.473373||Pct Diff 3.08252464697||P90 Base 23.873001||P90 Cmp 24.206406||Pct Diff 1.39657766529||P99 Base 98.233698||P99 Cmp 95.195554||Pct Diff -3.09277168818||P999 Base 98.233698||P999 Cmp 95.195554||Pct Diff -3.09277168818||P100 Base 110.184038||P100 Cmp 98.988051||Pct Diff -10.1611696242
||Task PKLookup||P50 Base 10.601929||P50 Cmp 11.04425||Pct Diff 4.17208038273||P90 Base 42.915291||P90 Cmp 63.869636||Pct Diff 48.8272233783||P99 Base 244.288211||P99 Cmp 189.943771||Pct Diff -22.2460346234||P999 Base 244.288211||P999 Cmp 189.943771||Pct Diff -22.2460346234||P100 Base 375.021648||P100 Cmp 309.837601||Pct Diff -17.3814091393
||Task ('HighTerm', None)||P50 Base 1.18676||P50 Cmp 1.184481||Pct Diff -0.192035457885||P90 Base 4.963455||P90 Cmp 1.27264||Pct Diff -74.3597957471||P99 Base 6.520851||P99 Cmp 1.572509||Pct Diff -75.8849113406||P999 Base 6.520851||P999 Cmp 1.572509||Pct Diff -75.8849113406||P100 Base 30.066929||P100 Cmp 48.339944||Pct Diff 60.7744641962
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
BrowseDayOfYearTaxoFacets 6140.59 (2.9%) 5807.98 (5.3%) -5.4% ( -13% - 2%)
LowPhrase 196.32 (4.8%) 189.68 (7.3%) -3.4% ( -14% - 9%)
HighTerm 881.21 (4.5%) 851.87 (3.1%) -3.3% ( -10% - 4%)
BrowseMonthTaxoFacets 6102.50 (5.9%) 5900.68 (3.6%) -3.3% ( -12% - 6%)
OrHighHigh 58.79 (4.1%) 57.02 (6.1%) -3.0% ( -12% - 7%)
HighTermDayOfYearSort 289.35 (10.4%) 282.22 (10.5%) -2.5% ( -21% - 20%)
Prefix3 71.56 (3.9%) 69.98 (4.3%) -2.2% ( -9% - 6%)
Fuzzy1 59.16 (7.6%) 58.03 (10.2%) -1.9% ( -18% - 17%)
OrHighNotMed 584.72 (4.2%) 573.91 (6.6%) -1.8% ( -12% - 9%)
MedTerm 984.04 (5.4%) 965.96 (3.4%) -1.8% ( -10% - 7%)
Fuzzy2 38.10 (13.7%) 37.41 (12.8%) -1.8% ( -24% - 28%)
Wildcard 528.66 (8.0%) 519.91 (7.9%) -1.7% ( -16% - 15%)
PKLookup 94.13 (2.6%) 92.62 (3.7%) -1.6% ( -7% - 4%)
HighTermMonthSort 336.80 (10.6%) 331.70 (19.8%) -1.5% ( -28% - 32%)
OrHighLow 447.22 (4.7%) 441.05 (5.0%) -1.4% ( -10% - 8%)
AndHighHigh 197.86 (3.9%) 195.18 (3.4%) -1.4% ( -8% - 6%)
IntNRQ 256.14 (2.0%) 253.21 (5.0%) -1.1% ( -7% - 5%)
OrNotHighHigh 545.49 (4.7%) 539.32 (5.7%) -1.1% ( -10% - 9%)
OrNotHighMed 686.03 (4.5%) 679.36 (5.5%) -1.0% ( -10% - 9%)
OrHighNotHigh 581.32 (5.7%) 575.89 (5.6%) -0.9% ( -11% - 10%)
LowSloppyPhrase 62.79 (6.3%) 62.21 (6.0%) -0.9% ( -12% - 12%)
MedPhrase 152.82 (3.3%) 151.72 (3.1%) -0.7% ( -6% - 5%)
HighSloppyPhrase 107.99 (5.8%) 107.40 (6.4%) -0.5% ( -12% - 12%)
OrHighNotLow 657.11 (6.5%) 653.91 (5.9%) -0.5% ( -12% - 12%)
Respell 62.96 (2.8%) 62.68 (4.3%) -0.4% ( -7% - 6%)
BrowseDateTaxoFacets 2.32 (0.9%) 2.32 (1.0%) -0.1% ( -2% - 1%)
HighPhrase 240.33 (3.9%) 240.62 (4.0%) 0.1% ( -7% - 8%)
LowTerm 1147.07 (2.8%) 1152.18 (5.4%) 0.4% ( -7% - 8%)
HighIntervalsOrdered 55.76 (4.0%) 56.02 (1.9%) 0.5% ( -5% - 6%)
OrHighMed 308.84 (6.7%) 310.32 (6.5%) 0.5% ( -11% - 14%)
OrNotHighLow 828.80 (5.2%) 833.41 (5.9%) 0.6% ( -10% - 12%)
AndHighLow 768.44 (2.9%) 775.60 (5.1%) 0.9% ( -6% - 9%)
LowSpanNear 42.71 (5.2%) 43.30 (2.4%) 1.4% ( -5% - 9%)
MedSpanNear 120.38 (3.0%) 122.08 (2.2%) 1.4% ( -3% - 6%)
AndHighMed 301.44 (6.9%) 306.36 (7.4%) 1.6% ( -11% - 17%)
BrowseMonthSSDVFacets 13.26 (21.0%) 13.58 (20.8%) 2.4% ( -32% - 55%)
BrowseDayOfYearSSDVFacets 10.76 (19.2%) 11.02 (17.9%) 2.4% ( -29% - 48%)
HighSpanNear 53.34 (7.2%) 54.75 (2.6%) 2.6% ( -6% - 13%)
MedSloppyPhrase 122.09 (7.8%) 126.25 (2.7%) 3.4% ( -6% - 15%)
iter 16
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.16 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -1045502 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.16 -topN 10 -pk
22.0 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.16 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -1045502 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.16 -topN 10 -pk
22.0 s
Report after iter 16:
||Task ('Wildcard', None)||P50 Base 1.89396||P50 Cmp 2.316303||Pct Diff 22.2994677818||P90 Base 15.046056||P90 Cmp 23.865561||Pct Diff 58.616723213||P99 Base 23.790087||P99 Cmp 24.047222||Pct Diff 1.08084934704||P999 Base 23.790087||P999 Cmp 24.047222||Pct Diff 1.08084934704||P100 Base 118.49089||P100 Cmp 132.880261||Pct Diff 12.1438627054
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 3.911087||P50 Cmp 5.230591||Pct Diff 33.737526166||P90 Base 97.179201||P90 Cmp 125.822937||Pct Diff 29.4751713384||P99 Base 133.390284||P99 Cmp 128.31641||Pct Diff -3.80378079111||P999 Base 133.390284||P999 Cmp 128.31641||Pct Diff -3.80378079111||P100 Base 155.875424||P100 Cmp 134.713974||Pct Diff -13.5758732563
||Task ('MedSloppyPhrase', None)||P50 Base 9.211669||P50 Cmp 8.011849||Pct Diff -13.025001224||P90 Base 12.234318||P90 Cmp 11.842121||Pct Diff -3.205711998||P99 Base 12.393249||P99 Cmp 12.089764||Pct Diff -2.44879288716||P999 Base 12.393249||P999 Cmp 12.089764||Pct Diff -2.44879288716||P100 Base 13.065173||P100 Cmp 13.160833||Pct Diff 0.732175532616
||Task ('OrHighHigh', None)||P50 Base 26.643706||P50 Cmp 19.174931||Pct Diff -28.0320425394||P90 Base 30.886372||P90 Cmp 28.895747||Pct Diff -6.4449945756||P99 Base 37.642963||P99 Cmp 28.94803||Pct Diff -23.098428782||P999 Base 37.642963||P999 Cmp 28.94803||Pct Diff -23.098428782||P100 Base 56.390525||P100 Cmp 58.475132||Pct Diff 3.69673274012
||Task ('MedPhrase', None)||P50 Base 6.53852||P50 Cmp 6.916159||Pct Diff 5.77560365343||P90 Base 8.086725||P90 Cmp 8.215992||Pct Diff 1.59850866698||P99 Base 8.465366||P99 Cmp 8.490048||Pct Diff 0.291564475771||P999 Base 8.465366||P999 Cmp 8.490048||Pct Diff 0.291564475771||P100 Base 10.411119||P100 Cmp 8.833571||Pct Diff -15.1525306742
||Task ('LowSpanNear', None)||P50 Base 27.178902||P50 Cmp 23.047686||Pct Diff -15.2000842418||P90 Base 38.220326||P90 Cmp 33.475758||Pct Diff -12.4137298044||P99 Base 38.26221||P99 Cmp 35.525944||Pct Diff -7.151353777||P999 Base 38.26221||P999 Cmp 35.525944||Pct Diff -7.151353777||P100 Base 39.346014||P100 Cmp 36.77786||Pct Diff -6.52710081382
||Task ('Fuzzy2', None)||P50 Base 34.995973||P50 Cmp 31.813414||Pct Diff -9.09407205223||P90 Base 101.060994||P90 Cmp 99.94168||Pct Diff -1.10756282488||P99 Base 201.240851||P99 Cmp 209.07923||Pct Diff 3.89502377924||P999 Base 201.240851||P999 Cmp 209.07923||Pct Diff 3.89502377924||P100 Base 1015.897536||P100 Cmp 941.287505||Pct Diff -7.34424765846
||Task ('OrNotHighHigh', None)||P50 Base 1.874074||P50 Cmp 1.852589||Pct Diff -1.14643285164||P90 Base 7.56952||P90 Cmp 55.279114||Pct Diff 630.285592746||P99 Base 55.488979||P99 Cmp 58.708702||Pct Diff 5.80245493434||P999 Base 55.488979||P999 Cmp 58.708702||Pct Diff 5.80245493434||P100 Base 296.037641||P100 Cmp 373.887106||Pct Diff 26.297150841
||Task ('OrHighNotLow', None)||P50 Base 1.584535||P50 Cmp 1.499664||Pct Diff -5.35620860379||P90 Base 2.62804||P90 Cmp 2.734508||Pct Diff 4.05123209692||P99 Base 2.687616||P99 Cmp 19.16146||Pct Diff 612.953785065||P999 Base 2.687616||P999 Cmp 19.16146||Pct Diff 612.953785065||P100 Base 322.272383||P100 Cmp 172.802543||Pct Diff -46.37997169
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 93.172218||P50 Cmp 94.133079||Pct Diff 1.03127415084||P90 Base 107.625388||P90 Cmp 101.656173||Pct Diff -5.54628894811||P99 Base 127.573164||P99 Cmp 112.560719||Pct Diff -11.7677139371||P999 Base 127.573164||P999 Cmp 112.560719||Pct Diff -11.7677139371||P100 Base 146.109295||P100 Cmp 132.756336||Pct Diff -9.13902089528
||Task ('Fuzzy1', None)||P50 Base 17.342188||P50 Cmp 18.416714||Pct Diff 6.19602324689||P90 Base 52.909495||P90 Cmp 52.606364||Pct Diff -0.572923631193||P99 Base 102.383506||P99 Cmp 103.147398||Pct Diff 0.746108460087||P999 Base 102.383506||P999 Cmp 103.147398||Pct Diff 0.746108460087||P100 Base 205.626747||P100 Cmp 203.299157||Pct Diff -1.13194904552
||Task ('HighSloppyPhrase', None)||P50 Base 9.577675||P50 Cmp 9.693232||Pct Diff 1.20652454797||P90 Base 13.893186||P90 Cmp 18.480131||Pct Diff 33.015789179||P99 Base 21.71891||P99 Cmp 20.570876||Pct Diff -5.28587300191||P999 Base 21.71891||P999 Cmp 20.570876||Pct Diff -5.28587300191||P100 Base 31.451943||P100 Cmp 20.910153||Pct Diff -33.5171343786
||Task ('OrNotHighMed', None)||P50 Base 1.535112||P50 Cmp 1.4737||Pct Diff -4.00048986654||P90 Base 6.82947||P90 Cmp 3.214551||Pct Diff -52.9311791398||P99 Base 28.117166||P99 Cmp 14.830207||Pct Diff -47.255683592||P999 Base 28.117166||P999 Cmp 14.830207||Pct Diff -47.255683592||P100 Base 57.169643||P100 Cmp 70.264097||Pct Diff 22.9045579312
||Task ('LowPhrase', None)||P50 Base 5.19007||P50 Cmp 5.699013||Pct Diff 9.80609124732||P90 Base 7.593824||P90 Cmp 8.80994||Pct Diff 16.0145402369||P99 Base 11.016092||P99 Cmp 12.188458||Pct Diff 10.642304004||P999 Base 11.016092||P999 Cmp 12.188458||Pct Diff 10.642304004||P100 Base 13.169677||P100 Cmp 13.322105||Pct Diff 1.15741638918
||Task ('AndHighLow', None)||P50 Base 1.295452||P50 Cmp 1.276565||Pct Diff -1.45794672439||P90 Base 3.15298||P90 Cmp 3.825466||Pct Diff 21.3285843868||P99 Base 5.189699||P99 Cmp 6.092254||Pct Diff 17.3912783766||P999 Base 5.189699||P999 Cmp 6.092254||Pct Diff 17.3912783766||P100 Base 6.738585||P100 Cmp 6.578111||Pct Diff -2.38141983814
||Task ('LowTerm', None)||P50 Base 0.861698||P50 Cmp 0.848685||Pct Diff -1.51015785113||P90 Base 1.282231||P90 Cmp 1.104713||Pct Diff -13.8444632831||P99 Base 1.50748||P99 Cmp 1.550107||Pct Diff 2.82769920662||P999 Base 1.50748||P999 Cmp 1.550107||Pct Diff 2.82769920662||P100 Base 4.726338||P100 Cmp 4.761531||Pct Diff 0.744614540898
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 124.957066||P50 Cmp 124.812682||Pct Diff -0.11554688712||P90 Base 134.654496||P90 Cmp 134.354324||Pct Diff -0.222920146684||P99 Base 138.636187||P99 Cmp 137.675984||Pct Diff -0.692606325072||P999 Base 138.636187||P999 Cmp 137.675984||Pct Diff -0.692606325072||P100 Base 278.27796||P100 Cmp 277.23223||Pct Diff -0.375786138435
||Task ('AndHighHigh', None)||P50 Base 5.585584||P50 Cmp 5.572803||Pct Diff -0.228821193988||P90 Base 9.427501||P90 Cmp 7.059312||Pct Diff -25.1200079427||P99 Base 20.563246||P99 Cmp 11.094401||Pct Diff -46.0474236412||P999 Base 20.563246||P999 Cmp 11.094401||Pct Diff -46.0474236412||P100 Base 26.767082||P100 Cmp 24.606058||Pct Diff -8.07343886046
||Task ('HighTermMonthSort', 'Month')||P50 Base 3.282749||P50 Cmp 3.393347||Pct Diff 3.36906659632||P90 Base 7.156677||P90 Cmp 7.409633||Pct Diff 3.53454543219||P99 Base 34.936846||P99 Cmp 31.973852||Pct Diff -8.48100025973||P999 Base 34.936846||P999 Cmp 31.973852||Pct Diff -8.48100025973||P100 Base 99.805296||P100 Cmp 64.270281||Pct Diff -35.6043380704
||Task Respell||P50 Base 16.960383||P50 Cmp 19.549428||Pct Diff 15.2652507906||P90 Base 102.786832||P90 Cmp 106.595474||Pct Diff 3.70537930384||P99 Base 161.501882||P99 Cmp 163.030533||Pct Diff 0.946522096876||P999 Base 161.501882||P999 Cmp 163.030533||Pct Diff 0.946522096876||P100 Base 280.08204||P100 Cmp 280.040338||Pct Diff -0.0148892088904
||Task ('MedTerm', None)||P50 Base 1.075611||P50 Cmp 1.044319||Pct Diff -2.90923019567||P90 Base 1.252672||P90 Cmp 1.482834||Pct Diff 18.3736844122||P99 Base 1.407929||P99 Cmp 1.848993||Pct Diff 31.3271478888||P999 Base 1.407929||P999 Cmp 1.848993||Pct Diff 31.3271478888||P100 Base 1.928922||P100 Cmp 12.427052||Pct Diff 544.24854919
||Task ('HighIntervalsOrdered', None)||P50 Base 17.661453||P50 Cmp 18.068309||Pct Diff 2.30363832466||P90 Base 26.554122||P90 Cmp 28.050908||Pct Diff 5.63673692544||P99 Base 29.370487||P99 Cmp 39.963053||Pct Diff 36.0653400129||P999 Base 29.370487||P999 Cmp 39.963053||Pct Diff 36.0653400129||P100 Base 69.773456||P100 Cmp 73.919709||Pct Diff 5.94245037826
||Task ('HighSpanNear', None)||P50 Base 18.695939||P50 Cmp 17.726882||Pct Diff -5.18324861886||P90 Base 30.397338||P90 Cmp 29.153057||Pct Diff -4.09338804602||P99 Base 32.463424||P99 Cmp 29.27341||Pct Diff -9.82648657147||P999 Base 32.463424||P999 Cmp 29.27341||Pct Diff -9.82648657147||P100 Base 300.579235||P100 Cmp 300.833931||Pct Diff 0.0847350616219
||Task ('LowSloppyPhrase', None)||P50 Base 16.495531||P50 Cmp 17.189613||Pct Diff 4.20769722418||P90 Base 25.182142||P90 Cmp 25.382598||Pct Diff 0.796024420798||P99 Base 25.349948||P99 Cmp 26.229993||Pct Diff 3.47158503047||P999 Base 25.349948||P999 Cmp 26.229993||Pct Diff 3.47158503047||P100 Base 78.924485||P100 Cmp 75.443063||Pct Diff -4.41107978088
||Task ('OrHighNotHigh', None)||P50 Base 1.835044||P50 Cmp 1.977553||Pct Diff 7.76597182411||P90 Base 6.841205||P90 Cmp 3.274571||Pct Diff -52.1345874009||P99 Base 27.823681||P99 Cmp 3.286331||Pct Diff -88.1887267181||P999 Base 27.823681||P999 Cmp 3.286331||Pct Diff -88.1887267181||P100 Base 46.61345||P100 Cmp 46.950121||Pct Diff 0.722261493196
||Task ('OrNotHighLow', None)||P50 Base 1.23239||P50 Cmp 1.216069||Pct Diff -1.32433726337||P90 Base 2.031138||P90 Cmp 2.561312||Pct Diff 26.1023130875||P99 Base 2.847994||P99 Cmp 5.183802||Pct Diff 82.0159031234||P999 Base 2.847994||P999 Cmp 5.183802||Pct Diff 82.0159031234||P100 Base 5.238185||P100 Cmp 15.500489||Pct Diff 195.913355485
||Task ('MedSpanNear', None)||P50 Base 8.611682||P50 Cmp 11.756045||Pct Diff 36.5127625474||P90 Base 12.152772||P90 Cmp 13.547511||Pct Diff 11.4767149421||P99 Base 12.236619||P99 Cmp 14.136144||Pct Diff 15.5232830245||P999 Base 12.236619||P999 Cmp 14.136144||Pct Diff 15.5232830245||P100 Base 15.06654||P100 Cmp 22.933588||Pct Diff 52.2153593327
||Task ('BrowseDateTaxoFacets', None)||P50 Base 429.511769||P50 Cmp 437.594029||Pct Diff 1.88173190663||P90 Base 459.485624||P90 Cmp 472.253014||Pct Diff 2.7786266497||P99 Base 469.704368||P99 Cmp 488.561625||Pct Diff 4.0147076086||P999 Base 469.704368||P999 Cmp 488.561625||Pct Diff 4.0147076086||P100 Base 543.338614||P100 Cmp 535.647629||Pct Diff -1.41550495434
||Task ('HighPhrase', None)||P50 Base 4.08843||P50 Cmp 4.22943||Pct Diff 3.44875661317||P90 Base 5.656853||P90 Cmp 5.748115||Pct Diff 1.61329983296||P99 Base 23.780761||P99 Cmp 41.404467||Pct Diff 74.109091799||P999 Base 23.780761||P999 Cmp 41.404467||Pct Diff 74.109091799||P100 Base 263.852334||P100 Cmp 211.750883||Pct Diff -19.7464430995
||Task ('OrHighLow', None)||P50 Base 2.371593||P50 Cmp 2.32599||Pct Diff -1.92288474456||P90 Base 14.29387||P90 Cmp 13.618092||Pct Diff -4.72774692928||P99 Base 30.602882||P99 Cmp 30.913161||Pct Diff 1.01388816909||P999 Base 30.602882||P999 Cmp 30.913161||Pct Diff 1.01388816909||P100 Base 72.311584||P100 Cmp 69.732448||Pct Diff -3.56669824851
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.149726||P50 Cmp 0.176504||Pct Diff 17.8846693293||P90 Base 0.200072||P90 Cmp 0.217021||Pct Diff 8.4714502779||P99 Base 0.209455||P99 Cmp 0.219451||Pct Diff 4.77238547659||P999 Base 0.209455||P999 Cmp 0.219451||Pct Diff 4.77238547659||P100 Base 14.585933||P100 Cmp 14.906647||Pct Diff 2.19878975174
||Task ('OrHighMed', None)||P50 Base 4.2743||P50 Cmp 4.350795||Pct Diff 1.78964976721||P90 Base 29.91068||P90 Cmp 10.706908||Pct Diff -64.2037292365||P99 Base 41.869195||P99 Cmp 41.145111||Pct Diff -1.72939556158||P999 Base 41.869195||P999 Cmp 41.145111||Pct Diff -1.72939556158||P100 Base 592.546017||P100 Cmp 417.150338||Pct Diff -29.6003473094
||Task ('IntNRQ', None)||P50 Base 3.791843||P50 Cmp 4.031989||Pct Diff 6.3332263493||P90 Base 68.547543||P90 Cmp 70.550471||Pct Diff 2.92195447472||P99 Base 100.250467||P99 Cmp 84.968312||Pct Diff -15.243973876||P999 Base 100.250467||P999 Cmp 84.968312||Pct Diff -15.243973876||P100 Base 215.206145||P100 Cmp 104.745392||Pct Diff -51.3278805305
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.153645||P50 Cmp 0.170625||Pct Diff 11.0514497706||P90 Base 0.200329||P90 Cmp 0.232613||Pct Diff 16.1154900189||P99 Base 0.222326||P99 Cmp 0.244013||Pct Diff 9.75459460432||P999 Base 0.222326||P999 Cmp 0.244013||Pct Diff 9.75459460432||P100 Base 12.683583||P100 Cmp 13.03401||Pct Diff 2.76283917565
||Task ('AndHighMed', None)||P50 Base 3.440423||P50 Cmp 4.135138||Pct Diff 20.1927204881||P90 Base 5.988987||P90 Cmp 6.319843||Pct Diff 5.52440671519||P99 Base 9.436745||P99 Cmp 11.352488||Pct Diff 20.3008876472||P999 Base 9.436745||P999 Cmp 11.352488||Pct Diff 20.3008876472||P100 Base 35.265322||P100 Cmp 35.140762||Pct Diff -0.353208174308
||Task ('OrHighNotMed', None)||P50 Base 1.822665||P50 Cmp 1.643998||Pct Diff -9.80251444999||P90 Base 2.958954||P90 Cmp 4.660933||Pct Diff 57.5196167294||P99 Base 4.723892||P99 Cmp 5.028875||Pct Diff 6.45618062394||P999 Base 4.723892||P999 Cmp 5.028875||Pct Diff 6.45618062394||P100 Base 61.94553||P100 Cmp 58.591013||Pct Diff -5.41526886605
||Task ('Prefix3', None)||P50 Base 14.23883||P50 Cmp 14.356691||Pct Diff 0.827743571628||P90 Base 23.498828||P90 Cmp 23.985377||Pct Diff 2.0705245385||P99 Base 24.102483||P99 Cmp 30.655723||Pct Diff 27.1890659564||P999 Base 24.102483||P999 Cmp 30.655723||Pct Diff 27.1890659564||P100 Base 157.366237||P100 Cmp 179.554702||Pct Diff 14.0998891649
||Task PKLookup||P50 Base 10.308568||P50 Cmp 11.416709||Pct Diff 10.7497083979||P90 Base 33.725616||P90 Cmp 60.40606||Pct Diff 79.1103237373||P99 Base 63.272379||P99 Cmp 60.58075||Pct Diff -4.2540347661||P999 Base 63.272379||P999 Cmp 60.58075||Pct Diff -4.2540347661||P100 Base 388.667781||P100 Cmp 409.46978||Pct Diff 5.35212848013
||Task ('HighTerm', None)||P50 Base 1.138057||P50 Cmp 1.164726||Pct Diff 2.34337998888||P90 Base 1.600066||P90 Cmp 2.009488||Pct Diff 25.5878195024||P99 Base 2.184858||P99 Cmp 2.17785||Pct Diff -0.320753110728||P999 Base 2.184858||P999 Cmp 2.17785||Pct Diff -0.320753110728||P100 Base 10.371835||P100 Cmp 2.310154||Pct Diff -77.7266607114
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
BrowseDayOfYearTaxoFacets 6175.39 (3.6%) 5816.10 (5.1%) -5.8% ( -14% - 2%)
LowPhrase 196.32 (4.7%) 188.87 (7.2%) -3.8% ( -15% - 8%)
BrowseMonthTaxoFacets 6128.16 (5.9%) 5912.23 (3.5%) -3.5% ( -12% - 6%)
HighTerm 883.17 (4.5%) 853.19 (3.0%) -3.4% ( -10% - 4%)
HighTermDayOfYearSort 289.10 (10.1%) 280.66 (10.4%) -2.9% ( -21% - 19%)
Wildcard 529.31 (7.8%) 515.41 (8.4%) -2.6% ( -17% - 14%)
PKLookup 94.33 (2.7%) 92.34 (3.8%) -2.1% ( -8% - 4%)
Prefix3 71.51 (3.8%) 70.01 (4.2%) -2.1% ( -9% - 6%)
Fuzzy2 37.82 (13.7%) 37.09 (13.0%) -1.9% ( -25% - 28%)
Fuzzy1 59.15 (7.3%) 58.02 (9.9%) -1.9% ( -17% - 16%)
MedTerm 984.58 (5.2%) 966.68 (3.3%) -1.8% ( -9% - 7%)
OrHighHigh 57.65 (8.9%) 56.83 (6.2%) -1.4% ( -15% - 15%)
IntNRQ 256.88 (2.3%) 253.40 (4.8%) -1.4% ( -8% - 5%)
OrHighNotMed 584.38 (4.1%) 576.87 (6.7%) -1.3% ( -11% - 9%)
HighTermMonthSort 335.15 (10.6%) 330.88 (19.3%) -1.3% ( -28% - 31%)
OrHighLow 446.09 (4.7%) 441.00 (4.9%) -1.1% ( -10% - 8%)
AndHighHigh 197.15 (4.1%) 194.94 (3.3%) -1.1% ( -8% - 6%)
OrHighNotHigh 580.05 (5.6%) 574.51 (5.5%) -1.0% ( -11% - 10%)
MedPhrase 152.86 (3.2%) 151.42 (3.1%) -0.9% ( -7% - 5%)
LowSloppyPhrase 62.57 (6.4%) 61.98 (6.0%) -0.9% ( -12% - 12%)
Respell 62.99 (2.8%) 62.42 (4.5%) -0.9% ( -7% - 6%)
OrNotHighHigh 545.14 (4.6%) 540.58 (5.6%) -0.8% ( -10% - 9%)
OrNotHighMed 684.66 (4.5%) 680.89 (5.4%) -0.6% ( -9% - 9%)
HighSloppyPhrase 107.89 (5.7%) 107.44 (6.2%) -0.4% ( -11% - 12%)
BrowseDateTaxoFacets 2.32 (0.9%) 2.32 (1.0%) -0.2% ( -2% - 1%)
OrHighNotLow 655.88 (6.4%) 655.14 (5.8%) -0.1% ( -11% - 12%)
HighPhrase 240.60 (3.8%) 240.52 (3.9%) -0.0% ( -7% - 7%)
MedSpanNear 120.19 (3.0%) 120.30 (6.3%) 0.1% ( -8% - 9%)
LowTerm 1152.18 (3.2%) 1154.35 (5.3%) 0.2% ( -8% - 8%)
HighIntervalsOrdered 55.82 (3.9%) 55.99 (1.9%) 0.3% ( -5% - 6%)
OrHighMed 304.78 (8.5%) 306.50 (8.1%) 0.6% ( -14% - 18%)
OrNotHighLow 830.83 (5.2%) 835.85 (5.8%) 0.6% ( -9% - 12%)
AndHighMed 300.97 (6.8%) 303.11 (8.4%) 0.7% ( -13% - 17%)
AndHighLow 770.50 (3.0%) 776.55 (5.0%) 0.8% ( -6% - 9%)
BrowseMonthSSDVFacets 13.11 (21.1%) 13.41 (21.1%) 2.2% ( -32% - 56%)
BrowseDayOfYearSSDVFacets 10.60 (19.8%) 10.84 (18.9%) 2.3% ( -30% - 51%)
LowSpanNear 42.21 (7.0%) 43.32 (2.3%) 2.6% ( -6% - 12%)
HighSpanNear 53.40 (7.0%) 54.87 (2.6%) 2.7% ( -6% - 13%)
MedSloppyPhrase 121.48 (7.9%) 126.38 (2.6%) 4.0% ( -6% - 15%)
iter 17
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.17 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -3936769 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.17 -topN 10 -pk
21.4 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.17 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -3936769 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.17 -topN 10 -pk
21.7 s
Report after iter 17:
||Task ('Wildcard', None)||P50 Base 2.085837||P50 Cmp 1.901538||Pct Diff -8.83573356883||P90 Base 9.598272||P90 Cmp 4.339368||Pct Diff -54.7901122202||P99 Base 14.697275||P99 Cmp 12.231466||Pct Diff -16.777320966||P999 Base 14.697275||P999 Cmp 12.231466||Pct Diff -16.777320966||P100 Base 207.339973||P100 Cmp 191.580443||Pct Diff -7.60081607612
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 4.29494||P50 Cmp 3.946823||Pct Diff -8.10528202955||P90 Base 95.225992||P90 Cmp 72.619241||Pct Diff -23.7401055376||P99 Base 131.713154||P99 Cmp 131.766608||Pct Diff 0.0405836458825||P999 Base 131.713154||P999 Cmp 131.766608||Pct Diff 0.0405836458825||P100 Base 133.594856||P100 Cmp 150.079651||Pct Diff 12.3393935168
||Task ('MedSloppyPhrase', None)||P50 Base 7.845755||P50 Cmp 7.756648||Pct Diff -1.13573518419||P90 Base 11.144865||P90 Cmp 12.747269||Pct Diff 14.3779579205||P99 Base 12.012769||P99 Cmp 13.410218||Pct Diff 11.6330298202||P999 Base 12.012769||P999 Cmp 13.410218||Pct Diff 11.6330298202||P100 Base 33.225764||P100 Cmp 13.453907||Pct Diff -59.5076068078
||Task ('OrHighHigh', None)||P50 Base 17.453178||P50 Cmp 16.002749||Pct Diff -8.31040054711||P90 Base 40.230237||P90 Cmp 33.391957||Pct Diff -16.9978615836||P99 Base 104.582821||P99 Cmp 82.584899||Pct Diff -21.0339726828||P999 Base 104.582821||P999 Cmp 82.584899||Pct Diff -21.0339726828||P100 Base 120.056863||P100 Cmp 116.393585||Pct Diff -3.05128578947
||Task ('MedPhrase', None)||P50 Base 6.671835||P50 Cmp 6.686907||Pct Diff 0.225904867252||P90 Base 8.219187||P90 Cmp 8.452677||Pct Diff 2.84079191774||P99 Base 21.698919||P99 Cmp 8.830046||Pct Diff -59.3065166057||P999 Base 21.698919||P999 Cmp 8.830046||Pct Diff -59.3065166057||P100 Base 51.011175||P100 Cmp 15.157668||Pct Diff -70.2855933038
||Task ('LowSpanNear', None)||P50 Base 23.815429||P50 Cmp 24.59949||Pct Diff 3.2922396653||P90 Base 34.46206||P90 Cmp 35.267036||Pct Diff 2.33583250682||P99 Base 34.74123||P99 Cmp 43.159191||Pct Diff 24.2304633428||P999 Base 34.74123||P999 Cmp 43.159191||Pct Diff 24.2304633428||P100 Base 117.220156||P100 Cmp 112.423559||Pct Diff -4.09195582371
||Task ('Fuzzy2', None)||P50 Base 27.565364||P50 Cmp 28.163039||Pct Diff 2.16821007696||P90 Base 70.173085||P90 Cmp 77.052882||Pct Diff 9.80403954023||P99 Base 74.800441||P99 Cmp 102.393407||Pct Diff 36.8887744927||P999 Base 74.800441||P999 Cmp 102.393407||Pct Diff 36.8887744927||P100 Base 106.583856||P100 Cmp 194.254481||Pct Diff 82.2550696608
||Task ('OrNotHighHigh', None)||P50 Base 1.862089||P50 Cmp 1.782842||Pct Diff -4.25581161803||P90 Base 4.3818||P90 Cmp 4.895849||Pct Diff 11.7314573919||P99 Base 20.428273||P99 Cmp 11.586552||Pct Diff -43.2817840255||P999 Base 20.428273||P999 Cmp 11.586552||Pct Diff -43.2817840255||P100 Base 21.807091||P100 Cmp 26.441314||Pct Diff 21.2509912487
||Task ('OrHighNotLow', None)||P50 Base 1.577853||P50 Cmp 1.625509||Pct Diff 3.02030670791||P90 Base 3.420524||P90 Cmp 3.49261||Pct Diff 2.10745488118||P99 Base 64.089626||P99 Cmp 9.801466||Pct Diff -84.7066263111||P999 Base 64.089626||P999 Cmp 9.801466||Pct Diff -84.7066263111||P100 Base 296.764099||P100 Cmp 288.072722||Pct Diff -2.92871578108
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 64.737143||P50 Cmp 64.534365||Pct Diff -0.313232853047||P90 Base 66.565286||P90 Cmp 77.807662||Pct Diff 16.8892476478||P99 Base 67.495198||P99 Cmp 79.030883||Pct Diff 17.0911195786||P999 Base 67.495198||P999 Cmp 79.030883||Pct Diff 17.0911195786||P100 Base 183.769743||P100 Cmp 125.879269||Pct Diff -31.501635174
||Task ('Fuzzy1', None)||P50 Base 16.872728||P50 Cmp 16.743987||Pct Diff -0.763012359353||P90 Base 189.809349||P90 Cmp 185.982583||Pct Diff -2.01611038664||P99 Base 216.369276||P99 Cmp 230.898128||Pct Diff 6.71484060426||P999 Base 216.369276||P999 Cmp 230.898128||Pct Diff 6.71484060426||P100 Base 764.738183||P100 Cmp 895.671858||Pct Diff 17.1213727666
||Task ('HighSloppyPhrase', None)||P50 Base 8.652765||P50 Cmp 9.225523||Pct Diff 6.61936386808||P90 Base 13.575774||P90 Cmp 15.844133||Pct Diff 16.7088742049||P99 Base 13.807287||P99 Cmp 16.584919||Pct Diff 20.1171453885||P999 Base 13.807287||P999 Cmp 16.584919||Pct Diff 20.1171453885||P100 Base 180.742356||P100 Cmp 213.985707||Pct Diff 18.3926732702
||Task ('OrNotHighMed', None)||P50 Base 1.44936||P50 Cmp 1.557||Pct Diff 7.42672627919||P90 Base 2.497419||P90 Cmp 2.607552||Pct Diff 4.40987275263||P99 Base 3.001347||P99 Cmp 3.284838||Pct Diff 9.44545898891||P999 Base 3.001347||P999 Cmp 3.284838||Pct Diff 9.44545898891||P100 Base 53.031428||P100 Cmp 50.202983||Pct Diff -5.33352599896
||Task ('LowPhrase', None)||P50 Base 5.372201||P50 Cmp 5.512183||Pct Diff 2.60567316822||P90 Base 13.472665||P90 Cmp 8.533266||Pct Diff -36.6623752613||P99 Base 14.517456||P99 Cmp 10.382984||Pct Diff -28.4793148331||P999 Base 14.517456||P999 Cmp 10.382984||Pct Diff -28.4793148331||P100 Base 118.830953||P100 Cmp 126.795034||Pct Diff 6.70202569191
||Task ('AndHighLow', None)||P50 Base 1.393058||P50 Cmp 1.345202||Pct Diff -3.43531999386||P90 Base 21.786866||P90 Cmp 6.769108||Pct Diff -68.9303271062||P99 Base 22.715848||P99 Cmp 22.823829||Pct Diff 0.475355355433||P999 Base 22.715848||P999 Cmp 22.823829||Pct Diff 0.475355355433||P100 Base 99.094118||P100 Cmp 24.91217||Pct Diff -74.8600920995
||Task ('LowTerm', None)||P50 Base 0.890643||P50 Cmp 0.92916||Pct Diff 4.32462838646||P90 Base 1.571918||P90 Cmp 1.570724||Pct Diff -0.0759581606674||P99 Base 3.129306||P99 Cmp 10.427466||Pct Diff 233.219761826||P999 Base 3.129306||P999 Cmp 10.427466||Pct Diff 233.219761826||P100 Base 55.532351||P100 Cmp 54.831692||Pct Diff -1.26171319489
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 83.315868||P50 Cmp 82.673715||Pct Diff -0.770745135849||P90 Base 99.161803||P90 Cmp 91.904036||Pct Diff -7.31911560745||P99 Base 102.792511||P99 Cmp 103.27754||Pct Diff 0.471852467929||P999 Base 102.792511||P999 Cmp 103.27754||Pct Diff 0.471852467929||P100 Base 333.588651||P100 Cmp 277.024991||Pct Diff -16.9561104164
||Task ('AndHighHigh', None)||P50 Base 6.225241||P50 Cmp 5.245134||Pct Diff -15.7440812332||P90 Base 42.206809||P90 Cmp 31.66362||Pct Diff -24.9798296763||P99 Base 47.869557||P99 Cmp 43.086412||Pct Diff -9.99203940826||P999 Base 47.869557||P999 Cmp 43.086412||Pct Diff -9.99203940826||P100 Base 93.305574||P100 Cmp 99.153584||Pct Diff 6.26758911531
||Task ('HighTermMonthSort', 'Month')||P50 Base 2.842155||P50 Cmp 3.219614||Pct Diff 13.280732402||P90 Base 4.393006||P90 Cmp 8.946224||Pct Diff 103.646978857||P99 Base 8.061812||P99 Cmp 33.67353||Pct Diff 317.691829083||P999 Base 8.061812||P999 Cmp 33.67353||Pct Diff 317.691829083||P100 Base 41.829455||P100 Cmp 62.74184||Pct Diff 49.9943998792
||Task Respell||P50 Base 15.720903||P50 Cmp 16.284539||Pct Diff 3.58526479045||P90 Base 154.659626||P90 Cmp 152.684607||Pct Diff -1.27701007114||P99 Base 218.276277||P99 Cmp 242.343812||Pct Diff 11.0261799087||P999 Base 218.276277||P999 Cmp 242.343812||Pct Diff 11.0261799087||P100 Base 253.652099||P100 Cmp 266.626589||Pct Diff 5.11507298822
||Task ('MedTerm', None)||P50 Base 1.055566||P50 Cmp 1.04765||Pct Diff -0.749929421751||P90 Base 1.620773||P90 Cmp 1.647001||Pct Diff 1.61824018539||P99 Base 4.200265||P99 Cmp 4.607376||Pct Diff 9.69250749655||P999 Base 4.200265||P999 Cmp 4.607376||Pct Diff 9.69250749655||P100 Base 130.133864||P100 Cmp 108.099495||Pct Diff -16.9320792626
||Task ('HighIntervalsOrdered', None)||P50 Base 18.83122||P50 Cmp 17.914928||Pct Diff -4.86581326117||P90 Base 29.774003||P90 Cmp 28.709002||Pct Diff -3.57694932724||P99 Base 31.718688||P99 Cmp 28.997019||Pct Diff -8.58064810247||P999 Base 31.718688||P999 Cmp 28.997019||Pct Diff -8.58064810247||P100 Base 271.319707||P100 Cmp 262.592332||Pct Diff -3.21663881201
||Task ('HighSpanNear', None)||P50 Base 20.529584||P50 Cmp 17.803702||Pct Diff -13.2778238468||P90 Base 29.463473||P90 Cmp 27.643376||Pct Diff -6.17746930241||P99 Base 29.826524||P99 Cmp 40.991682||Pct Diff 37.4336546894||P999 Base 29.826524||P999 Cmp 40.991682||Pct Diff 37.4336546894||P100 Base 30.938941||P100 Cmp 60.620534||Pct Diff 95.936034139
||Task ('LowSloppyPhrase', None)||P50 Base 16.563877||P50 Cmp 16.890684||Pct Diff 1.97301030429||P90 Base 41.997177||P90 Cmp 30.296705||Pct Diff -27.860139266||P99 Base 47.985003||P99 Cmp 45.585348||Pct Diff -5.0008437011||P999 Base 47.985003||P999 Cmp 45.585348||Pct Diff -5.0008437011||P100 Base 58.779439||P100 Cmp 48.641386||Pct Diff -17.2476178277
||Task ('OrHighNotHigh', None)||P50 Base 1.694849||P50 Cmp 1.782861||Pct Diff 5.19291099089||P90 Base 10.90794||P90 Cmp 3.476251||Pct Diff -68.1310036542||P99 Base 12.464719||P99 Cmp 8.497991||Pct Diff -31.8236456032||P999 Base 12.464719||P999 Cmp 8.497991||Pct Diff -31.8236456032||P100 Base 151.246828||P100 Cmp 168.898267||Pct Diff 11.6706176476
||Task ('OrNotHighLow', None)||P50 Base 1.174309||P50 Cmp 1.265293||Pct Diff 7.74787555916||P90 Base 2.040517||P90 Cmp 3.498185||Pct Diff 71.4362095489||P99 Base 3.391765||P99 Cmp 4.204243||Pct Diff 23.9544308052||P999 Base 3.391765||P999 Cmp 4.204243||Pct Diff 23.9544308052||P100 Base 3.736508||P100 Cmp 8.649095||Pct Diff 131.475350782
||Task ('MedSpanNear', None)||P50 Base 9.650014||P50 Cmp 8.717605||Pct Diff -9.66225541227||P90 Base 12.710008||P90 Cmp 12.544687||Pct Diff -1.30071515297||P99 Base 13.275489||P99 Cmp 14.904834||Pct Diff 12.2733332083||P999 Base 13.275489||P999 Cmp 14.904834||Pct Diff 12.2733332083||P100 Base 24.352395||P100 Cmp 143.500285||Pct Diff 489.265593795
||Task ('BrowseDateTaxoFacets', None)||P50 Base 430.326128||P50 Cmp 426.943185||Pct Diff -0.786134696427||P90 Base 441.962506||P90 Cmp 441.879497||Pct Diff -0.018781909975||P99 Base 470.732614||P99 Cmp 464.733521||Pct Diff -1.27441626554||P999 Base 470.732614||P999 Cmp 464.733521||Pct Diff -1.27441626554||P100 Base 562.898865||P100 Cmp 526.348852||Pct Diff -6.4931758212
||Task ('HighPhrase', None)||P50 Base 4.598163||P50 Cmp 4.111041||Pct Diff -10.5938393224||P90 Base 7.570775||P90 Cmp 5.731503||Pct Diff -24.2943688064||P99 Base 10.681677||P99 Cmp 5.882929||Pct Diff -44.925043137||P999 Base 10.681677||P999 Cmp 5.882929||Pct Diff -44.925043137||P100 Base 47.78627||P100 Cmp 70.676881||Pct Diff 47.9020668489
||Task ('OrHighLow', None)||P50 Base 2.428244||P50 Cmp 2.298229||Pct Diff -5.35428070655||P90 Base 7.069011||P90 Cmp 4.4887||Pct Diff -36.5017256304||P99 Base 9.462791||P99 Cmp 7.1655||Pct Diff -24.2770975286||P999 Base 9.462791||P999 Cmp 7.1655||Pct Diff -24.2770975286||P100 Base 35.490128||P100 Cmp 7.700704||Pct Diff -78.3018421348
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.172709||P50 Cmp 0.171833||Pct Diff -0.50721155238||P90 Base 0.223447||P90 Cmp 0.19719||Pct Diff -11.7508849973||P99 Base 0.250723||P99 Cmp 0.200532||Pct Diff -20.0185064793||P999 Base 0.250723||P999 Cmp 0.200532||Pct Diff -20.0185064793||P100 Base 14.9209||P100 Cmp 15.407955||Pct Diff 3.26424679476
||Task ('OrHighMed', None)||P50 Base 3.595632||P50 Cmp 3.395554||Pct Diff -5.56447378375||P90 Base 31.491599||P90 Cmp 44.058926||Pct Diff 39.9069193025||P99 Base 60.664087||P99 Cmp 58.24572||Pct Diff -3.98648874416||P999 Base 60.664087||P999 Cmp 58.24572||Pct Diff -3.98648874416||P100 Base 127.792946||P100 Cmp 153.46527||Pct Diff 20.0889992786
||Task ('IntNRQ', None)||P50 Base 4.006204||P50 Cmp 4.034332||Pct Diff 0.702111025799||P90 Base 12.147999||P90 Cmp 11.846894||Pct Diff -2.47863866304||P99 Base 67.933053||P99 Cmp 81.246955||Pct Diff 19.5985627203||P999 Base 67.933053||P999 Cmp 81.246955||Pct Diff 19.5985627203||P100 Base 210.004233||P100 Cmp 163.203321||Pct Diff -22.2856993554
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.17697||P50 Cmp 0.182502||Pct Diff 3.12595355145||P90 Base 0.192696||P90 Cmp 0.218631||Pct Diff 13.4590235397||P99 Base 1.581539||P99 Cmp 0.24586||Pct Diff -84.4543827247||P999 Base 1.581539||P999 Cmp 0.24586||Pct Diff -84.4543827247||P100 Base 10.792128||P100 Cmp 10.01208||Pct Diff -7.2279350282
||Task ('AndHighMed', None)||P50 Base 3.266572||P50 Cmp 3.748062||Pct Diff 14.7399169527||P90 Base 11.613684||P90 Cmp 18.004139||Pct Diff 55.0252185267||P99 Base 11.709418||P99 Cmp 24.750638||Pct Diff 111.37376768||P999 Base 11.709418||P999 Cmp 24.750638||Pct Diff 111.37376768||P100 Base 182.698519||P100 Cmp 145.853169||Pct Diff -20.1672953901
||Task ('OrHighNotMed', None)||P50 Base 1.630404||P50 Cmp 1.794313||Pct Diff 10.0532751392||P90 Base 2.312654||P90 Cmp 6.007598||Pct Diff 159.770722296||P99 Base 3.619824||P99 Cmp 11.619977||Pct Diff 221.009446868||P999 Base 3.619824||P999 Cmp 11.619977||Pct Diff 221.009446868||P100 Base 5.508064||P100 Cmp 25.402743||Pct Diff 361.191863421
||Task ('Prefix3', None)||P50 Base 13.387535||P50 Cmp 14.231088||Pct Diff 6.30103301317||P90 Base 30.046216||P90 Cmp 24.226015||Pct Diff -19.3708285929||P99 Base 411.077228||P99 Cmp 306.46196||Pct Diff -25.4490545509||P999 Base 411.077228||P999 Cmp 306.46196||Pct Diff -25.4490545509||P100 Base 572.580601||P100 Cmp 484.602393||Pct Diff -15.3652093428
||Task PKLookup||P50 Base 10.684861||P50 Cmp 11.605952||Pct Diff 8.62052393569||P90 Base 57.671139||P90 Cmp 13.380187||Pct Diff -76.7991629227||P99 Base 71.775961||P99 Cmp 118.319854||Pct Diff 64.8460743006||P999 Base 71.775961||P999 Cmp 118.319854||Pct Diff 64.8460743006||P100 Base 347.843905||P100 Cmp 220.058699||Pct Diff -36.7363648358
||Task ('HighTerm', None)||P50 Base 1.139649||P50 Cmp 1.17187||Pct Diff 2.82727401156||P90 Base 2.636838||P90 Cmp 1.557521||Pct Diff -40.9322453636||P99 Base 2.828697||P99 Cmp 2.581495||Pct Diff -8.73907668442||P999 Base 2.828697||P999 Cmp 2.581495||Pct Diff -8.73907668442||P100 Base 10.088597||P100 Cmp 12.614708||Pct Diff 25.0392695833
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
BrowseDayOfYearTaxoFacets 6163.44 (3.6%) 5819.45 (5.0%) -5.6% ( -13% - 3%)
BrowseMonthTaxoFacets 6107.94 (5.9%) 5893.67 (3.7%) -3.5% ( -12% - 6%)
HighTerm 884.41 (4.4%) 854.57 (3.0%) -3.4% ( -10% - 4%)
LowPhrase 195.85 (4.7%) 189.40 (7.1%) -3.3% ( -14% - 8%)
Wildcard 530.75 (7.6%) 516.30 (8.1%) -2.7% ( -17% - 14%)
PKLookup 94.30 (2.6%) 92.03 (3.9%) -2.4% ( -8% - 4%)
HighTermDayOfYearSort 287.35 (10.1%) 280.56 (10.2%) -2.4% ( -20% - 19%)
Prefix3 71.71 (3.8%) 70.04 (4.0%) -2.3% ( -9% - 5%)
HighTermMonthSort 336.82 (10.4%) 329.76 (18.7%) -2.1% ( -28% - 30%)
Fuzzy2 38.02 (13.4%) 37.24 (12.7%) -2.1% ( -24% - 27%)
MedTerm 985.07 (5.1%) 966.15 (3.3%) -1.9% ( -9% - 6%)
Fuzzy1 59.22 (7.1%) 58.15 (9.7%) -1.8% ( -17% - 16%)
OrHighNotMed 587.65 (4.6%) 577.29 (6.5%) -1.8% ( -12% - 9%)
IntNRQ 256.59 (2.2%) 253.24 (4.7%) -1.3% ( -8% - 5%)
OrHighNotHigh 581.10 (5.5%) 574.47 (5.3%) -1.1% ( -11% - 10%)
LowSloppyPhrase 62.52 (6.2%) 61.83 (5.9%) -1.1% ( -12% - 11%)
Respell 63.07 (2.7%) 62.39 (4.4%) -1.1% ( -7% - 6%)
OrHighLow 445.18 (4.6%) 440.96 (4.8%) -0.9% ( -9% - 8%)
MedPhrase 152.77 (3.1%) 151.44 (3.1%) -0.9% ( -6% - 5%)
OrHighHigh 57.64 (8.7%) 57.16 (6.5%) -0.8% ( -14% - 15%)
AndHighHigh 196.31 (4.4%) 194.84 (3.2%) -0.8% ( -7% - 7%)
HighSloppyPhrase 108.40 (5.8%) 107.58 (6.1%) -0.8% ( -11% - 11%)
OrNotHighMed 685.56 (4.4%) 681.28 (5.3%) -0.6% ( -9% - 9%)
OrNotHighHigh 544.90 (4.5%) 541.85 (5.5%) -0.6% ( -10% - 9%)
OrHighNotLow 657.21 (6.3%) 655.10 (5.6%) -0.3% ( -11% - 12%)
BrowseDateTaxoFacets 2.32 (0.9%) 2.32 (1.0%) -0.1% ( -2% - 1%)
LowTerm 1151.31 (3.2%) 1151.09 (5.2%) -0.0% ( -8% - 8%)
OrNotHighLow 833.37 (5.2%) 835.02 (5.6%) 0.2% ( -10% - 11%)
AndHighMed 301.49 (6.6%) 302.15 (8.2%) 0.2% ( -13% - 16%)
HighPhrase 240.06 (3.8%) 240.75 (3.8%) 0.3% ( -7% - 8%)
MedSpanNear 119.37 (4.0%) 120.03 (6.2%) 0.6% ( -9% - 11%)
HighIntervalsOrdered 55.68 (3.9%) 56.00 (1.8%) 0.6% ( -5% - 6%)
AndHighLow 770.00 (2.9%) 776.28 (4.8%) 0.8% ( -6% - 8%)
OrHighMed 303.45 (8.5%) 307.21 (8.0%) 1.2% ( -14% - 19%)
BrowseMonthSSDVFacets 13.25 (20.7%) 13.52 (20.6%) 2.1% ( -32% - 54%)
BrowseDayOfYearSSDVFacets 10.68 (19.4%) 10.92 (18.4%) 2.2% ( -29% - 49%)
LowSpanNear 42.20 (6.8%) 43.16 (2.7%) 2.3% ( -6% - 12%)
HighSpanNear 53.34 (6.8%) 54.95 (2.6%) 3.0% ( -6% - 13%)
MedSloppyPhrase 122.00 (7.9%) 126.58 (2.6%) 3.8% ( -6% - 15%)
iter 18
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.18 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -3863379 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.18 -topN 10 -pk
21.6 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.18 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -3863379 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.18 -topN 10 -pk
20.8 s
Report after iter 18:
||Task ('Wildcard', None)||P50 Base 1.883758||P50 Cmp 1.900024||Pct Diff 0.863486711138||P90 Base 17.260679||P90 Cmp 15.008247||Pct Diff -13.0494982266||P99 Base 28.919319||P99 Cmp 28.873477||Pct Diff -0.158516872406||P999 Base 28.919319||P999 Cmp 28.873477||Pct Diff -0.158516872406||P100 Base 213.281221||P100 Cmp 237.238629||Pct Diff 11.2327789046
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 3.187646||P50 Cmp 3.011748||Pct Diff -5.5181158761||P90 Base 6.177111||P90 Cmp 6.578718||Pct Diff 6.50153445518||P99 Base 70.468039||P99 Cmp 104.10524||Pct Diff 47.7339819262||P999 Base 70.468039||P999 Cmp 104.10524||Pct Diff 47.7339819262||P100 Base 132.681702||P100 Cmp 130.956423||Pct Diff -1.30031419103
||Task ('MedSloppyPhrase', None)||P50 Base 7.789379||P50 Cmp 7.789464||Pct Diff 0.00109122948055||P90 Base 11.392194||P90 Cmp 8.817095||Pct Diff -22.6040655558||P99 Base 12.226202||P99 Cmp 11.616662||Pct Diff -4.98552207791||P999 Base 12.226202||P999 Cmp 11.616662||Pct Diff -4.98552207791||P100 Base 142.498211||P100 Cmp 214.181099||Pct Diff 50.3044125936
||Task ('OrHighHigh', None)||P50 Base 16.204675||P50 Cmp 16.21292||Pct Diff 0.0508803786562||P90 Base 27.045828||P90 Cmp 28.98475||Pct Diff 7.16902436856||P99 Base 28.227118||P99 Cmp 63.581895||Pct Diff 125.251104275||P999 Base 28.227118||P999 Cmp 63.581895||Pct Diff 125.251104275||P100 Base 67.560999||P100 Cmp 110.006132||Pct Diff 62.8249043505
||Task ('MedPhrase', None)||P50 Base 6.739851||P50 Cmp 6.626712||Pct Diff -1.67865728782||P90 Base 10.772681||P90 Cmp 9.790659||Pct Diff -9.11585518962||P99 Base 30.138929||P99 Cmp 29.851279||Pct Diff -0.954413476338||P999 Base 30.138929||P999 Cmp 29.851279||Pct Diff -0.954413476338||P100 Base 34.407687||P100 Cmp 34.661011||Pct Diff 0.736242456519
||Task ('LowSpanNear', None)||P50 Base 22.401738||P50 Cmp 23.888354||Pct Diff 6.63616367623||P90 Base 30.371686||P90 Cmp 31.416152||Pct Diff 3.43894639237||P99 Base 33.74936||P99 Cmp 35.512156||Pct Diff 5.22319830658||P999 Base 33.74936||P999 Cmp 35.512156||Pct Diff 5.22319830658||P100 Base 79.077535||P100 Cmp 36.387143||Pct Diff -53.9854865228
||Task ('Fuzzy2', None)||P50 Base 30.059864||P50 Cmp 35.997267||Pct Diff 19.7519290174||P90 Base 178.280218||P90 Cmp 176.8662||Pct Diff -0.793143521958||P99 Base 324.697185||P99 Cmp 319.511884||Pct Diff -1.59696518465||P999 Base 324.697185||P999 Cmp 319.511884||Pct Diff -1.59696518465||P100 Base 363.497341||P100 Cmp 419.495183||Pct Diff 15.4052961834
||Task ('OrNotHighHigh', None)||P50 Base 1.997329||P50 Cmp 1.891175||Pct Diff -5.31479791261||P90 Base 6.050572||P90 Cmp 4.419259||Pct Diff -26.9613021711||P99 Base 6.407301||P99 Cmp 5.393717||Pct Diff -15.819203749||P999 Base 6.407301||P999 Cmp 5.393717||Pct Diff -15.819203749||P100 Base 9.467999||P100 Cmp 7.636154||Pct Diff -19.3477523603
||Task ('OrHighNotLow', None)||P50 Base 1.52236||P50 Cmp 1.603741||Pct Diff 5.34571323471||P90 Base 2.852177||P90 Cmp 2.064235||Pct Diff -27.6259853438||P99 Base 4.407777||P99 Cmp 2.975709||Pct Diff -32.4895746768||P999 Base 4.407777||P999 Cmp 2.975709||Pct Diff -32.4895746768||P100 Base 11.75547||P100 Cmp 9.654813||Pct Diff -17.8696130397
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 65.146008||P50 Cmp 64.906077||Pct Diff -0.368297317619||P90 Base 84.18458||P90 Cmp 85.152164||Pct Diff 1.14936013222||P99 Base 127.70678||P99 Cmp 132.917197||Pct Diff 4.07998463355||P999 Base 127.70678||P999 Cmp 132.917197||Pct Diff 4.07998463355||P100 Base 218.134814||P100 Cmp 179.16957||Pct Diff -17.8629184794
||Task ('Fuzzy1', None)||P50 Base 18.291849||P50 Cmp 17.7793||Pct Diff -2.80206227375||P90 Base 126.349404||P90 Cmp 133.524847||Pct Diff 5.67904776187||P99 Base 216.75032||P99 Cmp 218.405213||Pct Diff 0.763501986987||P999 Base 216.75032||P999 Cmp 218.405213||Pct Diff 0.763501986987||P100 Base 226.60126||P100 Cmp 228.390449||Pct Diff 0.789575927336
||Task ('HighSloppyPhrase', None)||P50 Base 9.249167||P50 Cmp 9.265702||Pct Diff 0.178772855977||P90 Base 12.414511||P90 Cmp 15.289855||Pct Diff 23.1611539109||P99 Base 12.634595||P99 Cmp 18.592912||Pct Diff 47.1587494494||P999 Base 12.634595||P999 Cmp 18.592912||Pct Diff 47.1587494494||P100 Base 66.379436||P100 Cmp 24.982751||Pct Diff -62.3637190891
||Task ('OrNotHighMed', None)||P50 Base 1.46869||P50 Cmp 1.521557||Pct Diff 3.59960236673||P90 Base 9.061162||P90 Cmp 20.773446||Pct Diff 129.258079703||P99 Base 22.593193||P99 Cmp 22.047108||Pct Diff -2.41703330733||P999 Base 22.593193||P999 Cmp 22.047108||Pct Diff -2.41703330733||P100 Base 36.134698||P100 Cmp 36.365635||Pct Diff 0.639100401503
||Task ('LowPhrase', None)||P50 Base 5.105621||P50 Cmp 5.014571||Pct Diff -1.78332860978||P90 Base 7.971672||P90 Cmp 13.258771||Pct Diff 66.3235893298||P99 Base 13.043083||P99 Cmp 27.903383||Pct Diff 113.932419199||P999 Base 13.043083||P999 Cmp 27.903383||Pct Diff 113.932419199||P100 Base 223.034725||P100 Cmp 533.762173||Pct Diff 139.317968536
||Task ('AndHighLow', None)||P50 Base 1.361506||P50 Cmp 1.362012||Pct Diff 0.0371647278822||P90 Base 2.036749||P90 Cmp 3.229136||Pct Diff 58.5436398889||P99 Base 3.097838||P99 Cmp 4.176244||Pct Diff 34.8115685843||P999 Base 3.097838||P999 Cmp 4.176244||Pct Diff 34.8115685843||P100 Base 14.323078||P100 Cmp 9.299985||Pct Diff -35.0699270087
||Task ('LowTerm', None)||P50 Base 0.888002||P50 Cmp 0.889749||Pct Diff 0.19673379114||P90 Base 2.512877||P90 Cmp 11.280798||Pct Diff 348.919624797||P99 Base 21.072597||P99 Cmp 22.115219||Pct Diff 4.94776225256||P999 Base 21.072597||P999 Cmp 22.115219||Pct Diff 4.94776225256||P100 Base 54.521307||P100 Cmp 55.44467||Pct Diff 1.69358192385
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 83.222198||P50 Cmp 82.735523||Pct Diff -0.584789889832||P90 Base 90.829151||P90 Cmp 91.506535||Pct Diff 0.745778191849||P99 Base 93.403313||P99 Cmp 96.630603||Pct Diff 3.45522005199||P999 Base 93.403313||P999 Cmp 96.630603||Pct Diff 3.45522005199||P100 Base 276.022797||P100 Cmp 266.984307||Pct Diff -3.27454474711
||Task ('AndHighHigh', None)||P50 Base 5.030199||P50 Cmp 4.793534||Pct Diff -4.70488344497||P90 Base 11.495124||P90 Cmp 11.623024||Pct Diff 1.11264567481||P99 Base 181.320651||P99 Cmp 298.217828||Pct Diff 64.4698639429||P999 Base 181.320651||P999 Cmp 298.217828||Pct Diff 64.4698639429||P100 Base 300.469246||P100 Cmp 563.237012||Pct Diff 87.4524662667
||Task ('HighTermMonthSort', 'Month')||P50 Base 3.227531||P50 Cmp 3.220468||Pct Diff -0.218836008082||P90 Base 5.230974||P90 Cmp 5.392627||Pct Diff 3.09030402369||P99 Base 7.285402||P99 Cmp 7.832912||Pct Diff 7.51516525787||P999 Base 7.285402||P999 Cmp 7.832912||Pct Diff 7.51516525787||P100 Base 37.330811||P100 Cmp 81.96766||Pct Diff 119.571066913
||Task Respell||P50 Base 16.634223||P50 Cmp 16.787983||Pct Diff 0.924359376449||P90 Base 98.119545||P90 Cmp 96.910403||Pct Diff -1.23231513151||P99 Base 105.055507||P99 Cmp 138.442935||Pct Diff 31.7807499611||P999 Base 105.055507||P999 Cmp 138.442935||Pct Diff 31.7807499611||P100 Base 261.345742||P100 Cmp 265.68694||Pct Diff 1.66109383179
||Task ('MedTerm', None)||P50 Base 1.040636||P50 Cmp 1.090466||Pct Diff 4.78841785216||P90 Base 4.598622||P90 Cmp 22.334235||Pct Diff 385.672338366||P99 Base 5.31397||P99 Cmp 31.243321||Pct Diff 487.946883404||P999 Base 5.31397||P999 Cmp 31.243321||Pct Diff 487.946883404||P100 Base 67.132042||P100 Cmp 68.918819||Pct Diff 2.66158595325
||Task ('HighIntervalsOrdered', None)||P50 Base 17.103786||P50 Cmp 17.296859||Pct Diff 1.12883194399||P90 Base 27.040585||P90 Cmp 27.602721||Pct Diff 2.0788603501||P99 Base 118.246198||P99 Cmp 114.786717||Pct Diff -2.92565939414||P999 Base 118.246198||P999 Cmp 114.786717||Pct Diff -2.92565939414||P100 Base 165.261049||P100 Cmp 169.462796||Pct Diff 2.54249082008
||Task ('HighSpanNear', None)||P50 Base 19.550743||P50 Cmp 19.738709||Pct Diff 0.961426376481||P90 Base 28.211277||P90 Cmp 30.083751||Pct Diff 6.6373244997||P99 Base 31.133153||P99 Cmp 30.222024||Pct Diff -2.92655549536||P999 Base 31.133153||P999 Cmp 30.222024||Pct Diff -2.92655549536||P100 Base 39.427988||P100 Cmp 39.386823||Pct Diff -0.104405530406
||Task ('LowSloppyPhrase', None)||P50 Base 15.426975||P50 Cmp 15.332302||Pct Diff -0.613684795626||P90 Base 25.638538||P90 Cmp 17.309086||Pct Diff -32.4880147222||P99 Base 25.947033||P99 Cmp 19.000253||Pct Diff -26.7729262147||P999 Base 25.947033||P999 Cmp 19.000253||Pct Diff -26.7729262147||P100 Base 39.768435||P100 Cmp 24.17758||Pct Diff -39.2040949059
||Task ('OrHighNotHigh', None)||P50 Base 1.745215||P50 Cmp 1.705762||Pct Diff -2.26063837407||P90 Base 5.560425||P90 Cmp 13.567831||Pct Diff 144.007085789||P99 Base 17.012852||P99 Cmp 17.295336||Pct Diff 1.66041531426||P999 Base 17.012852||P999 Cmp 17.295336||Pct Diff 1.66041531426||P100 Base 320.741427||P100 Cmp 291.146956||Pct Diff -9.22689384929
||Task ('OrNotHighLow', None)||P50 Base 1.190577||P50 Cmp 1.22477||Pct Diff 2.87196880168||P90 Base 1.818832||P90 Cmp 2.711627||Pct Diff 49.086171785||P99 Base 6.213314||P99 Cmp 12.435839||Pct Diff 100.148246169||P999 Base 6.213314||P999 Cmp 12.435839||Pct Diff 100.148246169||P100 Base 49.823003||P100 Cmp 50.517907||Pct Diff 1.39474531473
||Task ('MedSpanNear', None)||P50 Base 7.834454||P50 Cmp 8.424339||Pct Diff 7.52936962806||P90 Base 12.246922||P90 Cmp 11.85398||Pct Diff -3.20849597964||P99 Base 47.758055||P99 Cmp 12.739446||Pct Diff -73.3250317669||P999 Base 47.758055||P999 Cmp 12.739446||Pct Diff -73.3250317669||P100 Base 72.407241||P100 Cmp 47.308059||Pct Diff -34.6639115831
||Task ('BrowseDateTaxoFacets', None)||P50 Base 428.918258||P50 Cmp 429.391633||Pct Diff 0.11036485185||P90 Base 435.050102||P90 Cmp 445.196209||Pct Diff 2.33216977846||P99 Base 443.527186||P99 Cmp 454.913366||Pct Diff 2.567188745||P999 Base 443.527186||P999 Cmp 454.913366||Pct Diff 2.567188745||P100 Base 527.80198||P100 Cmp 526.72643||Pct Diff -0.203779076388
||Task ('HighPhrase', None)||P50 Base 4.270308||P50 Cmp 4.094543||Pct Diff -4.11597945628||P90 Base 6.985631||P90 Cmp 4.992129||Pct Diff -28.5371786743||P99 Base 8.911591||P99 Cmp 9.661498||Pct Diff 8.41496204213||P999 Base 8.911591||P999 Cmp 9.661498||Pct Diff 8.41496204213||P100 Base 84.027743||P100 Cmp 66.260526||Pct Diff -21.1444653464
||Task ('OrHighLow', None)||P50 Base 2.256531||P50 Cmp 2.373746||Pct Diff 5.19447771823||P90 Base 2.893841||P90 Cmp 2.785976||Pct Diff -3.72739898287||P99 Base 2.989028||P99 Cmp 9.230719||Pct Diff 208.820091347||P999 Base 2.989028||P999 Cmp 9.230719||Pct Diff 208.820091347||P100 Base 227.507636||P100 Cmp 292.613675||Pct Diff 28.6170785934
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.165713||P50 Cmp 0.184494||Pct Diff 11.3334500009||P90 Base 0.238431||P90 Cmp 0.226172||Pct Diff -5.14152941522||P99 Base 5.141803||P99 Cmp 5.618681||Pct Diff 9.27452879856||P999 Base 5.141803||P999 Cmp 5.618681||Pct Diff 9.27452879856||P100 Base 18.89787||P100 Cmp 16.838544||Pct Diff -10.8971328515
||Task ('OrHighMed', None)||P50 Base 3.303623||P50 Cmp 3.0857||Pct Diff -6.59648513163||P90 Base 9.076941||P90 Cmp 8.453697||Pct Diff -6.86623389972||P99 Base 14.933524||P99 Cmp 10.988474||Pct Diff -26.417408242||P999 Base 14.933524||P999 Cmp 10.988474||Pct Diff -26.417408242||P100 Base 16.572239||P100 Cmp 13.904472||Pct Diff -16.0978066995
||Task ('IntNRQ', None)||P50 Base 3.953831||P50 Cmp 4.017501||Pct Diff 1.61033691121||P90 Base 12.336794||P90 Cmp 12.07042||Pct Diff -2.15918333402||P99 Base 70.910288||P99 Cmp 73.423005||Pct Diff 3.5435154346||P999 Base 70.910288||P999 Cmp 73.423005||Pct Diff 3.5435154346||P100 Base 135.162079||P100 Cmp 145.365577||Pct Diff 7.54908334904
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.152559||P50 Cmp 0.169657||Pct Diff 11.207467275||P90 Base 0.196107||P90 Cmp 0.214931||Pct Diff 9.5988414488||P99 Base 0.197123||P99 Cmp 0.216843||Pct Diff 10.0039061906||P999 Base 0.197123||P999 Cmp 0.216843||Pct Diff 10.0039061906||P100 Base 14.753737||P100 Cmp 17.944779||Pct Diff 21.6287032906
||Task ('AndHighMed', None)||P50 Base 3.202596||P50 Cmp 2.993269||Pct Diff -6.5361662851||P90 Base 8.533682||P90 Cmp 4.196365||Pct Diff -50.825856881||P99 Base 21.624769||P99 Cmp 5.049451||Pct Diff -76.6496881423||P999 Base 21.624769||P999 Cmp 5.049451||Pct Diff -76.6496881423||P100 Base 23.430795||P100 Cmp 16.528163||Pct Diff -29.4596576855
||Task ('OrHighNotMed', None)||P50 Base 1.915801||P50 Cmp 1.718906||Pct Diff -10.2774244298||P90 Base 11.626397||P90 Cmp 4.422192||Pct Diff -61.9642095483||P99 Base 22.997073||P99 Cmp 15.121702||Pct Diff -34.2451015397||P999 Base 22.997073||P999 Cmp 15.121702||Pct Diff -34.2451015397||P100 Base 341.805148||P100 Cmp 499.143614||Pct Diff 46.0316255974
||Task ('Prefix3', None)||P50 Base 14.824339||P50 Cmp 14.398762||Pct Diff -2.87079916346||P90 Base 23.653381||P90 Cmp 17.786655||Pct Diff -24.802906612||P99 Base 25.045831||P99 Cmp 22.914508||Pct Diff -8.5096916928||P999 Base 25.045831||P999 Cmp 22.914508||Pct Diff -8.5096916928||P100 Base 151.069498||P100 Cmp 163.354401||Pct Diff 8.13195460542
||Task PKLookup||P50 Base 11.122103||P50 Cmp 10.743845||Pct Diff -3.40095753474||P90 Base 67.03264||P90 Cmp 67.742064||Pct Diff 1.05832621242||P99 Base 267.946614||P99 Cmp 261.310648||Pct Diff -2.47660005885||P999 Base 267.946614||P999 Cmp 261.310648||Pct Diff -2.47660005885||P100 Base 280.048508||P100 Cmp 289.968434||Pct Diff 3.54221705048
||Task ('HighTerm', None)||P50 Base 1.172031||P50 Cmp 1.091617||Pct Diff -6.86108131952||P90 Base 2.676288||P90 Cmp 1.474502||Pct Diff -44.9049579119||P99 Base 6.490541||P99 Cmp 2.104594||Pct Diff -67.5744441026||P999 Base 6.490541||P999 Cmp 2.104594||Pct Diff -67.5744441026||P100 Base 39.94157||P100 Cmp 7.357309||Pct Diff -81.5798202224
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
BrowseDayOfYearTaxoFacets 6157.00 (3.5%) 5798.69 (5.1%) -5.8% ( -13% - 2%)
BrowseMonthTaxoFacets 6140.46 (6.2%) 5897.26 (3.5%) -4.0% ( -12% - 6%)
LowPhrase 195.98 (4.5%) 190.07 (7.1%) -3.0% ( -14% - 9%)
HighTerm 886.27 (4.3%) 860.08 (3.9%) -3.0% ( -10% - 5%)
Wildcard 531.70 (7.4%) 518.49 (8.1%) -2.5% ( -16% - 14%)
HighTermDayOfYearSort 289.96 (10.5%) 283.43 (10.7%) -2.3% ( -21% - 21%)
PKLookup 94.19 (2.6%) 92.12 (3.9%) -2.2% ( -8% - 4%)
Prefix3 71.52 (3.9%) 70.03 (3.9%) -2.1% ( -9% - 5%)
MedTerm 986.69 (5.0%) 966.93 (3.2%) -2.0% ( -9% - 6%)
HighTermMonthSort 335.53 (10.3%) 328.87 (18.3%) -2.0% ( -27% - 29%)
Fuzzy2 38.00 (13.1%) 37.24 (12.3%) -2.0% ( -24% - 26%)
Fuzzy1 59.36 (7.0%) 58.30 (9.4%) -1.8% ( -17% - 15%)
OrHighNotMed 587.56 (4.5%) 579.32 (6.5%) -1.4% ( -11% - 10%)
IntNRQ 256.53 (2.2%) 253.13 (4.6%) -1.3% ( -7% - 5%)
OrHighNotHigh 582.80 (5.5%) 575.69 (5.2%) -1.2% ( -11% - 10%)
OrHighLow 446.58 (4.7%) 441.40 (4.6%) -1.2% ( -10% - 8%)
LowSloppyPhrase 62.66 (6.1%) 62.01 (5.9%) -1.0% ( -12% - 11%)
Respell 62.95 (2.8%) 62.34 (4.3%) -1.0% ( -7% - 6%)
HighSloppyPhrase 108.56 (5.7%) 107.64 (5.9%) -0.8% ( -11% - 11%)
MedPhrase 152.67 (3.1%) 151.46 (3.0%) -0.8% ( -6% - 5%)
OrHighHigh 57.86 (8.6%) 57.43 (6.6%) -0.7% ( -14% - 15%)
OrNotHighMed 685.47 (4.3%) 680.90 (5.1%) -0.7% ( -9% - 9%)
OrNotHighHigh 545.36 (4.3%) 542.02 (5.4%) -0.6% ( -9% - 9%)
OrHighNotLow 659.04 (6.2%) 656.06 (5.5%) -0.5% ( -11% - 11%)
AndHighHigh 196.55 (4.3%) 195.82 (3.8%) -0.4% ( -8% - 8%)
BrowseDateTaxoFacets 2.32 (0.9%) 2.32 (1.0%) -0.1% ( -1% - 1%)
LowTerm 1150.11 (3.1%) 1150.54 (5.1%) 0.0% ( -7% - 8%)
OrNotHighLow 836.10 (5.2%) 837.10 (5.6%) 0.1% ( -10% - 11%)
MedSpanNear 119.85 (4.3%) 120.00 (6.0%) 0.1% ( -9% - 10%)
HighPhrase 239.85 (3.8%) 240.81 (3.7%) 0.4% ( -6% - 8%)
HighIntervalsOrdered 55.85 (4.0%) 56.10 (1.9%) 0.4% ( -5% - 6%)
AndHighMed 302.33 (6.5%) 304.02 (8.4%) 0.6% ( -13% - 16%)
AndHighLow 770.11 (2.8%) 775.70 (4.7%) 0.7% ( -6% - 8%)
OrHighMed 303.81 (8.2%) 308.14 (7.9%) 1.4% ( -13% - 19%)
LowSpanNear 42.34 (6.7%) 43.11 (2.7%) 1.8% ( -7% - 12%)
BrowseMonthSSDVFacets 13.36 (20.3%) 13.63 (20.2%) 2.0% ( -31% - 53%)
BrowseDayOfYearSSDVFacets 10.75 (19.0%) 10.98 (18.0%) 2.1% ( -29% - 48%)
HighSpanNear 53.25 (6.7%) 54.72 (3.1%) 2.8% ( -6% - 13%)
MedSloppyPhrase 122.40 (7.7%) 126.69 (2.6%) 3.5% ( -6% - 14%)
iter 19
my_modified_version:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.19 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/patch/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/patch/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/patch/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -9449968 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.my_modified_version.19 -topN 10 -pk
21.5 s
baseline:
log: /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.19 + stdout
run: java -server -Xms2g -Xmx2g -XX:-TieredCompilation -XX:+HeapDumpOnOutOfMemoryError -Xbatch -classpath /local/home/atris/analytical_luceneutil/trunk/lucene/build/core/lucene-core-9.0.0-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/core/classes/test:/local/home/atris/analytical_luceneutil/trunk/lucene/build/sandbox/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/misc/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/facet/classes/java:/home/mike/src/lucene-c-boost/dist/luceneCBoost-SNAPSHOT.jar:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/common/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/analysis/icu/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queryparser/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/grouping/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/suggest/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/highlighter/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/codecs/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/build/queries/classes/java:/local/home/atris/analytical_luceneutil/trunk/lucene/facet/lib/hppc-0.8.1.jar:/local/home/atris/analytical_luceneutil/util/lib/HdrHistogram.jar:/local/home/atris/analytical_luceneutil/util/build perf.SearchPerfTest -dirImpl MMapDirectory -indexPath /local/home/atris/analytical_luceneutil/indices/wikimedium10m.trunk.facets.taxonomy:Date.sortedset:Month.sortedset:DayOfYear.Lucene80.Lucene50.nd10M -facets taxonomy:Date;Date -facets sortedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -analyzer StandardAnalyzer -taskSource /local/home/atris/analytical_luceneutil/util/35994.tasks -searchThreadCount 2 -taskRepeatCount 20 -field body -tasksPerCat 1 -concurrentSearches -staticSeed -6930645 -seed -9449968 -similarity BM25Similarity -commit multi -hiliteImpl FastVectorHighlighter -log /local/home/atris/analytical_luceneutil/logs/trunk_vs_patch.baseline.19 -topN 10 -pk
21.4 s
Report after iter 19:
||Task ('Wildcard', None)||P50 Base 1.968323||P50 Cmp 1.981791||Pct Diff 0.684237292355||P90 Base 27.902347||P90 Cmp 21.182403||Pct Diff -24.0837948148||P99 Base 54.771594||P99 Cmp 55.634499||Pct Diff 1.57546081277||P999 Base 54.771594||P999 Cmp 55.634499||Pct Diff 1.57546081277||P100 Base 176.877932||P100 Cmp 128.903949||Pct Diff -27.1226503259
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 4.015212||P50 Cmp 3.826224||Pct Diff -4.70680003945||P90 Base 106.393336||P90 Cmp 73.281104||Pct Diff -31.1224680463||P99 Base 158.43439||P99 Cmp 74.407742||Pct Diff -53.035611776||P999 Base 158.43439||P999 Cmp 74.407742||Pct Diff -53.035611776||P100 Base 227.562111||P100 Cmp 140.021238||Pct Diff -38.469001986
||Task ('MedSloppyPhrase', None)||P50 Base 7.696956||P50 Cmp 9.41384||Pct Diff 22.3060129225||P90 Base 13.847737||P90 Cmp 23.039656||Pct Diff 66.3784920236||P99 Base 16.138765||P99 Cmp 28.895153||Pct Diff 79.0419093406||P999 Base 16.138765||P999 Cmp 28.895153||Pct Diff 79.0419093406||P100 Base 29.561748||P100 Cmp 86.980414||Pct Diff 194.232986493
||Task ('OrHighHigh', None)||P50 Base 17.75792||P50 Cmp 17.623694||Pct Diff -0.755865551821||P90 Base 46.806105||P90 Cmp 54.197039||Pct Diff 15.7905341622||P99 Base 53.857589||P99 Cmp 60.954724||Pct Diff 13.1775950832||P999 Base 53.857589||P999 Cmp 60.954724||Pct Diff 13.1775950832||P100 Base 186.268142||P100 Cmp 201.786548||Pct Diff 8.33121855051
||Task ('MedPhrase', None)||P50 Base 6.597017||P50 Cmp 6.523231||Pct Diff -1.11847521387||P90 Base 8.741035||P90 Cmp 6.891517||Pct Diff -21.1590275065||P99 Base 9.999877||P99 Cmp 8.512586||Pct Diff -14.873092939||P999 Base 9.999877||P999 Cmp 8.512586||Pct Diff -14.873092939||P100 Base 45.571332||P100 Cmp 8.676709||Pct Diff -80.9601593388
||Task ('LowSpanNear', None)||P50 Base 22.912703||P50 Cmp 22.969387||Pct Diff 0.24739115241||P90 Base 35.100961||P90 Cmp 28.527087||Pct Diff -18.7284729897||P99 Base 35.254469||P99 Cmp 30.872103||Pct Diff -12.4306680098||P999 Base 35.254469||P999 Cmp 30.872103||Pct Diff -12.4306680098||P100 Base 35.640265||P100 Cmp 32.807435||Pct Diff -7.94839769008
||Task ('Fuzzy2', None)||P50 Base 30.413671||P50 Cmp 29.956835||Pct Diff -1.50207451116||P90 Base 71.017181||P90 Cmp 81.76786||Pct Diff 15.1381381922||P99 Base 99.473037||P99 Cmp 100.465544||Pct Diff 0.997764851595||P999 Base 99.473037||P999 Cmp 100.465544||Pct Diff 0.997764851595||P100 Base 101.646049||P100 Cmp 101.100192||Pct Diff -0.537017429964
||Task ('OrNotHighHigh', None)||P50 Base 1.888252||P50 Cmp 1.940158||Pct Diff 2.74889156744||P90 Base 2.103949||P90 Cmp 2.869636||Pct Diff 36.3928498267||P99 Base 2.512832||P99 Cmp 4.196428||Pct Diff 66.9999426941||P999 Base 2.512832||P999 Cmp 4.196428||Pct Diff 66.9999426941||P100 Base 4.261148||P100 Cmp 4.311048||Pct Diff 1.17104592471
||Task ('OrHighNotLow', None)||P50 Base 1.802054||P50 Cmp 1.781136||Pct Diff -1.16078652471||P90 Base 4.160508||P90 Cmp 4.13665||Pct Diff -0.573439589589||P99 Base 13.927809||P99 Cmp 4.293068||Pct Diff -69.1762860907||P999 Base 13.927809||P999 Cmp 4.293068||Pct Diff -69.1762860907||P100 Base 161.858502||P100 Cmp 154.579971||Pct Diff -4.49684811738
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 66.407875||P50 Cmp 66.08426||Pct Diff -0.487314192782||P90 Base 66.826248||P90 Cmp 73.606736||Pct Diff 10.1464442535||P99 Base 94.348491||P99 Cmp 93.107581||Pct Diff -1.3152409613||P999 Base 94.348491||P999 Cmp 93.107581||Pct Diff -1.3152409613||P100 Base 120.206674||P100 Cmp 174.80242||Pct Diff 45.4182319361
||Task ('Fuzzy1', None)||P50 Base 21.230326||P50 Cmp 19.30043||Pct Diff -9.09027963113||P90 Base 57.323455||P90 Cmp 97.410088||Pct Diff 69.9305947278||P99 Base 97.101366||P99 Cmp 109.026222||Pct Diff 12.2808323829||P999 Base 97.101366||P999 Cmp 109.026222||Pct Diff 12.2808323829||P100 Base 686.387987||P100 Cmp 781.325982||Pct Diff 13.8315350499
||Task ('HighSloppyPhrase', None)||P50 Base 9.549781||P50 Cmp 9.784095||Pct Diff 2.45360600416||P90 Base 15.943927||P90 Cmp 42.91543||Pct Diff 169.164742162||P99 Base 28.495507||P99 Cmp 56.538261||Pct Diff 98.4111425005||P999 Base 28.495507||P999 Cmp 56.538261||Pct Diff 98.4111425005||P100 Base 111.450329||P100 Cmp 115.483154||Pct Diff 3.61849537474
||Task ('OrNotHighMed', None)||P50 Base 1.498898||P50 Cmp 1.510787||Pct Diff 0.793182724909||P90 Base 4.584199||P90 Cmp 4.337518||Pct Diff -5.38111456331||P99 Base 5.351498||P99 Cmp 5.801905||Pct Diff 8.41646581948||P999 Base 5.351498||P999 Cmp 5.801905||Pct Diff 8.41646581948||P100 Base 27.218381||P100 Cmp 50.768244||Pct Diff 86.5219095875
||Task ('LowPhrase', None)||P50 Base 5.042892||P50 Cmp 5.106012||Pct Diff 1.25166273638||P90 Base 7.835542||P90 Cmp 7.194287||Pct Diff -8.18392652353||P99 Base 11.146701||P99 Cmp 7.55985||Pct Diff -32.1785880863||P999 Base 11.146701||P999 Cmp 7.55985||Pct Diff -32.1785880863||P100 Base 14.894362||P100 Cmp 10.783064||Pct Diff -27.6030487241
||Task ('AndHighLow', None)||P50 Base 1.388644||P50 Cmp 1.47991||Pct Diff 6.57231082985||P90 Base 3.241751||P90 Cmp 5.583686||Pct Diff 72.2429020613||P99 Base 13.071941||P99 Cmp 9.714131||Pct Diff -25.6871569417||P999 Base 13.071941||P999 Cmp 9.714131||Pct Diff -25.6871569417||P100 Base 275.074329||P100 Cmp 279.086452||Pct Diff 1.45855958809
||Task ('LowTerm', None)||P50 Base 0.830381||P50 Cmp 0.883213||Pct Diff 6.36238064214||P90 Base 1.166906||P90 Cmp 1.403133||Pct Diff 20.2438756849||P99 Base 2.067017||P99 Cmp 1.569054||Pct Diff -24.0909000748||P999 Base 2.067017||P999 Cmp 1.569054||Pct Diff -24.0909000748||P100 Base 67.842547||P100 Cmp 93.694452||Pct Diff 38.105740635
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 85.608535||P50 Cmp 85.215355||Pct Diff -0.459276636377||P90 Base 95.546701||P90 Cmp 93.076058||Pct Diff -2.58579623801||P99 Base 150.039768||P99 Cmp 96.252983||Pct Diff -35.8483525514||P999 Base 150.039768||P999 Cmp 96.252983||Pct Diff -35.8483525514||P100 Base 267.692321||P100 Cmp 237.893122||Pct Diff -11.1318841305
||Task ('AndHighHigh', None)||P50 Base 5.018483||P50 Cmp 5.217715||Pct Diff 3.96996462875||P90 Base 6.167064||P90 Cmp 8.097553||Pct Diff 31.3032100851||P99 Base 10.046547||P99 Cmp 9.388851||Pct Diff -6.54648806202||P999 Base 10.046547||P999 Cmp 9.388851||Pct Diff -6.54648806202||P100 Base 135.602189||P100 Cmp 51.835135||Pct Diff -61.7741163456
||Task ('HighTermMonthSort', 'Month')||P50 Base 2.457833||P50 Cmp 2.534509||Pct Diff 3.11965865866||P90 Base 3.822881||P90 Cmp 4.455546||Pct Diff 16.5494296056||P99 Base 7.940367||P99 Cmp 6.899009||Pct Diff -13.1147338656||P999 Base 7.940367||P999 Cmp 6.899009||Pct Diff -13.1147338656||P100 Base 230.585872||P100 Cmp 79.089849||Pct Diff -65.7004792557
||Task Respell||P50 Base 16.658461||P50 Cmp 16.424043||Pct Diff -1.40720082125||P90 Base 212.093523||P90 Cmp 214.729488||Pct Diff 1.24283144658||P99 Base 251.328323||P99 Cmp 252.906748||Pct Diff 0.628033076877||P999 Base 251.328323||P999 Cmp 252.906748||Pct Diff 0.628033076877||P100 Base 304.328902||P100 Cmp 342.077933||Pct Diff 12.4040243145
||Task ('MedTerm', None)||P50 Base 1.051449||P50 Cmp 1.096947||Pct Diff 4.32717136067||P90 Base 3.56828||P90 Cmp 1.752213||Pct Diff -50.894744807||P99 Base 4.415944||P99 Cmp 4.294185||Pct Diff -2.75725869712||P999 Base 4.415944||P999 Cmp 4.294185||Pct Diff -2.75725869712||P100 Base 60.061617||P100 Cmp 22.698387||Pct Diff -62.2081653246
||Task ('HighIntervalsOrdered', None)||P50 Base 17.359282||P50 Cmp 17.524571||Pct Diff 0.952164957053||P90 Base 26.035212||P90 Cmp 25.176361||Pct Diff -3.29880547929||P99 Base 27.892976||P99 Cmp 39.18704||Pct Diff 40.4907099192||P999 Base 27.892976||P999 Cmp 39.18704||Pct Diff 40.4907099192||P100 Base 81.950664||P100 Cmp 174.140881||Pct Diff 112.494777346
||Task ('HighSpanNear', None)||P50 Base 18.324833||P50 Cmp 17.87112||Pct Diff -2.47594616551||P90 Base 28.326253||P90 Cmp 25.595215||Pct Diff -9.64136696795||P99 Base 32.242812||P99 Cmp 27.912698||Pct Diff -13.4297033398||P999 Base 32.242812||P999 Cmp 27.912698||Pct Diff -13.4297033398||P100 Base 150.100376||P100 Cmp 154.774801||Pct Diff 3.11419939414
||Task ('LowSloppyPhrase', None)||P50 Base 15.504067||P50 Cmp 14.751802||Pct Diff -4.85204946547||P90 Base 23.573201||P90 Cmp 24.301605||Pct Diff 3.08996644113||P99 Base 24.262003||P99 Cmp 24.627024||Pct Diff 1.50449655785||P999 Base 24.262003||P999 Cmp 24.627024||Pct Diff 1.50449655785||P100 Base 284.238929||P100 Cmp 255.986681||Pct Diff -9.93961245893
||Task ('OrHighNotHigh', None)||P50 Base 1.791149||P50 Cmp 1.876966||Pct Diff 4.79117036048||P90 Base 3.642838||P90 Cmp 5.931014||Pct Diff 62.813004586||P99 Base 4.008162||P99 Cmp 6.426743||Pct Diff 60.3413983766||P999 Base 4.008162||P999 Cmp 6.426743||Pct Diff 60.3413983766||P100 Base 6.321302||P100 Cmp 30.854754||Pct Diff 388.107576572
||Task ('OrNotHighLow', None)||P50 Base 1.287221||P50 Cmp 1.319587||Pct Diff 2.51440894765||P90 Base 26.338538||P90 Cmp 16.106539||Pct Diff -38.8480142672||P99 Base 86.943147||P99 Cmp 89.800272||Pct Diff 3.28619919866||P999 Base 86.943147||P999 Cmp 89.800272||Pct Diff 3.28619919866||P100 Base 290.996035||P100 Cmp 289.159532||Pct Diff -0.63110928642
||Task ('MedSpanNear', None)||P50 Base 8.139699||P50 Cmp 8.18076||Pct Diff 0.504453543061||P90 Base 11.865533||P90 Cmp 12.556177||Pct Diff 5.82058977039||P99 Base 12.469643||P99 Cmp 22.621231||Pct Diff 81.4104140752||P999 Base 12.469643||P999 Cmp 22.621231||Pct Diff 81.4104140752||P100 Base 13.363684||P100 Cmp 24.449196||Pct Diff 82.9525151897
||Task ('BrowseDateTaxoFacets', None)||P50 Base 428.883679||P50 Cmp 431.926356||Pct Diff 0.709441079011||P90 Base 451.154777||P90 Cmp 436.87298||Pct Diff -3.16560917186||P99 Base 485.280517||P99 Cmp 448.0144||Pct Diff -7.67929387118||P999 Base 485.280517||P999 Cmp 448.0144||Pct Diff -7.67929387118||P100 Base 660.041106||P100 Cmp 719.735606||Pct Diff 9.04405793175
||Task ('HighPhrase', None)||P50 Base 4.034775||P50 Cmp 4.07859||Pct Diff 1.0859341599||P90 Base 27.196244||P90 Cmp 28.281304||Pct Diff 3.98974211292||P99 Base 90.610057||P99 Cmp 72.818955||Pct Diff -19.6347983756||P999 Base 90.610057||P999 Cmp 72.818955||Pct Diff -19.6347983756||P100 Base 301.693961||P100 Cmp 297.709781||Pct Diff -1.3206031658
||Task ('OrHighLow', None)||P50 Base 2.406926||P50 Cmp 2.323333||Pct Diff -3.47301911234||P90 Base 12.760501||P90 Cmp 3.059022||Pct Diff -76.0274145976||P99 Base 13.073806||P99 Cmp 22.12358||Pct Diff 69.2206538784||P999 Base 13.073806||P999 Cmp 22.12358||Pct Diff 69.2206538784||P100 Base 31.887468||P100 Cmp 151.447845||Pct Diff 374.944718094
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.168759||P50 Cmp 0.176903||Pct Diff 4.82581669718||P90 Base 0.649281||P90 Cmp 0.268117||Pct Diff -58.7055527576||P99 Base 7.114674||P99 Cmp 1.012884||Pct Diff -85.7634517056||P999 Base 7.114674||P999 Cmp 1.012884||Pct Diff -85.7634517056||P100 Base 10.322883||P100 Cmp 7.201913||Pct Diff -30.2335113166
||Task ('OrHighMed', None)||P50 Base 3.374513||P50 Cmp 3.527409||Pct Diff 4.53090564476||P90 Base 22.314557||P90 Cmp 8.762483||Pct Diff -60.7319876438||P99 Base 22.421337||P99 Cmp 11.754387||Pct Diff -47.5749951932||P999 Base 22.421337||P999 Cmp 11.754387||Pct Diff -47.5749951932||P100 Base 88.714256||P100 Cmp 12.712136||Pct Diff -85.6706953615
||Task ('IntNRQ', None)||P50 Base 4.056411||P50 Cmp 3.934586||Pct Diff -3.00327062519||P90 Base 12.527507||P90 Cmp 12.57239||Pct Diff 0.358275593061||P99 Base 55.938072||P99 Cmp 79.438874||Pct Diff 42.0121773235||P999 Base 55.938072||P999 Cmp 79.438874||Pct Diff 42.0121773235||P100 Base 241.595549||P100 Cmp 101.252573||Pct Diff -58.0900503262
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.171559||P50 Cmp 0.159837||Pct Diff -6.83263483699||P90 Base 0.223181||P90 Cmp 0.193583||Pct Diff -13.2618816118||P99 Base 0.253828||P99 Cmp 0.255827||Pct Diff 0.787541169611||P999 Base 0.253828||P999 Cmp 0.255827||Pct Diff 0.787541169611||P100 Base 31.71077||P100 Cmp 30.630415||Pct Diff -3.40690244986
||Task ('AndHighMed', None)||P50 Base 3.110289||P50 Cmp 3.206239||Pct Diff 3.08492233358||P90 Base 11.570695||P90 Cmp 6.900099||Pct Diff -40.3657342969||P99 Base 12.471365||P99 Cmp 10.141758||Pct Diff -18.6796473361||P999 Base 12.471365||P999 Cmp 10.141758||Pct Diff -18.6796473361||P100 Base 25.871493||P100 Cmp 23.238373||Pct Diff -10.1776886243
||Task ('OrHighNotMed', None)||P50 Base 1.726614||P50 Cmp 1.771093||Pct Diff 2.57608243649||P90 Base 6.57851||P90 Cmp 7.776963||Pct Diff 18.2176967125||P99 Base 10.881884||P99 Cmp 10.470068||Pct Diff -3.78441821288||P999 Base 10.881884||P999 Cmp 10.470068||Pct Diff -3.78441821288||P100 Base 57.619635||P100 Cmp 11.23451||Pct Diff -80.5022888465
||Task ('Prefix3', None)||P50 Base 13.578043||P50 Cmp 13.999937||Pct Diff 3.10717825831||P90 Base 19.893614||P90 Cmp 19.796761||Pct Diff -0.486854726346||P99 Base 93.057957||P99 Cmp 99.141575||Pct Diff 6.53745063412||P999 Base 93.057957||P999 Cmp 99.141575||Pct Diff 6.53745063412||P100 Base 101.418055||P100 Cmp 209.050866||Pct Diff 106.127859581
||Task PKLookup||P50 Base 10.651801||P50 Cmp 11.134214||Pct Diff 4.52893365169||P90 Base 59.239812||P90 Cmp 12.446245||Pct Diff -78.9900666802||P99 Base 137.384566||P99 Cmp 80.402165||Pct Diff -41.476566589||P999 Base 137.384566||P999 Cmp 80.402165||Pct Diff -41.476566589||P100 Base 282.876194||P100 Cmp 255.621062||Pct Diff -9.63500378544
||Task ('HighTerm', None)||P50 Base 1.210093||P50 Cmp 1.238927||Pct Diff 2.38279206639||P90 Base 14.420263||P90 Cmp 5.00267||Pct Diff -65.3080529807||P99 Base 35.828796||P99 Cmp 14.434975||Pct Diff -59.7112473442||P999 Base 35.828796||P999 Cmp 14.434975||Pct Diff -59.7112473442||P100 Base 79.179192||P100 Cmp 139.513503||Pct Diff 76.1997053468
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff
BrowseDayOfYearTaxoFacets 6150.99 (3.4%) 5799.89 (4.9%) -5.7% ( -13% - 2%)
BrowseMonthTaxoFacets 6134.13 (6.0%) 5922.64 (3.9%) -3.4% ( -12% - 6%)
HighTerm 883.67 (4.4%) 858.02 (4.0%) -2.9% ( -10% - 5%)
LowPhrase 196.13 (4.4%) 190.50 (7.0%) -2.9% ( -13% - 8%)
Fuzzy2 38.05 (12.7%) 37.06 (12.2%) -2.6% ( -24% - 25%)
MedTerm 989.59 (5.0%) 964.48 (3.3%) -2.5% ( -10% - 6%)
PKLookup 94.34 (2.6%) 92.01 (3.8%) -2.5% ( -8% - 4%)
Wildcard 532.47 (7.3%) 520.02 (8.0%) -2.3% ( -16% - 13%)
HighTermMonthSort 339.48 (11.2%) 331.98 (18.1%) -2.2% ( -28% - 30%)
Prefix3 71.63 (3.8%) 70.11 (3.9%) -2.1% ( -9% - 5%)
HighTermDayOfYearSort 288.81 (10.4%) 283.02 (10.5%) -2.0% ( -20% - 21%)
OrHighNotMed 590.31 (4.8%) 580.32 (6.4%) -1.7% ( -12% - 9%)
Fuzzy1 59.07 (7.2%) 58.08 (9.4%) -1.7% ( -17% - 16%)
IntNRQ 256.17 (2.2%) 253.36 (4.5%) -1.1% ( -7% - 5%)
OrHighLow 446.31 (4.6%) 441.42 (4.5%) -1.1% ( -9% - 8%)
OrHighNotHigh 581.99 (5.4%) 575.69 (5.1%) -1.1% ( -10% - 9%)
HighSloppyPhrase 108.53 (5.5%) 107.51 (5.8%) -0.9% ( -11% - 10%)
Respell 62.88 (2.8%) 62.33 (4.2%) -0.9% ( -7% - 6%)
LowSloppyPhrase 62.82 (6.0%) 62.31 (6.1%) -0.8% ( -12% - 11%)
OrNotHighHigh 545.57 (4.2%) 541.19 (5.3%) -0.8% ( -9% - 9%)
OrHighHigh 57.87 (8.3%) 57.42 (6.4%) -0.8% ( -14% - 15%)
MedPhrase 152.77 (3.0%) 151.61 (2.9%) -0.8% ( -6% - 5%)
OrNotHighMed 686.16 (4.2%) 681.67 (5.0%) -0.7% ( -9% - 8%)
LowTerm 1158.62 (4.4%) 1151.42 (5.0%) -0.6% ( -9% - 9%)
AndHighHigh 196.84 (4.2%) 195.71 (3.7%) -0.6% ( -8% - 7%)
OrHighNotLow 655.27 (6.6%) 652.45 (5.9%) -0.4% ( -12% - 12%)
BrowseDateTaxoFacets 2.32 (0.9%) 2.32 (1.0%) -0.2% ( -1% - 1%)
MedSpanNear 120.05 (4.2%) 120.23 (5.9%) 0.2% ( -9% - 10%)
OrNotHighLow 833.62 (5.2%) 835.65 (5.5%) 0.2% ( -9% - 11%)
HighPhrase 240.35 (3.8%) 241.07 (3.6%) 0.3% ( -6% - 7%)
AndHighLow 769.08 (2.8%) 771.45 (5.2%) 0.3% ( -7% - 8%)
AndHighMed 303.63 (6.6%) 304.60 (8.2%) 0.3% ( -13% - 16%)
HighIntervalsOrdered 55.94 (4.0%) 56.15 (1.9%) 0.4% ( -5% - 6%)
OrHighMed 303.78 (8.0%) 307.77 (7.7%) 1.3% ( -13% - 18%)
LowSpanNear 42.41 (6.6%) 43.13 (2.6%) 1.7% ( -7% - 11%)
BrowseMonthSSDVFacets 13.44 (19.8%) 13.70 (19.7%) 1.9% ( -31% - 51%)
BrowseDayOfYearSSDVFacets 10.80 (18.5%) 11.02 (17.5%) 2.0% ( -28% - 46%)
MedSloppyPhrase 122.80 (7.7%) 126.06 (3.3%) 2.7% ( -7% - 14%)
HighSpanNear 53.30 (6.6%) 54.79 (3.1%) 2.8% ( -6% - 13%)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment