[
https://issues.apache.org/jira/browse/LUCENE-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934206#comment-16934206
]
Atri Sharma commented on LUCENE-8978:
-------------------------------------
I had some issues with my earlier test runs. Fixed them now and here are the
updated results:
Wikimedium10m with concurrent search:
||Task ('HighSpanNear', None)||P50 Base 18.971856||P50 Cmp 19.115405||Pct Diff
0.75664183831||P90 Base 25.394956||P90 Cmp 22.396552||Pct Diff
-11.80708484||P99 Base 25.585029||P99 Cmp 22.825023||Pct Diff
-10.7875820661||P999 Base 25.585029||P999 Cmp 22.825023||Pct Diff
-10.7875820661||P100 Base 29.948754||P100 Cmp 22.990658||Pct Diff
-23.2333405256||
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 100.813812||P50 Cmp
101.237299||Pct Diff 0.420068432687||P90 Base 112.729388||P90 Cmp
120.730533||Pct Diff 7.09765673526||P99 Base 122.198435||P99 Cmp
132.415702||Pct Diff 8.36120937228||P999 Base 122.198435||P999 Cmp
132.415702||Pct Diff 8.36120937228||P100 Base 294.000735||P100 Cmp
276.961033||Pct Diff -5.7958025173||
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 29.38945||P50 Cmp
30.619796||Pct Diff 4.18635258571||P90 Base 71.768952||P90 Cmp 80.413425||Pct
Diff 12.0448644701||P99 Base 85.238118||P99 Cmp 98.349615||Pct Diff
15.3821990767||P999 Base 85.238118||P999 Cmp 98.349615||Pct Diff
15.3821990767||P100 Base 100.262364||P100 Cmp 142.551521||Pct Diff
42.1784958112||
||Task ('HighTerm', None)||P50 Base 2.238097||P50 Cmp 1.268568||Pct Diff
-43.3193467486||P90 Base 3.279594||P90 Cmp 2.217695||Pct Diff
-32.3789773978||P99 Base 3.833247||P99 Cmp 7.549833||Pct Diff
96.9566010226||P999 Base 3.833247||P999 Cmp 7.549833||Pct Diff
96.9566010226||P100 Base 8.530505||P100 Cmp 37.05043||Pct Diff 334.328682768||
||Task ('LowTerm', None)||P50 Base 1.543205||P50 Cmp 1.231248||Pct Diff
-20.214877479||P90 Base 7.173272||P90 Cmp 2.116812||Pct Diff
-70.4902867199||P99 Base 11.802009||P99 Cmp 6.056692||Pct Diff
-48.6808389995||P999 Base 11.802009||P999 Cmp 6.056692||Pct Diff
-48.6808389995||P100 Base 21.263545||P100 Cmp 29.650059||Pct Diff
39.4408082001||
||Task ('OrNotHighHigh', None)||P50 Base 2.995964||P50 Cmp 1.803324||Pct Diff
-39.8082219947||P90 Base 3.829869||P90 Cmp 2.761644||Pct Diff
-27.8919461736||P99 Base 3.835793||P99 Cmp 2.90684||Pct Diff
-24.2180169785||P999 Base 3.835793||P999 Cmp 2.90684||Pct Diff
-24.2180169785||P100 Base 41.140203||P100 Cmp 38.965549||Pct Diff
-5.28595836049||
||Task ('MedPhrase', None)||P50 Base 2.679309||P50 Cmp 2.680824||Pct Diff
0.0565444299258||P90 Base 3.448301||P90 Cmp 4.514041||Pct Diff
30.9062346935||P99 Base 95.803532||P99 Cmp 38.188159||Pct Diff
-60.1390906966||P999 Base 95.803532||P999 Cmp 38.188159||Pct Diff
-60.1390906966||P100 Base 101.641901||P100 Cmp 73.856804||Pct Diff
-27.3362626305||
||Task ('AndHighLow', None)||P50 Base 1.409244||P50 Cmp 1.347221||Pct Diff
-4.40115409397||P90 Base 4.495005||P90 Cmp 3.099544||Pct Diff
-31.044704066||P99 Base 6.043321||P99 Cmp 5.084951||Pct Diff
-15.8583335222||P999 Base 6.043321||P999 Cmp 5.084951||Pct Diff
-15.8583335222||P100 Base 8.454945||P100 Cmp 7.701492||Pct Diff -8.91138854244||
||Task ('MedTerm', None)||P50 Base 1.682272||P50 Cmp 1.147723||Pct Diff
-31.7754203839||P90 Base 15.24221||P90 Cmp 4.303477||Pct Diff
-71.7660562346||P99 Base 24.52032||P99 Cmp 5.817554||Pct Diff
-76.2745592227||P999 Base 24.52032||P999 Cmp 5.817554||Pct Diff
-76.2745592227||P100 Base 45.496262||P100 Cmp 20.414843||Pct Diff
-55.1285268227||
||Task ('Prefix3', None)||P50 Base 1.904465||P50 Cmp 1.8418||Pct Diff
-3.29042539506||P90 Base 6.631238||P90 Cmp 21.78927||Pct Diff
228.585250597||P99 Base 20.862886||P99 Cmp 164.172423||Pct Diff
686.911374582||P999 Base 20.862886||P999 Cmp 164.172423||Pct Diff
686.911374582||P100 Base 235.494494||P100 Cmp 311.228238||Pct Diff
32.1594542249||
||Task ('OrHighNotMed', None)||P50 Base 2.592121||P50 Cmp 1.741687||Pct Diff
-32.8084221377||P90 Base 3.21777||P90 Cmp 2.281574||Pct Diff
-29.0945592755||P99 Base 4.108258||P99 Cmp 2.356369||Pct Diff
-42.6431105349||P999 Base 4.108258||P999 Cmp 2.356369||Pct Diff
-42.6431105349||P100 Base 36.452029||P100 Cmp 24.359319||Pct Diff
-33.1743124642||
||Task ('LowSloppyPhrase', None)||P50 Base 7.17009||P50 Cmp 6.775814||Pct Diff
-5.49889889806||P90 Base 10.237824||P90 Cmp 11.639566||Pct Diff
13.6917962254||P99 Base 15.983773||P99 Cmp 11.864554||Pct Diff
-25.7712556353||P999 Base 15.983773||P999 Cmp 11.864554||Pct Diff
-25.7712556353||P100 Base 27.466558||P100 Cmp 15.832752||Pct Diff
-42.3562573803||
||Task ('Wildcard', None)||P50 Base 3.182749||P50 Cmp 2.826948||Pct Diff
-11.1790467926||P90 Base 10.75107||P90 Cmp 9.240186||Pct Diff
-14.0533360865||P99 Base 143.622905||P99 Cmp 9.604664||Pct Diff
-93.3125820008||P999 Base 143.622905||P999 Cmp 9.604664||Pct Diff
-93.3125820008||P100 Base 356.310669||P100 Cmp 165.943325||Pct Diff
-53.4273488173||
||Task ('HighSloppyPhrase', None)||P50 Base 18.930947||P50 Cmp 17.470305||Pct
Diff -7.71563091904||P90 Base 29.558801||P90 Cmp 28.708357||Pct Diff
-2.87712617301||P99 Base 30.502984||P99 Cmp 29.054366||Pct Diff
-4.7491025796||P999 Base 30.502984||P999 Cmp 29.054366||Pct Diff
-4.7491025796||P100 Base 100.576435||P100 Cmp 29.413667||Pct Diff
-70.7549119235||
||Task ('HighIntervalsOrdered', None)||P50 Base 16.140269||P50 Cmp
16.695305||Pct Diff 3.43882744457||P90 Base 24.893004||P90 Cmp 24.412859||Pct
Diff -1.92883510564||P99 Base 32.006548||P99 Cmp 36.016794||Pct Diff
12.5294549103||P999 Base 32.006548||P999 Cmp 36.016794||Pct Diff
12.5294549103||P100 Base 135.304631||P100 Cmp 107.165711||Pct Diff
-20.7967161154||
||Task ('IntNRQ', None)||P50 Base 5.01008||P50 Cmp 5.077795||Pct Diff
1.35157522435||P90 Base 55.870017||P90 Cmp 13.879275||Pct Diff
-75.1579187814||P99 Base 104.078259||P99 Cmp 113.021586||Pct Diff
8.59288681991||P999 Base 104.078259||P999 Cmp 113.021586||Pct Diff
8.59288681991||P100 Base 228.186239||P100 Cmp 120.063283||Pct Diff
-47.3836443748||
||Task ('MedSpanNear', None)||P50 Base 6.044147||P50 Cmp 6.538728||Pct Diff
8.18280892242||P90 Base 27.73923||P90 Cmp 26.78976||Pct Diff
-3.42284194623||P99 Base 31.186687||P99 Cmp 29.375471||Pct Diff
-5.80765760723||P999 Base 31.186687||P999 Cmp 29.375471||Pct Diff
-5.80765760723||P100 Base 475.296829||P100 Cmp 299.124599||Pct Diff
-37.0657280358||
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.173862||P50 Cmp
0.165614||Pct Diff -4.74399236176||P90 Base 0.219035||P90 Cmp 0.275778||Pct
Diff 25.9059054489||P99 Base 0.219605||P99 Cmp 0.284092||Pct Diff
29.3649962433||P999 Base 0.219605||P999 Cmp 0.284092||Pct Diff
29.3649962433||P100 Base 24.387907||P100 Cmp 23.903957||Pct Diff
-1.98438512989||
||Task ('HighTermMonthSort', 'Month')||P50 Base 25.356492||P50 Cmp
26.126949||Pct Diff 3.03849996285||P90 Base 32.241495||P90 Cmp 35.329769||Pct
Diff 9.57856948011||P99 Base 36.428719||P99 Cmp 39.964302||Pct Diff
9.70548264406||P999 Base 36.428719||P999 Cmp 39.964302||Pct Diff
9.70548264406||P100 Base 76.849917||P100 Cmp 70.917629||Pct Diff
-7.71931607942||
||Task Respell||P50 Base 22.624837||P50 Cmp 22.886964||Pct Diff
1.15858072259||P90 Base 278.20719||P90 Cmp 85.811447||Pct Diff
-69.1555610047||P99 Base 283.803815||P99 Cmp 285.948691||Pct Diff
0.755760101393||P999 Base 283.803815||P999 Cmp 285.948691||Pct Diff
0.755760101393||P100 Base 408.986758||P100 Cmp 646.591515||Pct Diff
58.0959535614||
||Task ('HighPhrase', None)||P50 Base 39.342939||P50 Cmp 18.644176||Pct Diff
-52.6111254678||P90 Base 50.707655||P90 Cmp 26.184513||Pct Diff
-48.3618144046||P99 Base 57.097617||P99 Cmp 26.751993||Pct Diff
-53.1469185483||P999 Base 57.097617||P999 Cmp 26.751993||Pct Diff
-53.1469185483||P100 Base 203.423561||P100 Cmp 180.117251||Pct Diff
-11.4570356971||
||Task ('OrHighNotLow', None)||P50 Base 2.519362||P50 Cmp 1.758888||Pct Diff
-30.185181804||P90 Base 6.628084||P90 Cmp 3.069032||Pct Diff
-53.6965433751||P99 Base 6.819052||P99 Cmp 4.400299||Pct Diff
-35.4705170161||P999 Base 6.819052||P999 Cmp 4.400299||Pct Diff
-35.4705170161||P100 Base 42.230781||P100 Cmp 11.238064||Pct Diff
-73.3889269062||
||Task ('LowPhrase', None)||P50 Base 1.998635||P50 Cmp 1.803893||Pct Diff
-9.74375010945||P90 Base 5.928542||P90 Cmp 4.752868||Pct Diff
-19.8307442201||P99 Base 11.554931||P99 Cmp 12.960246||Pct Diff
12.1620371424||P999 Base 11.554931||P999 Cmp 12.960246||Pct Diff
12.1620371424||P100 Base 30.426781||P100 Cmp 24.484238||Pct Diff
-19.5306332274||
||Task ('OrHighNotHigh', None)||P50 Base 2.831417||P50 Cmp 1.333155||Pct Diff
-52.9156249327||P90 Base 6.883672||P90 Cmp 2.313561||Pct Diff
-66.3905979251||P99 Base 7.788618||P99 Cmp 4.554117||Pct Diff
-41.5285612929||P999 Base 7.788618||P999 Cmp 4.554117||Pct Diff
-41.5285612929||P100 Base 8.976584||P100 Cmp 6.332386||Pct Diff -29.4566173502||
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.174705||P50 Cmp
0.171706||Pct Diff -1.71660799634||P90 Base 0.25399||P90 Cmp 0.260638||Pct Diff
2.61742588291||P99 Base 21.042688||P99 Cmp 8.644944||Pct Diff
-58.9171117302||P999 Base 21.042688||P999 Cmp 8.644944||Pct Diff
-58.9171117302||P100 Base 23.388598||P100 Cmp 23.772758||Pct Diff
1.64250973915||
||Task ('Fuzzy2', None)||P50 Base 26.6262||P50 Cmp 34.349226||Pct Diff
29.0053631386||P90 Base 108.542321||P90 Cmp 57.367342||Pct Diff
-47.1474891347||P99 Base 164.59635||P99 Cmp 108.404373||Pct Diff
-34.1392606823||P999 Base 164.59635||P999 Cmp 108.404373||Pct Diff
-34.1392606823||P100 Base 706.455337||P100 Cmp 751.645786||Pct Diff
6.39678782694||
||Task ('AndHighMed', None)||P50 Base 2.782514||P50 Cmp 2.731525||Pct Diff
-1.83247954907||P90 Base 10.537516||P90 Cmp 6.382485||Pct Diff
-39.4308392984||P99 Base 72.980547||P99 Cmp 8.907339||Pct Diff
-87.7949133486||P999 Base 72.980547||P999 Cmp 8.907339||Pct Diff
-87.7949133486||P100 Base 209.391929||P100 Cmp 65.690225||Pct Diff
-68.6281007517||
||Task ('AndHighHigh', None)||P50 Base 5.160436||P50 Cmp 5.838854||Pct Diff
13.1465248285||P90 Base 14.80012||P90 Cmp 13.701921||Pct Diff
-7.4202033497||P99 Base 54.506459||P99 Cmp 87.039011||Pct Diff
59.6856823886||P999 Base 54.506459||P999 Cmp 87.039011||Pct Diff
59.6856823886||P100 Base 108.419844||P100 Cmp 114.454877||Pct Diff
5.56635462416||
||Task ('MedSloppyPhrase', None)||P50 Base 13.276245||P50 Cmp 13.791899||Pct
Diff 3.88403498128||P90 Base 66.651656||P90 Cmp 21.125857||Pct Diff
-68.3040778462||P99 Base 117.477161||P99 Cmp 66.361111||Pct Diff
-43.5114787971||P999 Base 117.477161||P999 Cmp 66.361111||Pct Diff
-43.5114787971||P100 Base 144.912198||P100 Cmp 164.681974||Pct Diff
13.6425892871||
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 93.380842||P50 Cmp
92.735093||Pct Diff -0.691521929091||P90 Base 96.720704||P90 Cmp 99.407285||Pct
Diff 2.77766898802||P99 Base 96.76942||P99 Cmp 100.435863||Pct Diff
3.78884465774||P999 Base 96.76942||P999 Cmp 100.435863||Pct Diff
3.78884465774||P100 Base 126.35659||P100 Cmp 125.511467||Pct Diff
-0.668839670333||
||Task ('OrNotHighMed', None)||P50 Base 2.008232||P50 Cmp 1.960218||Pct Diff
-2.39085922344||P90 Base 18.503889||P90 Cmp 5.723573||Pct Diff
-69.0682699188||P99 Base 302.172336||P99 Cmp 204.593996||Pct Diff
-32.2922810512||P999 Base 302.172336||P999 Cmp 204.593996||Pct Diff
-32.2922810512||P100 Base 451.344257||P100 Cmp 294.181114||Pct Diff
-34.8211239121||
||Task ('LowSpanNear', None)||P50 Base 19.967304||P50 Cmp 20.081594||Pct Diff
0.572385736202||P90 Base 25.087717||P90 Cmp 30.951829||Pct Diff
23.3744345888||P99 Base 25.701355||P99 Cmp 33.999408||Pct Diff
32.2864417071||P999 Base 25.701355||P999 Cmp 33.999408||Pct Diff
32.2864417071||P100 Base 35.304445||P100 Cmp 35.944626||Pct Diff 1.81331557542||
||Task ('OrHighLow', None)||P50 Base 3.196112||P50 Cmp 1.682768||Pct Diff
-47.3495296786||P90 Base 9.367199||P90 Cmp 45.882965||Pct Diff
389.825880714||P99 Base 41.940519||P99 Cmp 126.347569||Pct Diff
201.25418572||P999 Base 41.940519||P999 Cmp 126.347569||Pct Diff
201.25418572||P100 Base 106.524356||P100 Cmp 213.443731||Pct Diff
100.370825053||
||Task PKLookup||P50 Base 10.961338||P50 Cmp 10.326765||Pct Diff
-5.78919288868||P90 Base 80.746438||P90 Cmp 72.596238||Pct Diff
-10.0935721771||P99 Base 183.752939||P99 Cmp 179.07915||Pct Diff
-2.54351795701||P999 Base 183.752939||P999 Cmp 179.07915||Pct Diff
-2.54351795701||P100 Base 283.95249||P100 Cmp 181.990793||Pct Diff
-35.9080129919||
||Task ('OrHighHigh', None)||P50 Base 15.202781||P50 Cmp 16.164734||Pct Diff
6.32748047874||P90 Base 22.280623||P90 Cmp 22.964996||Pct Diff
3.07160621137||P99 Base 28.72027||P99 Cmp 81.176||Pct Diff 182.64358239||P999
Base 28.72027||P999 Cmp 81.176||Pct Diff 182.64358239||P100 Base
145.116416||P100 Cmp 413.271206||Pct Diff 184.785979003||
||Task ('OrNotHighLow', None)||P50 Base 1.423141||P50 Cmp 1.441871||Pct Diff
1.31610290196||P90 Base 3.908113||P90 Cmp 2.421889||Pct Diff -38.029197211||P99
Base 5.080778||P99 Cmp 4.055832||Pct Diff -20.1730128732||P999 Base
5.080778||P999 Cmp 4.055832||Pct Diff -20.1730128732||P100 Base 5.133711||P100
Cmp 5.39345||Pct Diff 5.0594784163||
||Task ('Fuzzy1', None)||P50 Base 18.435499||P50 Cmp 20.056537||Pct Diff
8.79302480502||P90 Base 106.048087||P90 Cmp 109.547307||Pct Diff
3.29965405222||P99 Base 185.022941||P99 Cmp 168.072828||Pct Diff
-9.16108721891||P999 Base 185.022941||P999 Cmp 168.072828||Pct Diff
-9.16108721891||P100 Base 200.953009||P100 Cmp 200.452265||Pct Diff
-0.249184624053||
||Task ('BrowseDateTaxoFacets', None)||P50 Base 429.678395||P50 Cmp
432.655336||Pct Diff 0.692830040943||P90 Base 441.138564||P90 Cmp
470.791557||Pct Diff 6.72192263835||P99 Base 445.074599||P99 Cmp
475.335447||Pct Diff 6.79905078115||P999 Base 445.074599||P999 Cmp
475.335447||Pct Diff 6.79905078115||P100 Base 520.385966||P100 Cmp
540.567427||Pct Diff 3.87817164923||
||Task ('OrHighMed', None)||P50 Base 4.127915||P50 Cmp 4.273914||Pct Diff
3.53687030862||P90 Base 8.134325||P90 Cmp 7.147647||Pct Diff
-12.1298079435||P99 Base 20.868165||P99 Cmp 16.851728||Pct Diff
-19.2467186262||P999 Base 20.868165||P999 Cmp 16.851728||Pct Diff
-19.2467186262||P100 Base 88.36515||P100 Cmp 70.356703||Pct Diff
-20.3795806378||
QPS:
||Task||QPS baseline||StdDev baseline||QPS my_modified_version||StdDev
my_modified_version||Pct diff||
|IntNRQ|195.61|26.86|189.74|30.63|{color:#FF0000}28%{color}-{color:#008000}30%{color}|
|HighTermDayOfYearSort|33.48|1.05|32.55|1.26|{color:#FF0000}9%{color}-{color:#008000}4%{color}|
|MedPhrase|384.80|18.11|376.18|22.89|{color:#FF0000}12%{color}-{color:#008000}8%{color}|
|AndHighMed|361.93|16.95|354.75|21.28|{color:#FF0000}11%{color}-{color:#008000}8%{color}|
|Wildcard|350.94|25.49|344.72|25.84|{color:#FF0000}15%{color}-{color:#008000}13%{color}|
|BrowseDayOfYearTaxoFacets|6009.22|266.20|5914.08|266.14|{color:#FF0000}9%{color}-{color:#008000}7%{color}|
|BrowseMonthTaxoFacets|6241.48|348.42|6157.94|513.42|{color:#FF0000}14%{color}-{color:#008000}13%{color}|
|AndHighHigh|207.72|10.17|205.30|10.85|{color:#FF0000}10%{color}-{color:#008000}9%{color}|
|Fuzzy2|36.37|2.97|36.11|3.52|{color:#FF0000}17%{color}-{color:#008000}18%{color}|
|BrowseDayOfYearSSDVFacets|11.47|1.78|11.41|1.79|{color:#FF0000}27%{color}-{color:#008000}36%{color}|
|BrowseDateTaxoFacets|2.31|0.03|2.31|0.02|{color:#FF0000}2%{color}-{color:#008000}2%{color}|
|Respell|44.88|1.42|45.01|1.14|{color:#FF0000}5%{color}-{color:#008000}6%{color}|
|BrowseMonthSSDVFacets|14.06|2.52|14.10|2.47|{color:#FF0000}29%{color}-{color:#008000}43%{color}|
|OrHighHigh|63.18|1.64|63.44|1.52|{color:#FF0000}4%{color}-{color:#008000}5%{color}|
|AndHighLow|764.78|42.14|768.20|58.99|{color:#FF0000}12%{color}-{color:#008000}14%{color}|
|HighTermMonthSort|38.42|2.91|38.63|2.61|{color:#FF0000}12%{color}-{color:#008000}16%{color}|
|PKLookup|93.60|2.29|94.17|2.98|{color:#FF0000}4%{color}-{color:#008000}6%{color}|
|Prefix3|590.01|46.44|593.55|45.92|{color:#FF0000}13%{color}-{color:#008000}17%{color}|
|MedSloppyPhrase|71.29|2.14|72.09|2.32|{color:#FF0000}4%{color}-{color:#008000}7%{color}|
|OrNotHighLow|809.35|41.50|824.71|52.64|{color:#FF0000}9%{color}-{color:#008000}14%{color}|
|MedSpanNear|164.18|8.81|167.48|5.37|{color:#FF0000}6%{color}-{color:#008000}11%{color}|
|HighSloppyPhrase|50.69|2.82|52.10|4.89|{color:#FF0000}11%{color}-{color:#008000}19%{color}|
|Fuzzy1|53.99|3.79|55.50|4.36|{color:#FF0000}11%{color}-{color:#008000}19%{color}|
|LowSpanNear|49.39|2.24|50.91|1.54|{color:#FF0000}4%{color}-{color:#008000}11%{color}|
|OrHighMed|237.07|9.39|245.09|7.45|{color:#FF0000}3%{color}-{color:#008000}10%{color}|
|HighSpanNear|50.02|3.13|51.90|2.96|{color:#FF0000}7%{color}-{color:#008000}16%{color}|
|LowPhrase|611.17|32.61|640.51|36.72|{color:#FF0000}6%{color}-{color:#008000}17%{color}|
|LowSloppyPhrase|135.74|3.89|142.56|6.75|{color:#FF0000}2%{color}-{color:#008000}13%{color}|
|HighIntervalsOrdered|60.29|3.88|63.70|2.32|{color:#FF0000}4%{color}-{color:#008000}17%{color}|
|OrNotHighMed|496.19|29.63|578.53|33.48|{color:#008000}3%{color}-{color:#008000}31%{color}|
|LowTerm|653.60|37.63|821.65|47.13|{color:#008000}12%{color}-{color:#008000}41%{color}|
|MedTerm|656.04|27.84|926.69|40.44|{color:#008000}29%{color}-{color:#008000}53%{color}|
|OrHighNotLow|399.76|23.22|566.34|40.56|{color:#008000}24%{color}-{color:#008000}61%{color}|
|OrNotHighHigh|340.65|17.44|528.36|24.66|{color:#008000}40%{color}-{color:#008000}71%{color}|
|OrHighNotMed|366.37|28.10|604.46|38.21|{color:#008000}43%{color}-{color:#008000}89%{color}|
|HighTerm|438.96|21.03|756.51|34.50|{color:#008000}56%{color}-{color:#008000}89%{color}|
|OrHighLow|340.01|22.05|631.66|31.12|{color:#008000}65%{color}-{color:#008000}108%{color}|
|HighPhrase|24.73|0.89|51.09|3.91|{color:#008000}84%{color}-{color:#008000}130%{color}|
|OrHighNotHigh|337.80|21.14|749.55|50.39|{color:#008000}94%{color}-{color:#008000}152%{color}|
Run with Wikimedium2m with concurrent search:
||Task ('HighSpanNear', None)||P50 Base 8.813157||P50 Cmp 8.123343||Pct Diff
-7.82709306098||P90 Base 9.578886||P90 Cmp 10.519825||Pct Diff
9.82305249274||P99 Base 63.295942||P99 Cmp 12.879954||Pct Diff
-79.6512168189||P999 Base 63.295942||P999 Cmp 12.879954||Pct Diff
-79.6512168189||P100 Base 441.961583||P100 Cmp 398.916664||Pct Diff
-9.7395159796||
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 25.520102||P50 Cmp
25.708815||Pct Diff 0.739468047581||P90 Base 31.369428||P90 Cmp 31.892711||Pct
Diff 1.66813051229||P99 Base 47.191478||P99 Cmp 48.001516||Pct Diff
1.7164921175||P999 Base 47.191478||P999 Cmp 48.001516||Pct Diff
1.7164921175||P100 Base 199.751539||P100 Cmp 285.152603||Pct Diff 42.753645067||
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 9.256266||P50 Cmp
10.480745||Pct Diff 13.228649652||P90 Base 103.768693||P90 Cmp 54.062236||Pct
Diff -47.9012075444||P99 Base 124.004027||P99 Cmp 100.174965||Pct Diff
-19.216361417||P999 Base 124.004027||P999 Cmp 100.174965||Pct Diff
-19.216361417||P100 Base 252.900443||P100 Cmp 270.168526||Pct Diff
6.82801611383||
||Task ('HighTerm', None)||P50 Base 2.011595||P50 Cmp 1.352258||Pct Diff
-32.7768263492||P90 Base 2.912031||P90 Cmp 2.306147||Pct Diff
-20.806234549||P99 Base 24.686838||P99 Cmp 28.123986||Pct Diff
13.922998158||P999 Base 24.686838||P999 Cmp 28.123986||Pct Diff
13.922998158||P100 Base 26.822225||P100 Cmp 31.580883||Pct Diff 17.7414737219||
||Task ('LowTerm', None)||P50 Base 1.178432||P50 Cmp 1.157976||Pct Diff
-1.73586596426||P90 Base 41.586041||P90 Cmp 9.090624||Pct Diff
-78.1402033437||P99 Base 49.374688||P99 Cmp 9.641412||Pct Diff
-80.4729662292||P999 Base 49.374688||P999 Cmp 9.641412||Pct Diff
-80.4729662292||P100 Base 107.195484||P100 Cmp 104.543067||Pct Diff
-2.47437382717||
||Task ('AndHighLow', None)||P50 Base 1.175334||P50 Cmp 1.257495||Pct Diff
6.9904384626||P90 Base 2.445409||P90 Cmp 2.606558||Pct Diff 6.58985879254||P99
Base 4.324788||P99 Cmp 4.17237||Pct Diff -3.52428835818||P999 Base
4.324788||P999 Cmp 4.17237||Pct Diff -3.52428835818||P100 Base 7.812082||P100
Cmp 6.899342||Pct Diff -11.6836971245||
||Task ('MedTerm', None)||P50 Base 1.708915||P50 Cmp 1.266041||Pct Diff
-25.915507793||P90 Base 3.175119||P90 Cmp 1.979174||Pct Diff
-37.6661473161||P99 Base 3.182974||P99 Cmp 2.598911||Pct Diff
-18.349600091||P999 Base 3.182974||P999 Cmp 2.598911||Pct Diff
-18.349600091||P100 Base 7.557294||P100 Cmp 3.237533||Pct Diff -57.1601554736||
||Task ('Prefix3', None)||P50 Base 1.29982||P50 Cmp 1.337177||Pct Diff
2.87401332492||P90 Base 6.38432||P90 Cmp 6.367103||Pct Diff
-0.269676332013||P99 Base 16.46575||P99 Cmp 35.422007||Pct Diff
115.125378437||P999 Base 16.46575||P999 Cmp 35.422007||Pct Diff
115.125378437||P100 Base 40.891181||P100 Cmp 43.82821||Pct Diff 7.18254872609||
||Task ('LowSloppyPhrase', None)||P50 Base 6.431493||P50 Cmp 5.369896||Pct Diff
-16.50622958||P90 Base 13.292756||P90 Cmp 10.359546||Pct Diff
-22.0662291552||P99 Base 14.74504||P99 Cmp 11.461787||Pct Diff
-22.2668300662||P999 Base 14.74504||P999 Cmp 11.461787||Pct Diff
-22.2668300662||P100 Base 72.746205||P100 Cmp 70.734906||Pct Diff
-2.76481639145||
||Task ('Wildcard', None)||P50 Base 1.43662||P50 Cmp 1.398856||Pct Diff
-2.62867007281||P90 Base 7.579543||P90 Cmp 7.291776||Pct Diff
-3.79662731645||P99 Base 101.29012||P99 Cmp 92.121979||Pct Diff
-9.05136749764||P999 Base 101.29012||P999 Cmp 92.121979||Pct Diff
-9.05136749764||P100 Base 212.597658||P100 Cmp 213.29882||Pct Diff
0.329807019793||
||Task ('HighSloppyPhrase', None)||P50 Base 5.699683||P50 Cmp 6.198641||Pct
Diff 8.75413597563||P90 Base 7.820096||P90 Cmp 7.52444||Pct Diff
-3.78072085049||P99 Base 10.078942||P99 Cmp 7.993736||Pct Diff
-20.6887389569||P999 Base 10.078942||P999 Cmp 7.993736||Pct Diff
-20.6887389569||P100 Base 131.69683||P100 Cmp 69.521661||Pct Diff
-47.210831878||
||Task ('HighIntervalsOrdered', None)||P50 Base 41.562004||P50 Cmp
44.43864||Pct Diff 6.92131207148||P90 Base 49.811002||P90 Cmp 51.517051||Pct
Diff 3.42504453133||P99 Base 50.919986||P99 Cmp 51.783454||Pct Diff
1.69573495169||P999 Base 50.919986||P999 Cmp 51.783454||Pct Diff
1.69573495169||P100 Base 124.675493||P100 Cmp 124.867464||Pct Diff
0.153976531699||
||Task ('IntNRQ', None)||P50 Base 1.763593||P50 Cmp 1.84301||Pct Diff
4.50313649464||P90 Base 18.185218||P90 Cmp 17.796579||Pct Diff
-2.13711488089||P99 Base 59.879538||P99 Cmp 58.382585||Pct Diff
-2.49994079781||P999 Base 59.879538||P999 Cmp 58.382585||Pct Diff
-2.49994079781||P100 Base 72.118167||P100 Cmp 71.901802||Pct Diff
-0.300014558052||
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.132964||P50 Cmp
0.110594||Pct Diff -16.8241027647||P90 Base 0.176984||P90 Cmp 0.156555||Pct
Diff -11.5428513312||P99 Base 0.186092||P99 Cmp 0.240541||Pct Diff
29.2591836296||P999 Base 0.186092||P999 Cmp 0.240541||Pct Diff
29.2591836296||P100 Base 1.234188||P100 Cmp 1.101133||Pct Diff -10.7807724593||
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.120671||P50 Cmp
0.110937||Pct Diff -8.06656114559||P90 Base 0.181042||P90 Cmp 0.15327||Pct Diff
-15.3400868307||P99 Base 13.585576||P99 Cmp 13.492223||Pct Diff
-0.687147898624||P999 Base 13.585576||P999 Cmp 13.492223||Pct Diff
-0.687147898624||P100 Base 17.780386||P100 Cmp 17.488324||Pct Diff
-1.64260775891||
||Task ('HighTermMonthSort', 'Month')||P50 Base 7.876089||P50 Cmp 9.126057||Pct
Diff 15.8704148722||P90 Base 10.061729||P90 Cmp 16.56249||Pct Diff
64.6087864223||P99 Base 11.327679||P99 Cmp 16.726095||Pct Diff
47.6568589205||P999 Base 11.327679||P999 Cmp 16.726095||Pct Diff
47.6568589205||P100 Base 14.626743||P100 Cmp 21.083184||Pct Diff 44.1413443854||
||Task Respell||P50 Base 12.666815||P50 Cmp 12.290712||Pct Diff
-2.96919943964||P90 Base 127.719823||P90 Cmp 129.605893||Pct Diff
1.47672456452||P99 Base 172.140849||P99 Cmp 204.631585||Pct Diff
18.8745066547||P999 Base 172.140849||P999 Cmp 204.631585||Pct Diff
18.8745066547||P100 Base 267.965769||P100 Cmp 271.395418||Pct Diff
1.27988325255||
||Task ('HighPhrase', None)||P50 Base 3.955844||P50 Cmp 4.312118||Pct Diff
9.00627021692||P90 Base 11.932968||P90 Cmp 12.988844||Pct Diff
8.8483937944||P99 Base 57.869633||P99 Cmp 50.958381||Pct Diff
-11.9427956282||P999 Base 57.869633||P999 Cmp 50.958381||Pct Diff
-11.9427956282||P100 Base 159.308688||P100 Cmp 207.099636||Pct Diff
29.9989590022||
||Task ('MedPhrase', None)||P50 Base 1.509789||P50 Cmp 1.401743||Pct Diff
-7.15636423368||P90 Base 3.99065||P90 Cmp 7.959375||Pct Diff 99.4505907559||P99
Base 10.255495||P99 Cmp 9.685884||Pct Diff -5.55420289318||P999 Base
10.255495||P999 Cmp 9.685884||Pct Diff -5.55420289318||P100 Base
35.104429||P100 Cmp 19.761119||Pct Diff -43.7076187737||
||Task ('LowPhrase', None)||P50 Base 2.034111||P50 Cmp 1.797256||Pct Diff
-11.644153146||P90 Base 5.164741||P90 Cmp 6.12666||Pct Diff 18.6247287134||P99
Base 6.134577||P99 Cmp 7.785578||Pct Diff 26.9130373618||P999 Base
6.134577||P999 Cmp 7.785578||Pct Diff 26.9130373618||P100 Base 119.704217||P100
Cmp 73.071102||Pct Diff -38.9569525358||
||Task ('MedSpanNear', None)||P50 Base 1.624244||P50 Cmp 1.599929||Pct Diff
-1.4970041447||P90 Base 3.135791||P90 Cmp 6.816385||Pct Diff 117.37370252||P99
Base 14.787226||P99 Cmp 15.847319||Pct Diff 7.1689781437||P999 Base
14.787226||P999 Cmp 15.847319||Pct Diff 7.1689781437||P100 Base 58.513403||P100
Cmp 42.06028||Pct Diff -28.118554308||
||Task ('Fuzzy2', None)||P50 Base 24.42392||P50 Cmp 21.670018||Pct Diff
-11.2754299883||P90 Base 119.884834||P90 Cmp 104.942901||Pct Diff
-12.4635723314||P99 Base 243.400751||P99 Cmp 105.750276||Pct Diff
-56.5530198385||P999 Base 243.400751||P999 Cmp 105.750276||Pct Diff
-56.5530198385||P100 Base 778.583117||P100 Cmp 834.553161||Pct Diff
7.18870506924||
||Task ('AndHighMed', None)||P50 Base 1.358098||P50 Cmp 1.339465||Pct Diff
-1.371992301||P90 Base 5.609091||P90 Cmp 6.249786||Pct Diff 11.4224390369||P99
Base 11.319551||P99 Cmp 12.125497||Pct Diff 7.11994671873||P999 Base
11.319551||P999 Cmp 12.125497||Pct Diff 7.11994671873||P100 Base
18.877632||P100 Cmp 19.212408||Pct Diff 1.77340039259||
||Task ('AndHighHigh', None)||P50 Base 2.184449||P50 Cmp 1.821678||Pct Diff
-16.606979609||P90 Base 11.381647||P90 Cmp 14.089114||Pct Diff
23.7880071311||P99 Base 16.217725||P99 Cmp 24.813664||Pct Diff
53.0033589791||P999 Base 16.217725||P999 Cmp 24.813664||Pct Diff
53.0033589791||P100 Base 78.350548||P100 Cmp 69.636808||Pct Diff -11.121479329||
||Task ('MedSloppyPhrase', None)||P50 Base 3.976319||P50 Cmp 3.840908||Pct Diff
-3.40543603267||P90 Base 11.635151||P90 Cmp 5.471669||Pct Diff
-52.9729437976||P99 Base 40.329324||P99 Cmp 12.591182||Pct Diff
-68.7790898751||P999 Base 40.329324||P999 Cmp 12.591182||Pct Diff
-68.7790898751||P100 Base 53.395788||P100 Cmp 77.379705||Pct Diff 44.917245158||
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 23.655945||P50 Cmp
23.594373||Pct Diff -0.26028129504||P90 Base 24.654877||P90 Cmp 27.782082||Pct
Diff 12.6839205079||P99 Base 42.1597||P99 Cmp 45.571178||Pct Diff
8.09179856593||P999 Base 42.1597||P999 Cmp 45.571178||Pct Diff
8.09179856593||P100 Base 81.179751||P100 Cmp 79.151185||Pct Diff
-2.49885713495||
||Task ('LowSpanNear', None)||P50 Base 1.635838||P50 Cmp 1.583422||Pct Diff
-3.20422926965||P90 Base 2.22724||P90 Cmp 1.915652||Pct Diff
-13.9898708716||P99 Base 2.430474||P99 Cmp 2.915627||Pct Diff
19.9612503569||P999 Base 2.430474||P999 Cmp 2.915627||Pct Diff
19.9612503569||P100 Base 5.30635||P100 Cmp 5.950495||Pct Diff 12.1391351871||
||Task ('OrHighLow', None)||P50 Base 2.460173||P50 Cmp 1.580869||Pct Diff
-35.7415515088||P90 Base 4.157541||P90 Cmp 6.689259||Pct Diff
60.8946009191||P99 Base 4.210433||P99 Cmp 7.051428||Pct Diff
67.4751266675||P999 Base 4.210433||P999 Cmp 7.051428||Pct Diff
67.4751266675||P100 Base 35.64555||P100 Cmp 35.677192||Pct Diff
0.0887684437468||
||Task PKLookup||P50 Base 8.758861||P50 Cmp 8.963258||Pct Diff
2.33360250836||P90 Base 72.762364||P90 Cmp 11.850024||Pct Diff
-83.7140750402||P99 Base 249.586286||P99 Cmp 55.412309||Pct Diff
-77.7983358429||P999 Base 249.586286||P999 Cmp 55.412309||Pct Diff
-77.7983358429||P100 Base 289.773601||P100 Cmp 239.77105||Pct Diff
-17.2557302761||
||Task ('OrHighHigh', None)||P50 Base 4.311043||P50 Cmp 5.657138||Pct Diff
31.2243464053||P90 Base 12.038243||P90 Cmp 32.801629||Pct Diff
172.478541927||P99 Base 29.549851||P99 Cmp 49.223917||Pct Diff
66.5792392659||P999 Base 29.549851||P999 Cmp 49.223917||Pct Diff
66.5792392659||P100 Base 114.887852||P100 Cmp 163.752464||Pct Diff
42.5324445965||
||Task ('Fuzzy1', None)||P50 Base 12.119345||P50 Cmp 11.915585||Pct Diff
-1.68127898001||P90 Base 32.879032||P90 Cmp 74.053052||Pct Diff
125.228808439||P99 Base 64.835785||P99 Cmp 76.170727||Pct Diff
17.4825399276||P999 Base 64.835785||P999 Cmp 76.170727||Pct Diff
17.4825399276||P100 Base 67.30084||P100 Cmp 193.730038||Pct Diff 187.856790495||
||Task ('BrowseDateTaxoFacets', None)||P50 Base 81.977097||P50 Cmp
83.168023||Pct Diff 1.45275454192||P90 Base 85.492791||P90 Cmp 86.264531||Pct
Diff 0.902695994566||P99 Base 86.187931||P99 Cmp 86.302465||Pct Diff
0.132888675562||P999 Base 86.187931||P999 Cmp 86.302465||Pct Diff
0.132888675562||P100 Base 199.23214||P100 Cmp 203.608695||Pct Diff
2.19671133382||
||Task ('OrHighMed', None)||P50 Base 2.317957||P50 Cmp 2.296451||Pct Diff
-0.927799782308||P90 Base 4.418174||P90 Cmp 9.962049||Pct Diff
125.478874304||P99 Base 8.427864||P99 Cmp 36.240266||Pct Diff
330.005348924||P999 Base 8.427864||P999 Cmp 36.240266||Pct Diff
330.005348924||P100 Base 356.200849||P100 Cmp 379.720121||Pct Diff
6.60281188718||
QPS:
||Task||QPS baseline||StdDev baseline||QPS my_modified_version||StdDev
my_modified_version||Pct diff||
|IntNRQ|634.20|49.89|610.28|73.85|{color:#FF0000}21%{color}-{color:#008000}17%{color}|
|Fuzzy1|93.02|7.45|91.55|6.72|{color:#FF0000}15%{color}-{color:#008000}14%{color}|
|OrHighHigh|210.69|18.83|208.57|19.23|{color:#FF0000}17%{color}-{color:#008000}18%{color}|
|BrowseMonthTaxoFacets|8914.10|553.44|8831.09|599.95|{color:#FF0000}13%{color}-{color:#008000}12%{color}|
|HighTermMonthSort|122.28|7.07|121.27|7.54|{color:#FF0000}12%{color}-{color:#008000}11%{color}|
|HighTermDayOfYearSort|114.44|9.44|113.96|9.31|{color:#FF0000}15%{color}-{color:#008000}17%{color}|
|Wildcard|725.01|24.53|723.07|37.36|{color:#FF0000}8%{color}-{color:#008000}8%{color}|
|MedSloppyPhrase|266.76|13.46|266.24|12.45|{color:#FF0000}9%{color}-{color:#008000}10%{color}|
|BrowseDayOfYearSSDVFacets|39.12|0.33|39.07|0.34|{color:#FF0000}1%{color}-{color:#008000}1%{color}|
|LowSpanNear|630.75|19.80|630.39|18.96|{color:#FF0000}6%{color}-{color:#008000}6%{color}|
|BrowseMonthSSDVFacets|43.17|0.54|43.15|0.54|{color:#FF0000}2%{color}-{color:#008000}2%{color}|
|PKLookup|120.74|4.80|120.71|3.86|{color:#FF0000}6%{color}-{color:#008000}7%{color}|
|HighIntervalsOrdered|25.98|2.82|26.01|2.64|{color:#FF0000}18%{color}-{color:#008000}23%{color}|
|HighPhrase|273.22|11.19|273.52|14.59|{color:#FF0000}8%{color}-{color:#008000}9%{color}|
|Respell|82.32|2.83|82.82|2.22|{color:#FF0000}5%{color}-{color:#008000}6%{color}|
|Prefix3|755.12|31.75|759.80|20.51|{color:#FF0000}6%{color}-{color:#008000}7%{color}|
|MedSpanNear|671.02|25.27|676.06|27.56|{color:#FF0000}6%{color}-{color:#008000}8%{color}|
|HighSpanNear|118.46|4.26|119.38|5.62|{color:#FF0000}7%{color}-{color:#008000}9%{color}|
|LowSloppyPhrase|185.47|16.48|187.08|12.79|{color:#FF0000}13%{color}-{color:#008000}18%{color}|
|BrowseDayOfYearTaxoFacets|8713.10|644.34|8794.23|487.72|{color:#FF0000}11%{color}-{color:#008000}15%{color}|
|HighSloppyPhrase|177.33|11.39|179.01|13.07|{color:#FF0000}12%{color}-{color:#008000}15%{color}|
|BrowseDateTaxoFacets|11.77|0.47|11.90|0.46|{color:#FF0000}6%{color}-{color:#008000}9%{color}|
|AndHighMed|739.72|20.80|749.20|23.26|{color:#FF0000}4%{color}-{color:#008000}7%{color}|
|AndHighLow|838.36|31.47|855.47|38.50|{color:#FF0000}6%{color}-{color:#008000}10%{color}|
|MedPhrase|693.35|23.65|708.94|18.07|{color:#FF0000}3%{color}-{color:#008000}8%{color}|
|Fuzzy2|46.43|4.15|48.16|3.66|{color:#FF0000}12%{color}-{color:#008000}22%{color}|
|LowPhrase|519.19|17.80|551.91|17.50|{color:#008000}0%{color}-{color:#008000}13%{color}|
|OrHighMed|446.15|24.14|476.92|29.44|{color:#FF0000}4%{color}-{color:#008000}19%{color}|
|LowTerm|902.82|47.70|1015.81|66.84|{color:#008000}0%{color}-{color:#008000}26%{color}|
|AndHighHigh|496.25|15.46|574.08|20.11|{color:#008000}8%{color}-{color:#008000}23%{color}|
|MedTerm|584.69|40.68|842.87|54.96|{color:#008000}25%{color}-{color:#008000}65%{color}|
|HighTerm|515.25|34.37|775.63|44.06|{color:#008000}33%{color}-{color:#008000}70%{color}|
|OrHighLow|388.97|27.41|688.27|37.64|{color:#008000}56%{color}-{color:#008000}100%{color}|
> "Max Bottom" Based Early Termination For Concurrent Search
> ----------------------------------------------------------
>
> Key: LUCENE-8978
> URL: https://issues.apache.org/jira/browse/LUCENE-8978
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Atri Sharma
> Assignee: Atri Sharma
> Priority: Major
> Time Spent: 5h 50m
> Remaining Estimate: 0h
>
> When running a search concurrently, collectors which have collected the
> number of hits requested locally i.e. their local priority queue is full can
> then globally publish their bottom hit's score, and other collectors can then
> use that score as the filter. If multiple collectors have full priority
> queues, the maximum of all bottom scores will be considered as the global
> bottom score.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
