gf2121 commented on PR #14935: URL: https://github.com/apache/lucene/pull/14935#issuecomment-3065989475
The luceneutil result sounds too good to be true for me, so i rechecked and found that this new branch contains https://github.com/apache/lucene/pull/14906 while baseline not, so the previous compare is unfair. Here is the correct one, sorry for the noise! ``` TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value CountFilteredPhrase 12.56 (1.1%) 12.57 (1.3%) 0.1% ( -2% - 2%) 0.833 Fuzzy1 35.40 (2.0%) 35.44 (2.4%) 0.1% ( -4% - 4%) 0.886 IntSet 159.97 (5.4%) 160.21 (5.4%) 0.2% ( -10% - 11%) 0.929 FilteredOrStopWords 12.18 (2.2%) 12.20 (1.7%) 0.2% ( -3% - 4%) 0.798 Fuzzy2 32.34 (2.0%) 32.40 (2.3%) 0.2% ( -4% - 4%) 0.798 FilteredAndStopWords 14.12 (1.8%) 14.15 (1.9%) 0.2% ( -3% - 3%) 0.692 CountFilteredOrHighMed 33.44 (0.8%) 33.53 (0.7%) 0.3% ( -1% - 1%) 0.249 CountOrHighHigh 65.91 (1.0%) 66.11 (1.3%) 0.3% ( -2% - 2%) 0.416 CountFilteredIntNRQ 25.03 (1.0%) 25.11 (1.0%) 0.3% ( -1% - 2%) 0.334 FilteredOrHighHigh 18.82 (1.7%) 18.89 (1.8%) 0.4% ( -3% - 3%) 0.511 CountFilteredOrHighHigh 28.01 (0.8%) 28.12 (0.7%) 0.4% ( -1% - 1%) 0.076 Phrase 10.22 (2.4%) 10.27 (2.5%) 0.5% ( -4% - 5%) 0.538 CountAndHighHigh 65.46 (1.2%) 65.78 (1.4%) 0.5% ( -2% - 3%) 0.227 FilteredPhrase 13.49 (2.1%) 13.55 (2.0%) 0.5% ( -3% - 4%) 0.458 CombinedTerm 17.05 (2.5%) 17.14 (2.6%) 0.5% ( -4% - 5%) 0.513 FilteredAndHighHigh 17.35 (1.4%) 17.44 (1.6%) 0.5% ( -2% - 3%) 0.261 CountAndHighMed 92.88 (1.3%) 93.43 (1.4%) 0.6% ( -2% - 3%) 0.173 FilteredOrHighMed 52.86 (2.4%) 53.17 (2.2%) 0.6% ( -3% - 5%) 0.409 FilteredAnd3Terms 110.52 (2.0%) 111.18 (2.1%) 0.6% ( -3% - 4%) 0.353 IntNRQ 57.31 (1.4%) 57.66 (1.6%) 0.6% ( -2% - 3%) 0.209 CountOrHighMed 97.32 (1.3%) 97.94 (1.5%) 0.6% ( -2% - 3%) 0.142 FilteredIntNRQ 56.84 (1.5%) 57.22 (1.6%) 0.7% ( -2% - 3%) 0.170 CombinedAndHighHigh 8.38 (2.1%) 8.45 (2.1%) 0.8% ( -3% - 5%) 0.254 FilteredAnd2Terms2StopWords 74.22 (3.3%) 74.79 (2.4%) 0.8% ( -4% - 6%) 0.408 FilteredOr3Terms 55.26 (2.2%) 55.72 (1.6%) 0.8% ( -2% - 4%) 0.173 Respell 28.72 (2.1%) 28.97 (2.1%) 0.9% ( -3% - 5%) 0.195 AndHighOrMedMed 21.84 (2.4%) 22.04 (2.2%) 0.9% ( -3% - 5%) 0.227 OrHighRare 121.45 (4.8%) 122.58 (5.1%) 0.9% ( -8% - 11%) 0.555 FilteredTerm 70.79 (1.9%) 71.46 (2.6%) 0.9% ( -3% - 5%) 0.187 And2Terms2StopWords 71.18 (4.5%) 71.85 (3.3%) 0.9% ( -6% - 9%) 0.447 CombinedOrHighHigh 8.22 (3.4%) 8.30 (3.2%) 1.0% ( -5% - 7%) 0.351 AndMedOrHighHigh 23.64 (3.0%) 23.87 (2.0%) 1.0% ( -3% - 6%) 0.216 FilteredAndHighMed 49.01 (2.4%) 49.50 (1.7%) 1.0% ( -3% - 5%) 0.129 FilteredOr2Terms2StopWords 61.95 (2.2%) 62.62 (1.8%) 1.1% ( -2% - 5%) 0.091 Or2Terms2StopWords 73.44 (4.6%) 74.31 (3.0%) 1.2% ( -6% - 9%) 0.331 CombinedAndHighMed 30.40 (2.6%) 30.77 (2.9%) 1.2% ( -4% - 6%) 0.166 FilteredPrefix3 80.79 (3.2%) 81.78 (4.0%) 1.2% ( -5% - 8%) 0.286 TermTitleSort 62.42 (2.5%) 63.18 (3.8%) 1.2% ( -4% - 7%) 0.229 DismaxOrHighMed 60.65 (3.9%) 61.40 (3.4%) 1.2% ( -5% - 8%) 0.286 CombinedOrHighMed 29.75 (3.5%) 30.14 (3.0%) 1.3% ( -4% - 7%) 0.203 TermDayOfYearSort 351.91 (2.8%) 356.71 (3.4%) 1.4% ( -4% - 7%) 0.165 CountTerm 3725.09 (4.9%) 3783.50 (5.3%) 1.6% ( -8% - 12%) 0.330 DismaxTerm 369.05 (3.9%) 374.93 (4.1%) 1.6% ( -6% - 10%) 0.210 Prefix3 86.00 (3.6%) 87.41 (4.5%) 1.6% ( -6% - 10%) 0.201 TermDTSort 208.45 (4.2%) 211.88 (4.6%) 1.6% ( -6% - 10%) 0.240 DismaxOrHighHigh 41.61 (5.3%) 42.32 (3.1%) 1.7% ( -6% - 10%) 0.210 And3Terms 94.46 (5.6%) 96.13 (3.4%) 1.8% ( -6% - 11%) 0.234 TermMonthSort 1553.66 (5.3%) 1581.95 (5.2%) 1.8% ( -8% - 13%) 0.277 Wildcard 51.46 (3.0%) 52.52 (2.9%) 2.1% ( -3% - 8%) 0.027 Or3Terms 84.97 (5.8%) 86.75 (3.4%) 2.1% ( -6% - 12%) 0.164 OrHighMed 91.63 (6.7%) 93.76 (3.0%) 2.3% ( -6% - 12%) 0.159 AndHighMed 76.48 (7.1%) 78.29 (2.9%) 2.4% ( -7% - 13%) 0.165 Term 448.90 (5.1%) 459.66 (4.6%) 2.4% ( -6% - 12%) 0.118 OrHighHigh 31.64 (8.9%) 32.63 (3.2%) 3.1% ( -8% - 16%) 0.135 AndHighHigh 31.54 (9.4%) 33.20 (2.9%) 5.3% ( -6% - 19%) 0.017 AndStopWords 11.89 (7.8%) 12.76 (4.0%) 7.3% ( -4% - 20%) 0.000 OrStopWords 12.40 (8.8%) 13.74 (3.6%) 10.8% ( -1% - 25%) 0.000 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
