jpountz commented on PR #12670: URL: https://github.com/apache/lucene/pull/12670#issuecomment-1761288055
Results on wikibigall. Both the baseline and the contender have #12668. ``` TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value IntNRQ 279.07 (9.5%) 269.35 (6.9%) -3.5% ( -18% - 14%) 0.185 Prefix3 210.18 (3.2%) 207.28 (4.2%) -1.4% ( -8% - 6%) 0.239 CountOrHighMed 87.59 (13.7%) 86.77 (14.3%) -0.9% ( -25% - 31%) 0.832 CountOrHighHigh 56.41 (13.8%) 55.89 (14.6%) -0.9% ( -25% - 31%) 0.836 LowPhrase 23.15 (3.7%) 23.00 (4.2%) -0.7% ( -8% - 7%) 0.598 Wildcard 36.09 (3.7%) 35.90 (3.8%) -0.5% ( -7% - 7%) 0.652 HighTermDayOfYearSort 249.90 (2.0%) 249.63 (1.8%) -0.1% ( -3% - 3%) 0.857 Respell 69.31 (1.8%) 69.38 (2.4%) 0.1% ( -3% - 4%) 0.876 MedPhrase 28.69 (2.4%) 28.73 (3.5%) 0.1% ( -5% - 6%) 0.894 HighPhrase 54.89 (2.8%) 55.06 (3.7%) 0.3% ( -6% - 7%) 0.771 PKLookup 224.50 (2.9%) 226.08 (2.6%) 0.7% ( -4% - 6%) 0.415 CountPhrase 4.40 (3.6%) 4.43 (4.8%) 0.8% ( -7% - 9%) 0.542 Fuzzy2 79.33 (1.8%) 80.04 (1.6%) 0.9% ( -2% - 4%) 0.092 Fuzzy1 116.13 (1.9%) 117.20 (1.7%) 0.9% ( -2% - 4%) 0.106 CountTerm 16592.06 (5.5%) 16762.13 (6.2%) 1.0% ( -10% - 13%) 0.580 HighTerm 377.81 (7.9%) 381.70 (7.1%) 1.0% ( -12% - 17%) 0.665 MedTerm 481.56 (7.2%) 487.41 (6.3%) 1.2% ( -11% - 15%) 0.570 LowTerm 1072.51 (6.8%) 1086.51 (6.0%) 1.3% ( -10% - 15%) 0.522 AndHighLow 996.73 (2.3%) 1013.39 (3.8%) 1.7% ( -4% - 8%) 0.096 CountAndHighHigh 40.50 (3.6%) 41.23 (5.0%) 1.8% ( -6% - 10%) 0.187 HighTermMonthSort 4998.32 (3.8%) 5092.15 (2.2%) 1.9% ( -3% - 8%) 0.056 CountAndHighMed 122.05 (2.8%) 124.41 (4.5%) 1.9% ( -5% - 9%) 0.099 AndHighMed 140.41 (2.8%) 145.21 (4.1%) 3.4% ( -3% - 10%) 0.002 AndHighHigh 51.03 (3.4%) 53.21 (4.6%) 4.3% ( -3% - 12%) 0.001 OrHighMed 183.06 (3.7%) 191.28 (5.0%) 4.5% ( -4% - 13%) 0.001 OrHighLow 598.61 (3.0%) 627.58 (3.7%) 4.8% ( -1% - 11%) 0.000 OrHighHigh 67.20 (6.2%) 71.31 (6.2%) 6.1% ( -5% - 19%) 0.002 ``` Disjunctions see a bigger improvement than conjunctions, which makes sense since they tend to rely more on `nextDoc()` and less on `advance()` compared with conjunctions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org