jpountz commented on PR #13977: URL: https://github.com/apache/lucene/pull/13977#issuecomment-2455325803
Here is the output of luceneutil on wikibigall with `-searchConcurrency 0`. Despite the removal of optimizations for the case when there is no search concurrency, all variations look like noise: ``` TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value LowTerm 987.41 (9.9%) 964.04 (9.5%) -2.4% ( -19% - 18%) 0.441 HighTermTitleSort 138.88 (11.1%) 136.20 (12.3%) -1.9% ( -22% - 24%) 0.602 MedTerm 663.03 (9.5%) 651.84 (9.1%) -1.7% ( -18% - 18%) 0.568 TermDTSort 350.84 (11.6%) 345.28 (13.6%) -1.6% ( -24% - 26%) 0.692 HighTerm 420.03 (9.3%) 413.92 (8.4%) -1.5% ( -17% - 17%) 0.603 HighTermDayOfYearSort 808.94 (9.4%) 798.37 (9.0%) -1.3% ( -18% - 18%) 0.654 PKLookup 258.88 (10.6%) 255.85 (10.6%) -1.2% ( -20% - 22%) 0.727 IntNRQ 183.20 (14.4%) 182.00 (12.9%) -0.7% ( -24% - 31%) 0.879 OrNotHighHigh 265.37 (9.0%) 263.81 (10.3%) -0.6% ( -18% - 20%) 0.848 HighTermTitleBDVSort 15.58 (9.1%) 15.50 (11.6%) -0.5% ( -19% - 22%) 0.876 OrHighNotMed 384.31 (8.9%) 382.57 (10.5%) -0.5% ( -18% - 20%) 0.883 And2Terms2StopWords 155.97 (8.1%) 155.41 (10.9%) -0.4% ( -17% - 20%) 0.906 CountOrHighHigh 72.44 (9.2%) 72.19 (10.4%) -0.3% ( -18% - 21%) 0.911 OrHighNotHigh 274.27 (8.9%) 273.45 (9.2%) -0.3% ( -16% - 19%) 0.916 CountAndHighHigh 55.45 (5.8%) 55.48 (7.6%) 0.0% ( -12% - 14%) 0.984 Fuzzy2 70.44 (8.9%) 70.49 (10.4%) 0.1% ( -17% - 21%) 0.980 OrNotHighMed 416.84 (9.9%) 417.32 (9.8%) 0.1% ( -17% - 21%) 0.970 CountOrHighMed 136.40 (8.2%) 136.67 (8.2%) 0.2% ( -14% - 17%) 0.939 OrMany 18.52 (8.9%) 18.57 (10.7%) 0.3% ( -17% - 21%) 0.928 OrHighHigh 68.65 (9.1%) 68.85 (9.9%) 0.3% ( -17% - 21%) 0.922 Fuzzy1 74.51 (9.9%) 74.84 (10.8%) 0.4% ( -18% - 23%) 0.895 OrNotHighLow 949.97 (9.6%) 955.23 (9.4%) 0.6% ( -16% - 21%) 0.854 OrHighNotLow 506.24 (10.7%) 509.09 (10.7%) 0.6% ( -18% - 24%) 0.868 Wildcard 107.93 (9.3%) 108.58 (10.3%) 0.6% ( -17% - 22%) 0.847 OrHighMed 164.04 (8.8%) 165.21 (9.9%) 0.7% ( -16% - 21%) 0.809 And3Terms 171.04 (9.3%) 172.28 (9.7%) 0.7% ( -16% - 21%) 0.811 Prefix3 110.72 (7.9%) 111.55 (10.8%) 0.7% ( -16% - 21%) 0.802 AndStopWords 31.21 (9.8%) 31.46 (9.1%) 0.8% ( -16% - 21%) 0.788 OrStopWords 35.41 (11.6%) 35.72 (9.8%) 0.9% ( -18% - 25%) 0.797 Or3Terms 172.95 (9.4%) 174.46 (9.3%) 0.9% ( -16% - 21%) 0.767 AndHighLow 968.15 (9.1%) 976.66 (8.9%) 0.9% ( -15% - 20%) 0.758 CountAndHighMed 161.43 (6.3%) 162.95 (6.8%) 0.9% ( -11% - 15%) 0.651 OrHighRare 264.93 (9.3%) 268.08 (9.1%) 1.2% ( -15% - 21%) 0.682 Or2Terms2StopWords 159.11 (9.6%) 161.05 (8.9%) 1.2% ( -15% - 21%) 0.677 AndHighHigh 53.31 (9.4%) 53.98 (9.7%) 1.3% ( -16% - 22%) 0.678 AndHighMed 168.10 (8.9%) 170.24 (9.9%) 1.3% ( -16% - 22%) 0.669 OrHighLow 719.77 (9.5%) 729.34 (8.9%) 1.3% ( -15% - 21%) 0.648 HighTermMonthSort 3003.54 (8.8%) 3046.54 (8.0%) 1.4% ( -14% - 20%) 0.592 CountTerm 7707.72 (10.5%) 7843.15 (10.3%) 1.8% ( -17% - 25%) 0.593 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org