HUSTERGS commented on PR #14896: URL: https://github.com/apache/lucene/pull/14896#issuecomment-3046712346
I want to share the luceneutil result against the latest code: <details> <summary> result </summary> ``` TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value OrStopWords 8.38 (9.8%) 8.15 (4.8%) -2.7% ( -15% - 13%) 0.272 CombinedTerm 11.24 (3.9%) 11.05 (5.1%) -1.7% ( -10% - 7%) 0.235 FilteredPrefix3 71.86 (2.7%) 71.52 (2.9%) -0.5% ( -5% - 5%) 0.594 Prefix3 76.67 (2.9%) 76.31 (2.9%) -0.5% ( -6% - 5%) 0.614 SpanNear 2.52 (3.9%) 2.52 (3.3%) -0.3% ( -7% - 7%) 0.817 Wildcard 47.88 (2.7%) 47.79 (3.4%) -0.2% ( -6% - 6%) 0.847 Phrase 7.76 (2.8%) 7.75 (3.1%) -0.1% ( -5% - 5%) 0.881 TermMonthSort 2436.04 (2.6%) 2438.89 (3.3%) 0.1% ( -5% - 6%) 0.901 CountTerm 7406.29 (3.5%) 7416.13 (3.7%) 0.1% ( -6% - 7%) 0.907 SloppyPhrase 1.14 (5.4%) 1.14 (5.8%) 0.2% ( -10% - 12%) 0.918 OrHighRare 95.84 (5.4%) 96.05 (4.9%) 0.2% ( -9% - 11%) 0.891 CountFilteredOrHighMed 17.98 (0.5%) 18.03 (0.6%) 0.2% ( 0% - 1%) 0.158 IntSet 296.49 (4.0%) 297.26 (4.3%) 0.3% ( -7% - 8%) 0.845 CountFilteredIntNRQ 16.36 (1.0%) 16.42 (1.0%) 0.3% ( -1% - 2%) 0.326 CountFilteredOrHighHigh 15.89 (0.6%) 15.95 (0.7%) 0.4% ( 0% - 1%) 0.065 IntervalsOrdered 2.43 (3.6%) 2.44 (3.3%) 0.4% ( -6% - 7%) 0.696 FilteredPhrase 9.98 (1.9%) 10.03 (2.0%) 0.5% ( -3% - 4%) 0.452 CountPhrase 2.66 (4.8%) 2.67 (4.5%) 0.5% ( -8% - 10%) 0.743 CountAndHighHigh 48.95 (1.7%) 49.26 (2.2%) 0.6% ( -3% - 4%) 0.300 TermTitleSort 51.66 (5.4%) 52.01 (5.9%) 0.7% ( -10% - 12%) 0.697 CountFilteredPhrase 9.07 (2.4%) 9.14 (3.6%) 0.7% ( -5% - 6%) 0.447 FilteredAndStopWords 8.43 (1.9%) 8.50 (2.5%) 0.8% ( -3% - 5%) 0.275 TermDayOfYearSort 271.55 (1.9%) 273.63 (2.5%) 0.8% ( -3% - 5%) 0.277 CountOrHighHigh 50.37 (2.0%) 50.78 (2.5%) 0.8% ( -3% - 5%) 0.264 FilteredTerm 66.33 (2.9%) 66.88 (2.8%) 0.8% ( -4% - 6%) 0.356 CountOrHighMed 77.72 (2.0%) 78.38 (2.1%) 0.9% ( -3% - 4%) 0.182 FilteredAndHighHigh 10.41 (1.9%) 10.51 (2.5%) 0.9% ( -3% - 5%) 0.212 CountAndHighMed 75.17 (2.4%) 75.84 (2.5%) 0.9% ( -3% - 5%) 0.247 CombinedOrHighHigh 5.53 (3.3%) 5.58 (4.0%) 0.9% ( -6% - 8%) 0.442 IntNRQ 42.23 (2.7%) 42.62 (2.8%) 0.9% ( -4% - 6%) 0.288 CountOrMany 5.03 (2.3%) 5.08 (2.9%) 0.9% ( -4% - 6%) 0.261 FilteredIntNRQ 41.95 (2.7%) 42.35 (2.7%) 0.9% ( -4% - 6%) 0.273 FilteredOrStopWords 8.26 (1.6%) 8.34 (1.6%) 1.0% ( -2% - 4%) 0.047 FilteredOrHighHigh 13.22 (1.5%) 13.36 (1.7%) 1.1% ( -2% - 4%) 0.034 CountFilteredOrMany 4.46 (1.9%) 4.51 (2.5%) 1.1% ( -3% - 5%) 0.120 Fuzzy1 40.56 (3.8%) 41.03 (3.5%) 1.2% ( -5% - 8%) 0.319 FilteredOr3Terms 44.37 (2.4%) 44.91 (2.6%) 1.2% ( -3% - 6%) 0.121 Fuzzy2 36.81 (3.3%) 37.27 (3.5%) 1.2% ( -5% - 8%) 0.247 FilteredOrHighMed 39.33 (2.3%) 39.85 (2.9%) 1.3% ( -3% - 6%) 0.106 FilteredOrMany 4.03 (2.8%) 4.09 (2.3%) 1.3% ( -3% - 6%) 0.098 TermDTSort 143.16 (3.4%) 145.47 (4.6%) 1.6% ( -6% - 9%) 0.208 CombinedOrHighMed 20.80 (4.0%) 21.13 (5.2%) 1.6% ( -7% - 11%) 0.267 FilteredOr2Terms2StopWords 50.41 (3.0%) 51.22 (3.7%) 1.6% ( -4% - 8%) 0.128 CombinedAndHighHigh 5.67 (1.9%) 5.77 (2.3%) 1.7% ( -2% - 5%) 0.010 DismaxOrHighHigh 34.94 (5.7%) 35.56 (2.8%) 1.8% ( -6% - 10%) 0.213 Respell 36.11 (3.2%) 36.75 (3.5%) 1.8% ( -4% - 8%) 0.092 DismaxTerm 523.84 (5.8%) 533.26 (2.9%) 1.8% ( -6% - 11%) 0.213 AndMedOrHighHigh 16.66 (3.9%) 16.97 (2.2%) 1.9% ( -4% - 8%) 0.065 FilteredAndHighMed 31.47 (3.2%) 32.12 (2.0%) 2.0% ( -3% - 7%) 0.014 AndStopWords 8.13 (8.8%) 8.30 (3.9%) 2.1% ( -9% - 16%) 0.329 FilteredAnd3Terms 101.09 (3.0%) 103.25 (3.3%) 2.1% ( -4% - 8%) 0.033 CombinedAndHighMed 21.25 (3.1%) 21.71 (4.1%) 2.2% ( -4% - 9%) 0.058 AndHighOrMedMed 14.11 (1.6%) 14.43 (2.3%) 2.3% ( -1% - 6%) 0.000 Term 475.06 (8.0%) 486.72 (4.2%) 2.5% ( -8% - 15%) 0.224 Term1M 474.61 (7.9%) 486.87 (4.1%) 2.6% ( -8% - 15%) 0.195 Term100 474.49 (7.9%) 486.82 (4.1%) 2.6% ( -8% - 15%) 0.194 Term10K 474.11 (7.9%) 486.63 (4.1%) 2.6% ( -8% - 15%) 0.185 TermB1M 474.30 (7.9%) 486.95 (4.2%) 2.7% ( -8% - 16%) 0.182 TermB1M1P 474.36 (7.8%) 487.12 (4.0%) 2.7% ( -8% - 15%) 0.171 DismaxOrHighMed 50.32 (6.0%) 51.78 (3.2%) 2.9% ( -5% - 12%) 0.057 AndHighHigh 20.71 (10.4%) 21.43 (3.6%) 3.5% ( -9% - 19%) 0.156 FilteredAnd2Terms2StopWords 58.48 (5.0%) 60.57 (4.5%) 3.6% ( -5% - 13%) 0.017 Or3Terms 63.26 (8.8%) 65.91 (3.7%) 4.2% ( -7% - 18%) 0.048 OrHighMed 67.43 (9.6%) 70.50 (3.5%) 4.6% ( -7% - 19%) 0.046 OrHighHigh 20.16 (10.3%) 21.10 (2.6%) 4.7% ( -7% - 19%) 0.048 Or2Terms2StopWords 59.67 (7.4%) 62.50 (6.2%) 4.7% ( -8% - 19%) 0.028 And3Terms 69.96 (7.7%) 73.31 (3.4%) 4.8% ( -5% - 17%) 0.011 And2Terms2StopWords 57.56 (7.4%) 60.42 (6.4%) 5.0% ( -8% - 20%) 0.023 AndHighMed 52.50 (9.1%) 55.25 (2.5%) 5.2% ( -5% - 18%) 0.013 OrMany 4.54 (5.2%) 4.79 (5.0%) 5.4% ( -4% - 16%) 0.001 ``` </details> There’s still about a 5% margin for improvement. (I got some problem with previous machine, so there is a overall drop in absolute performance, but the relative percentage differences are still meaningful ) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org