HUSTERGS commented on PR #15081: URL: https://github.com/apache/lucene/pull/15081#issuecomment-3195484311
I'll run the luceneutil to verify again. Here is the result, based on https://github.com/HUSTERGS/lucene/tree/bench_advance, hope I'm not get anything wrong ``` TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value FilteredPrefix3 68.14 (4.6%) 67.56 (5.1%) -0.8% ( -10% - 9%) 0.578 Prefix3 73.02 (5.6%) 72.44 (5.5%) -0.8% ( -11% - 10%) 0.651 AndHighOrMedMed 13.32 (3.5%) 13.25 (4.3%) -0.5% ( -8% - 7%) 0.687 OrHighHigh 17.49 (10.0%) 17.41 (9.4%) -0.5% ( -18% - 21%) 0.882 IntSet 283.49 (4.4%) 282.71 (5.6%) -0.3% ( -9% - 10%) 0.864 OrStopWords 7.97 (8.2%) 7.95 (8.3%) -0.2% ( -15% - 17%) 0.952 TermTitleSort 50.51 (7.6%) 50.46 (8.5%) -0.1% ( -15% - 17%) 0.969 Wildcard 45.77 (4.0%) 45.76 (3.7%) -0.0% ( -7% - 7%) 0.984 IntervalsOrdered 2.39 (4.7%) 2.39 (4.3%) -0.0% ( -8% - 9%) 0.988 CountFilteredOrHighMed 17.72 (1.5%) 17.71 (1.4%) -0.0% ( -2% - 2%) 0.981 CountFilteredOrHighHigh 15.64 (1.8%) 15.64 (1.6%) 0.0% ( -3% - 3%) 0.969 CountAndHighHigh 47.62 (3.2%) 47.64 (2.9%) 0.0% ( -5% - 6%) 0.974 CountPhrase 2.60 (4.5%) 2.61 (4.4%) 0.0% ( -8% - 9%) 0.980 CountAndHighMed 70.08 (3.0%) 70.10 (3.9%) 0.0% ( -6% - 7%) 0.973 CountFilteredIntNRQ 16.20 (1.7%) 16.23 (1.8%) 0.1% ( -3% - 3%) 0.792 FilteredTerm 59.72 (3.7%) 59.85 (3.9%) 0.2% ( -7% - 8%) 0.859 TermDayOfYearSort 247.90 (3.9%) 248.46 (4.5%) 0.2% ( -7% - 8%) 0.866 Phrase 7.22 (3.4%) 7.24 (3.6%) 0.2% ( -6% - 7%) 0.827 CombinedTerm 10.65 (5.7%) 10.68 (4.9%) 0.2% ( -9% - 11%) 0.884 CountOrHighMed 70.80 (2.4%) 71.00 (2.8%) 0.3% ( -4% - 5%) 0.724 FilteredIntNRQ 41.43 (3.1%) 41.56 (3.3%) 0.3% ( -5% - 6%) 0.752 TermMonthSort 2008.62 (5.9%) 2015.27 (6.0%) 0.3% ( -10% - 12%) 0.860 CountOrHighHigh 48.55 (3.3%) 48.73 (2.4%) 0.4% ( -5% - 6%) 0.686 CountOrMany 4.70 (4.7%) 4.72 (4.0%) 0.4% ( -7% - 9%) 0.776 FilteredAndStopWords 8.13 (3.1%) 8.17 (3.1%) 0.4% ( -5% - 6%) 0.689 OrHighMed 55.43 (10.6%) 55.65 (10.4%) 0.4% ( -18% - 23%) 0.904 FilteredPhrase 9.16 (4.0%) 9.20 (3.8%) 0.4% ( -7% - 8%) 0.733 IntNRQ 41.73 (3.2%) 41.91 (3.4%) 0.4% ( -5% - 7%) 0.682 SloppyPhrase 1.08 (6.6%) 1.09 (6.4%) 0.5% ( -11% - 14%) 0.815 CountFilteredOrMany 4.19 (4.4%) 4.21 (3.6%) 0.5% ( -7% - 8%) 0.699 FilteredAndHighHigh 10.13 (2.8%) 10.19 (3.0%) 0.6% ( -5% - 6%) 0.542 TermDTSort 134.03 (4.0%) 134.79 (4.6%) 0.6% ( -7% - 9%) 0.679 FilteredOrMany 3.79 (2.7%) 3.82 (3.8%) 0.6% ( -5% - 7%) 0.573 SpanNear 2.41 (6.7%) 2.42 (6.9%) 0.6% ( -12% - 15%) 0.775 Respell 34.21 (2.9%) 34.43 (3.4%) 0.6% ( -5% - 7%) 0.521 DismaxTerm 443.25 (7.0%) 446.24 (6.8%) 0.7% ( -12% - 15%) 0.757 CountFilteredPhrase 8.47 (3.5%) 8.53 (3.3%) 0.7% ( -5% - 7%) 0.502 FilteredOrHighHigh 12.14 (2.8%) 12.23 (3.7%) 0.7% ( -5% - 7%) 0.481 FilteredOr3Terms 40.17 (3.0%) 40.47 (4.2%) 0.7% ( -6% - 8%) 0.514 FilteredOrStopWords 7.72 (2.9%) 7.78 (3.4%) 0.8% ( -5% - 7%) 0.431 Fuzzy2 33.07 (4.4%) 33.34 (4.9%) 0.8% ( -8% - 10%) 0.588 FilteredAnd3Terms 97.61 (3.3%) 98.40 (4.3%) 0.8% ( -6% - 8%) 0.510 CombinedAndHighHigh 5.51 (4.6%) 5.55 (4.2%) 0.8% ( -7% - 10%) 0.548 DismaxOrHighMed 43.24 (7.7%) 43.61 (7.8%) 0.8% ( -13% - 17%) 0.729 CombinedOrHighHigh 5.39 (5.6%) 5.44 (4.8%) 0.9% ( -9% - 12%) 0.595 Or2Terms2StopWords 50.73 (8.5%) 51.20 (8.7%) 0.9% ( -14% - 19%) 0.734 Term10K 397.11 (8.3%) 400.79 (6.8%) 0.9% ( -13% - 17%) 0.700 CombinedOrHighMed 18.74 (6.0%) 18.92 (4.6%) 0.9% ( -9% - 12%) 0.579 FilteredOrHighMed 35.39 (3.6%) 35.72 (4.2%) 0.9% ( -6% - 8%) 0.439 FilteredOr2Terms2StopWords 44.69 (4.0%) 45.12 (5.2%) 1.0% ( -7% - 10%) 0.507 Or3Terms 56.27 (9.1%) 56.84 (9.2%) 1.0% ( -15% - 21%) 0.728 CombinedAndHighMed 19.12 (4.5%) 19.31 (5.0%) 1.0% ( -8% - 11%) 0.499 Term1M 397.05 (8.7%) 401.40 (6.3%) 1.1% ( -12% - 17%) 0.650 OrMany 3.96 (6.2%) 4.00 (6.8%) 1.1% ( -11% - 15%) 0.594 AndMedOrHighHigh 15.22 (4.8%) 15.39 (4.1%) 1.1% ( -7% - 10%) 0.436 TermB1M 396.44 (8.8%) 400.87 (6.6%) 1.1% ( -13% - 18%) 0.648 TermB1M1P 397.07 (8.5%) 401.57 (6.2%) 1.1% ( -12% - 17%) 0.630 Fuzzy1 36.35 (5.0%) 36.78 (5.0%) 1.2% ( -8% - 11%) 0.460 Term 396.76 (8.6%) 401.50 (6.9%) 1.2% ( -13% - 18%) 0.626 Term100 396.43 (8.5%) 401.41 (6.5%) 1.3% ( -12% - 17%) 0.601 DismaxOrHighHigh 31.12 (6.2%) 31.52 (6.2%) 1.3% ( -10% - 14%) 0.514 FilteredAndHighMed 29.61 (4.3%) 30.08 (3.2%) 1.6% ( -5% - 9%) 0.186 FilteredAnd2Terms2StopWords 53.17 (6.1%) 54.30 (5.6%) 2.1% ( -9% - 14%) 0.251 And3Terms 63.65 (8.5%) 65.18 (5.3%) 2.4% ( -10% - 17%) 0.281 And2Terms2StopWords 49.84 (8.0%) 51.06 (6.9%) 2.4% ( -11% - 18%) 0.303 CountTerm 5207.97 (7.6%) 5340.28 (7.6%) 2.5% ( -11% - 19%) 0.291 AndStopWords 7.95 (8.7%) 8.18 (5.4%) 2.8% ( -10% - 18%) 0.215 OrHighRare 89.54 (6.2%) 92.12 (4.0%) 2.9% ( -6% - 13%) 0.080 AndHighMed 46.21 (10.0%) 47.59 (6.5%) 3.0% ( -12% - 21%) 0.262 AndHighHigh 18.84 (10.6%) 19.47 (7.5%) 3.4% ( -13% - 24%) 0.246 WARNING: cat=CombinedAndHighHigh: hit counts differ: 231389+ vs 231396+ WARNING: cat=CombinedOrHighHigh: hit counts differ: 256699+ vs 256705+ WARNING: cat=CombinedOrHighMed: hit counts differ: 71326+ vs 71325+ WARNING: cat=DismaxOrHighHigh: hit counts differ: 144527+ vs 144388+ WARNING: cat=FilteredAndHighHigh: hit counts differ: 53017+ vs 53016+ WARNING: cat=FilteredAndHighMed: hit counts differ: 12420+ vs 12419+ WARNING: cat=Fuzzy1: hit counts differ: 11814+ vs 11813+ WARNING: cat=Or3Terms: hit counts differ: 32433+ vs 32418+ WARNING: cat=OrHighMed: hit counts differ: 43152+ vs 43139+ ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
