slow-J commented on PR #12741: URL: https://github.com/apache/lucene/pull/12741#issuecomment-1807962044
I ran a new luceneutil benchmark on Saturday with my commit https://github.com/apache/lucene/commit/8ae598bae593e1faa4ff82a87f4cd45f120f1059 (using Lucene99PostingsFormat) as candidate and the commit's parent as baseline (using Lucene90PostingsFormat). Other benchmark variables for transparency: * Java 19 * Ec2 instance: `m5.12xlarge`. * Disabled JFR ``` TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value BrowseMonthTaxoFacets 3.98 (6.7%) 3.92 (2.3%) -1.7% ( -9% - 7%) 0.286 BrowseDayOfYearSSDVFacets 3.29 (1.6%) 3.27 (1.1%) -0.7% ( -3% - 2%) 0.126 BrowseDateSSDVFacets 1.01 (4.8%) 1.00 (5.6%) -0.6% ( -10% - 10%) 0.695 PKLookup 151.00 (2.5%) 150.26 (2.6%) -0.5% ( -5% - 4%) 0.543 BrowseMonthSSDVFacets 3.44 (1.6%) 3.43 (1.5%) -0.5% ( -3% - 2%) 0.321 LowTerm 345.74 (3.0%) 344.39 (3.1%) -0.4% ( -6% - 5%) 0.689 Wildcard 142.48 (1.9%) 142.00 (1.8%) -0.3% ( -3% - 3%) 0.569 Prefix3 1056.96 (4.0%) 1054.07 (3.2%) -0.3% ( -7% - 7%) 0.812 BrowseRandomLabelSSDVFacets 2.55 (7.2%) 2.54 (7.2%) -0.1% ( -13% - 15%) 0.975 BrowseDayOfYearTaxoFacets 3.96 (0.7%) 3.96 (0.7%) -0.0% ( -1% - 1%) 0.856 BrowseDateTaxoFacets 3.94 (0.7%) 3.94 (0.7%) -0.0% ( -1% - 1%) 0.912 BrowseRandomLabelTaxoFacets 3.41 (0.8%) 3.41 (0.9%) -0.0% ( -1% - 1%) 0.977 Fuzzy1 69.71 (0.9%) 69.74 (0.8%) 0.0% ( -1% - 1%) 0.902 OrHighNotHigh 205.50 (4.6%) 205.67 (5.3%) 0.1% ( -9% - 10%) 0.958 Fuzzy2 58.39 (0.8%) 58.44 (0.6%) 0.1% ( -1% - 1%) 0.688 OrHighNotLow 265.57 (5.4%) 266.05 (5.9%) 0.2% ( -10% - 12%) 0.921 HighIntervalsOrdered 5.32 (4.5%) 5.33 (4.1%) 0.2% ( -8% - 9%) 0.879 HighTermTitleBDVSort 7.81 (3.1%) 7.83 (2.7%) 0.3% ( -5% - 6%) 0.756 Respell 34.00 (1.3%) 34.10 (1.1%) 0.3% ( -2% - 2%) 0.451 MedTermDayTaxoFacets 16.00 (3.8%) 16.04 (3.8%) 0.3% ( -7% - 8%) 0.801 OrHighNotMed 255.88 (5.0%) 257.07 (5.2%) 0.5% ( -9% - 11%) 0.774 AndHighHighDayTaxoFacets 2.83 (3.5%) 2.84 (3.4%) 0.5% ( -6% - 7%) 0.658 MedTerm 374.43 (4.9%) 376.51 (5.6%) 0.6% ( -9% - 11%) 0.738 HighTerm 472.29 (4.8%) 474.92 (5.7%) 0.6% ( -9% - 11%) 0.738 MedSpanNear 5.01 (4.3%) 5.04 (4.6%) 0.6% ( -7% - 9%) 0.690 HighTermMonthSort 2670.49 (4.1%) 2689.05 (3.1%) 0.7% ( -6% - 8%) 0.549 LowIntervalsOrdered 6.65 (4.2%) 6.70 (4.3%) 0.7% ( -7% - 9%) 0.584 OrHighHigh 22.54 (1.2%) 22.71 (2.4%) 0.7% ( -2% - 4%) 0.204 OrHighMedDayTaxoFacets 1.58 (4.6%) 1.59 (3.5%) 0.8% ( -6% - 9%) 0.523 IntNRQ 27.99 (2.4%) 28.25 (3.9%) 0.9% ( -5% - 7%) 0.371 OrNotHighHigh 244.47 (3.7%) 246.97 (4.5%) 1.0% ( -6% - 9%) 0.432 MedIntervalsOrdered 3.14 (3.7%) 3.18 (3.9%) 1.0% ( -6% - 9%) 0.391 OrHighMed 43.19 (1.3%) 43.65 (1.7%) 1.1% ( -1% - 4%) 0.025 HighSpanNear 6.73 (2.7%) 6.80 (3.3%) 1.2% ( -4% - 7%) 0.223 LowPhrase 255.75 (2.1%) 259.11 (2.0%) 1.3% ( -2% - 5%) 0.043 HighTermDayOfYearSort 253.38 (4.1%) 257.57 (2.2%) 1.7% ( -4% - 8%) 0.112 AndHighHigh 15.70 (1.1%) 15.98 (2.5%) 1.8% ( -1% - 5%) 0.004 MedPhrase 14.60 (2.4%) 14.89 (2.2%) 1.9% ( -2% - 6%) 0.009 OrHighLow 340.15 (2.3%) 346.84 (2.6%) 2.0% ( -2% - 6%) 0.010 HighPhrase 105.17 (2.3%) 107.28 (2.0%) 2.0% ( -2% - 6%) 0.004 HighSloppyPhrase 1.97 (5.2%) 2.01 (3.6%) 2.0% ( -6% - 11%) 0.152 HighTermTitleSort 118.65 (5.4%) 121.16 (2.4%) 2.1% ( -5% - 10%) 0.112 MedSloppyPhrase 2.73 (5.0%) 2.79 (3.1%) 2.2% ( -5% - 10%) 0.092 LowSloppyPhrase 9.48 (3.7%) 9.69 (1.7%) 2.3% ( -3% - 8%) 0.013 AndHighMed 47.32 (1.3%) 48.52 (2.8%) 2.5% ( -1% - 6%) 0.000 LowSpanNear 17.05 (2.0%) 17.49 (2.1%) 2.6% ( -1% - 6%) 0.000 OrNotHighMed 292.37 (3.0%) 300.28 (3.3%) 2.7% ( -3% - 9%) 0.007 AndHighMedDayTaxoFacets 21.13 (1.8%) 21.74 (1.5%) 2.9% ( 0% - 6%) 0.000 TermDTSort 124.22 (4.8%) 127.91 (1.3%) 3.0% ( -3% - 9%) 0.008 AndHighLow 477.93 (3.1%) 494.29 (2.5%) 3.4% ( -2% - 9%) 0.000 OrNotHighLow 424.91 (2.3%) 444.79 (2.8%) 4.7% ( 0% - 10%) 0.000 ``` and I am still seeing a speed, although the `AndHighMed` gain was 2.5% -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
