fudongyingluck commented on PR #12339: URL: https://github.com/apache/lucene/pull/12339#issuecomment-1584035487
lucene benchmark result, python3.10 src/python/localrun.py -source wikimediumall ``` TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value BrowseDayOfYearSSDVFacets 6.29 (7.5%) 6.16 (9.4%) -2.1% ( -17% - 15%) 0.428 HighTermTitleBDVSort 10.68 (8.0%) 10.51 (4.3%) -1.6% ( -12% - 11%) 0.442 IntNRQ 47.94 (1.8%) 47.23 (8.1%) -1.5% ( -11% - 8%) 0.422 OrHighMedDayTaxoFacets 6.09 (6.9%) 6.02 (5.2%) -1.1% ( -12% - 11%) 0.563 BrowseMonthSSDVFacets 6.56 (8.0%) 6.50 (8.3%) -0.9% ( -15% - 16%) 0.719 MedIntervalsOrdered 27.91 (4.9%) 27.67 (5.1%) -0.9% ( -10% - 9%) 0.579 HighSloppyPhrase 3.61 (4.3%) 3.58 (4.4%) -0.7% ( -9% - 8%) 0.596 BrowseDayOfYearTaxoFacets 7.06 (6.1%) 7.04 (5.2%) -0.3% ( -10% - 11%) 0.850 OrHighLow 351.52 (2.9%) 350.34 (3.4%) -0.3% ( -6% - 6%) 0.737 OrHighHigh 20.17 (3.4%) 20.11 (3.7%) -0.3% ( -7% - 7%) 0.776 MedSloppyPhrase 4.99 (4.0%) 4.97 (4.7%) -0.3% ( -8% - 8%) 0.822 BrowseRandomLabelTaxoFacets 6.20 (7.1%) 6.19 (5.3%) -0.2% ( -11% - 13%) 0.914 OrHighMed 106.18 (3.5%) 105.99 (3.4%) -0.2% ( -6% - 6%) 0.866 BrowseDateTaxoFacets 7.00 (5.9%) 6.99 (4.8%) -0.1% ( -10% - 11%) 0.947 Fuzzy1 88.03 (3.3%) 87.96 (1.9%) -0.1% ( -5% - 5%) 0.925 HighIntervalsOrdered 12.93 (4.5%) 12.92 (4.4%) -0.0% ( -8% - 9%) 0.979 Prefix3 224.61 (2.8%) 224.69 (2.3%) 0.0% ( -4% - 5%) 0.966 LowSloppyPhrase 22.07 (4.2%) 22.10 (4.1%) 0.1% ( -7% - 8%) 0.928 OrNotHighMed 403.85 (2.4%) 404.49 (2.9%) 0.2% ( -4% - 5%) 0.851 OrHighNotLow 468.49 (5.1%) 469.62 (4.9%) 0.2% ( -9% - 10%) 0.879 HighTermMonthSort 3512.17 (6.9%) 3523.19 (7.5%) 0.3% ( -13% - 15%) 0.890 OrHighNotMed 532.57 (4.3%) 534.39 (3.6%) 0.3% ( -7% - 8%) 0.786 MedTerm 1019.27 (4.5%) 1022.80 (4.3%) 0.3% ( -8% - 9%) 0.805 AndHighHighDayTaxoFacets 7.35 (2.8%) 7.38 (1.7%) 0.4% ( -4% - 5%) 0.633 AndHighHigh 32.60 (3.8%) 32.72 (4.2%) 0.4% ( -7% - 8%) 0.776 AndHighLow 662.12 (3.5%) 664.62 (3.9%) 0.4% ( -6% - 7%) 0.745 Fuzzy2 91.31 (4.0%) 91.66 (2.3%) 0.4% ( -5% - 6%) 0.709 OrNotHighHigh 675.72 (3.3%) 679.20 (3.6%) 0.5% ( -6% - 7%) 0.636 AndHighMed 96.86 (5.9%) 97.41 (6.3%) 0.6% ( -11% - 13%) 0.771 PKLookup 281.91 (3.6%) 283.54 (2.6%) 0.6% ( -5% - 7%) 0.566 Wildcard 183.21 (4.9%) 184.35 (2.8%) 0.6% ( -6% - 8%) 0.619 OrHighNotHigh 500.76 (3.4%) 504.24 (3.4%) 0.7% ( -5% - 7%) 0.513 LowPhrase 183.76 (2.7%) 185.24 (2.5%) 0.8% ( -4% - 6%) 0.326 LowTerm 732.82 (3.0%) 738.99 (3.0%) 0.8% ( -4% - 6%) 0.368 MedTermDayTaxoFacets 38.20 (2.9%) 38.53 (1.9%) 0.9% ( -3% - 5%) 0.273 MedPhrase 85.79 (2.5%) 86.54 (2.3%) 0.9% ( -3% - 5%) 0.250 HighTerm 678.62 (4.8%) 684.64 (4.4%) 0.9% ( -7% - 10%) 0.544 AndHighMedDayTaxoFacets 34.42 (2.5%) 34.73 (1.5%) 0.9% ( -2% - 4%) 0.164 LowIntervalsOrdered 16.93 (3.6%) 17.09 (3.2%) 1.0% ( -5% - 7%) 0.373 MedSpanNear 25.65 (3.4%) 25.89 (4.3%) 1.0% ( -6% - 9%) 0.440 HighSpanNear 9.16 (3.9%) 9.25 (4.7%) 1.0% ( -7% - 9%) 0.473 HighPhrase 136.81 (2.8%) 138.28 (2.8%) 1.1% ( -4% - 6%) 0.231 Respell 67.25 (4.6%) 68.00 (3.4%) 1.1% ( -6% - 9%) 0.377 BrowseRandomLabelSSDVFacets 5.26 (7.4%) 5.32 (7.2%) 1.1% ( -12% - 16%) 0.627 LowSpanNear 7.90 (3.7%) 7.99 (3.9%) 1.1% ( -6% - 9%) 0.347 HighTermDayOfYearSort 400.43 (2.6%) 405.41 (2.7%) 1.2% ( -3% - 6%) 0.137 OrNotHighLow 818.63 (3.1%) 828.86 (3.0%) 1.2% ( -4% - 7%) 0.199 HighTermTitleSort 62.96 (2.5%) 63.77 (3.1%) 1.3% ( -4% - 7%) 0.149 BrowseMonthTaxoFacets 10.34 (33.0%) 10.47 (33.7%) 1.3% ( -49% - 101%) 0.902 TermDTSort 239.19 (4.0%) 242.85 (6.9%) 1.5% ( -8% - 12%) 0.390 BrowseDateSSDVFacets 1.49 (12.4%) 1.54 (11.4%) 3.4% ( -18% - 31%) 0.362``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org