Pulkitg64 commented on PR #15003: URL: https://github.com/apache/lucene/pull/15003#issuecomment-3499140504
https://github.com/apache/lucene/pull/15003#issuecomment-3494558786 Continuing from above benchmark run: With higher deletes we are regressing on recall with out any benefits on force merge time. This suggest it is required to add some guardrails like we had earlier in previous revision i.e select only those graphs which have less than x% deletes and skip others. (**Maybe 20-30% deletes is fine**) | Experiment | | Baseline | | Candidate | | Change | | |------------|---------|----------|----------------|-----------|----------------|---------------|------------------------| | Delete % | MaxConn | Recall | ForceMergeTime | Recall | ForceMergeTime | Recall Change | ForceMerge Time Change | | 60 | 8 | 0.83 | 28.69 | 0.8 | 23.81 | -3.61% | 1.2x | | 60 | 16 | 0.919 | 42.81 | 0.894 | 39.07 | -2.72% | 1.1x | | 60 | 32 | 0.949 | 51.6 | 0.926 | 50.38 | -2.42% | 1.02x | | 60 | 64 | 0.955 | 54.78 | 0.945 | 52.98 | -1.05% | 1.03x | | 70 | 8 | 0.843 | 20.84 | 0.788 | 18.39 | -6.52% | 1.13x | | 70 | 16 | 0.927 | 30.39 | 0.886 | 29 | -4.42% | 1.04x | | 70 | 32 | 0.955 | 36.05 | 0.936 | 34.85 | -1.99% | 1.03x | | 70 | 64 | 0.961 | 37.15 | 0.945 | 38.41 | -1.66% | 0.96x | | 80 | 8 | 0.864 | 12.95 | 0.732 | 10.69 | -15.28% | 1.2x | | 80 | 16 | 0.94 | 18.23 | 0.821 | 16.42 | -12.66% | 1.1x | | 80 | 32 | 0.965 | 20.98 | 0.914 | 19.18 | -5.28% | 1.1x | | 80 | 64 | 0.968 | 21.69 | 0.916 | 20.23 | -5.37% | 1.07x | | 90 | 8 | 0.893 | 5.37 | 0.39 | 2.67 | -56.33% | 2.01x | | 90 | 16 | 0.961 | 7.26 | 0.562 | 5.14 | -41.52% | 1.4x | | 90 | 32 | 0.978 | 8.04 | 0.678 | 6.43 | -30.67% | 1.2x | | 90 | 64 | 0.98 | 8.02 | 0.758 | 6.48 | -22.65% | 1.23x | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
