dungba88 commented on PR #14226: URL: https://github.com/apache/lucene/pull/14226#issuecomment-2709963838
Ran again with the second idea that the pro-rata rate will be based on the active segments in the current pass instead of the whole index (called "adaptive" in the graph). However I didn't see much improvement and it only increases the latency, doesn't seem to worth pursuing. The "simplified" version now only has a slight more latency compared to "optimistic" with lambda=2. I think it's comparable to the "optimistic", subjected to some noise. Maybe we can "opt" for this simplified 2-pass collection instead multi-pass? <img width="726" alt="Screenshot 2025-03-10 at 18 31 22" src="https://github.com/user-attachments/assets/c9bfd321-ecc3-4207-8f4e-da0b959d70c2"; /> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
