prudhvigodithi commented on PR #15383: URL: https://github.com/apache/lucene/pull/15383#issuecomment-3533757781
Yes this is the issue to handle the duplicate work per segment https://github.com/apache/lucene/issues/13745, the main target of this is to reduce the size allocation per partition, without this PR today each partition thread allocates full segment-sized structure, so the number of allocations is the same, but the size is vastly different. IMO this change should be still useful when we come up with strategy to stop duplicate work per segment https://github.com/apache/lucene/issues/13745 Before I run the full benchmarks I guess I can quickly test the final DocIdSet's `ramBytesUsed` ? this should show reduction with partition aware `DocIdSetBuilder`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
