airborne12 opened a new pull request, #59: URL: https://github.com/apache/doris-thirdparty/pull/59
Description: This pull request addresses the issue of index compaction performance by introducing a priority queue to better manage the process. This update involves changes in IndexWriter.cpp, SegmentMergeInfo.cpp, and _SegmentMergeInfo.h. The key modifications include: 1. Replacing the previous approach for finding the smallest term and constructing a dest_idx_bitmap with a more efficient priority queue based approach. 2. Introducing a new postingQueue class to manage the document merging process. 3. Implementing a new DestDoc struct to store relevant information for each document in the merging process. 4. Refactoring the mergeTerms() method to use the new priority queue based approach. These changes have resulted in improved performance during the index compaction process, leading to faster indexing and optimized resource usage. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
