mikemccand commented on PR #13542: URL: https://github.com/apache/lucene/pull/13542#issuecomment-2210815304
Thank you for tackling this @javanna! This is long overdue ... it's crazy that a fully optimized (`forceMerge(1)`) index removes all intra-query concurrency. > IndexSearcher#count / TotalHitCountCollector rely on Weight#count(LeafReaderContext), which now gets called multiple times against the same leaf and leads to excessive counting of hits. I think queries that do substantial work in `Weight/ScorerSupplier.get` are also tricky? E.g. points queries (`PointRangeQuery`) walks the BKD tree to build a bitset. Ideally, if a segment has multiple `LeafReaderContextPartition`s, we'd only do the BKD intersect once, and then the N threads working on those partitions can share that bitset? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
