jpountz commented on issue #12877: URL: https://github.com/apache/lucene/issues/12877#issuecomment-1845325507
> +1, I like this idea. I have a vague recollection of you saying you already implemented something like that, am I making this up? (it's quite possible, I struggle to keep lots of stuff in memory!) > It might be implemented by having TieredMergePolicy dynamically set the max segment size One potential issue that comes to mind with this approach is that `TieredMergePolicy` gives up on finding balanced merges when they reach the maximum merged segment size and just packs as many segments as possible as long as the sum of their sizes is under the threshold, so this could potentially worsen write amplification? > Perhaps when the index is tiny it doesn't do the maxDoc/N, but only once enough maxDoc have been index, start enforcing that ... +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
