Atri Sharma created LUCENE-10679:
------------------------------------
Summary: FairDistributionMergePolicy
Key: LUCENE-10679
URL: https://issues.apache.org/jira/browse/LUCENE-10679
Project: Lucene - Core
Issue Type: Improvement
Reporter: Atri Sharma
Assignee: Atri Sharma
TieredMergePolicy and LogMergePolicy can define merge specifications which have
a skew in the distribution of overall "work" (i.e. number of documents to
process) amongst threads. This is especially true when the underlying segment
distribution is highly skewed.
A more optimal distribution can be achieved by performing a variation of the
integer partitioning algorithm. Initial tests show a more optimal distribution
on a simulated set of skewed segment distributions.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
