[
https://issues.apache.org/jira/browse/SOLR-14275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17046274#comment-17046274
]
Andrzej Bialecki commented on SOLR-14275:
-----------------------------------------
The current behavior has exponential complexity and it doesn't scale - for
scenarios involving ~10k cores * nodes calculations take several minutes to
complete, while blocking all other collection operations.
This issue explores ways to properly fix the design so that its complexity is
closer to linear - just adding a band-aid flag is not a proper fix.
> Policy calculations are very slow for large clusters and large operations
> -------------------------------------------------------------------------
>
> Key: SOLR-14275
> URL: https://issues.apache.org/jira/browse/SOLR-14275
> Project: Solr
> Issue Type: Bug
> Security Level: Public(Default Security Level. Issues are Public)
> Components: AutoScaling
> Affects Versions: 7.7.2, 8.4.1
> Reporter: Andrzej Bialecki
> Assignee: Andrzej Bialecki
> Priority: Major
> Attachments: SOLR-14275.patch, scenario.txt
>
>
> Replica placement calculations performed during collection creation take
> extremely long time (several minutes) when using a large cluster and creating
> a large collection (eg. 1000 nodes, 500 shards, 4 replicas).
> Profiling shows that most of the time is spent in
> {{Row.computeCacheIfAbsent}}, which probably doesn't reuse this cache as much
> as it should.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
