[
https://issues.apache.org/jira/browse/SOLR-14275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17085678#comment-17085678
]
Andrzej Bialecki commented on SOLR-14275:
-----------------------------------------
I've integrated Noble's improvements into PR 1329 but there are still many test
failures, and Noble is working on fixing these.
The gist of the changes is using aggressive caching using an additional per-Row
structure.
Code review - by all means, if you're not easily scared ;)
> Policy calculations are very slow for large clusters and large operations
> -------------------------------------------------------------------------
>
> Key: SOLR-14275
> URL: https://issues.apache.org/jira/browse/SOLR-14275
> Project: Solr
> Issue Type: Bug
> Security Level: Public(Default Security Level. Issues are Public)
> Components: AutoScaling
> Affects Versions: 7.7.2, 8.4.1
> Reporter: Andrzej Bialecki
> Assignee: Andrzej Bialecki
> Priority: Major
> Labels: scaling
> Attachments: SOLR-14275.patch, scenario.txt
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Replica placement calculations performed during collection creation take
> extremely long time (several minutes) when using a large cluster and creating
> a large collection (eg. 1000 nodes, 500 shards, 4 replicas).
> Profiling shows that most of the time is spent in
> {{Row.computeCacheIfAbsent}}, which probably doesn't reuse this cache as much
> as it should.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
