On 11/23/2013 4:20 AM, Shalin Shekhar Mangar wrote: > As you said, loading caches from the caches of another server is not > feasible but there is some merit in warming with the queries of the > leader. For example, what if the leader could give a list of > queries/filters currently in the cache which could then be executed on > the replica? That'd be useful I think.
That is an interesting idea. Thoughts, conjured with only surface understanding of the internals involved: One question is whether this would be done via the zookeeper queue or with direct inter-server communication. My only worry with doing it in zookeeper is the potential for it to put a major load on low-end zookeeper machines. We often tell people that their ZK nodes do not need much in the way of resources. If the user has high-end machines, even if they are doing double duty as SolrCloud and Zookeeper, that would not really be a worry. Would we want to control the max number of forwarded keys via the existing autowarmCount setting, or have a new per-cache setting with a relatively low default? If it's a new setting, I would recommend that it not be included in the example solrconfig.xml file, to discourage people from shooting themselves in the foot accidentally. It should be well documented in the wiki and ref guide as an expert setting. Thanks, Shawn
