I think I need to provide a few more details here. I need the ability to add a shard to the cluster, in doing this I'd like to split an existing index and spin up this new shard with 1/2 (or there abouts) of this and allow the original to continue serving the pieces it has now. In our application we are using the murmurhash3 (taken from http://www.yonik.com/) so that updates/deletes are sent to the appropriate servers (we're using an old snapshot of solrcloud which doesn't support the latest distributed indexing). In my case the hashing is based on the number of shards, which means you add a shard and it breaks. I've read in one of the JIRAs that instead the hashing should be based on some other number (any ideas?) and then should be used to calculate ranges which would in turn be stored in ZK so adding another shard would be a matter of updating the range in ZK, stopping the machine serving the index to be split and splitting said index such that the 2 indexes created would map to the new bins.
All of that being said I have none of this implemented and would much prefer this work happen within solr proper since it's already on the roadmap and my code would ultimately be throw away. Thus the reason I'd like to understand what the plans are for this in Solr and possibly start contributing to this development, assuming it meets my timelines. Any thoughts/comments are greatly appreciated. On 1/25/12, Jamie Johnson <jej2...@gmail.com> wrote: > Thanks Otis. I have been following the SolrCloud development, but I > was wondering specifically about elastically expanding the cloud by > adding shards. I'm following the distributed indexing JIRA, but I'm > having difficulty finding a JIRA which specifically references the > issues with elasticity. Are you aware of one? > > On Wed, Jan 25, 2012 at 1:10 PM, Otis Gospodnetic > <otis_gospodne...@yahoo.com> wrote: >> Jamie, depending on how quickly you need this, it may be better to follow >> SolrCloud development because cluster resizing will work differently >> there. >> >> Otis >> ---- >> Performance Monitoring SaaS for Solr - >> http://sematext.com/spm/solr-performance-monitoring/index.html >> >> >>>________________________________ >>> From: Jamie Johnson <jej2...@gmail.com> >>>To: solr-user@lucene.apache.org >>>Sent: Wednesday, January 25, 2012 12:03 PM >>>Subject: Cluster Resizing question >>> >>>Is this the JIRA that I should be tracking for resizing a cluster? >>> >>>https://issues.apache.org/jira/browse/SOLR-2593 >>> >>>If not can someone point me to the appropriate location. Also is >>>there a rough timeline for when this will be available? >>> >>> >>> >
