Custom shard key

2016-03-22 Thread Anil
HI, i am using explicit shading by creating custom shard key for my application using hbase util mumurhash (added snippet below). int hash = MurmurHash.getInstance().hash(sharekey.getBytes()); hash = Math.abs(hash); int routingValue = hash % shards; I noticed only 5 out of 8 shards used and 3

Re: Custom shard key, shard partitioning

2013-02-20 Thread Mark Miller
On Feb 19, 2013, at 9:16 AM, Markus Jelsma wrote: > Ah, thanks. Got a Jira? I don't think i'm watching that one right now. https://issues.apache.org/jira/browse/SOLR-3154 - Mark

RE: Custom shard key, shard partitioning

2013-02-19 Thread Markus Jelsma
-Original message- > From:Mark Miller > Sent: Mon 18-Feb-2013 16:27 > To: solr-user@lucene.apache.org > Subject: Re: Custom shard key, shard partitioning > > Yeah, I think we are missing some docs on this… > > I think the info is in here: https://issues.apa

Re: Custom shard key, shard partitioning

2013-02-18 Thread Mark Miller
Yeah, I think we are missing some docs on this… I think the info is in here: https://issues.apache.org/jira/browse/SOLR-2592 But it's not so easy to pick out - I'd been considering going through and writing up some wiki doc for that feature (unless I'm somehow missing it), but just been too bus

Re: Custom shard key, shard partitioning

2013-02-18 Thread Marcin Rzewucki
Hi, I was able to implement custom hashing with the use of "_shard_" field. It contains the name of shard a document should go to. Works fine. Maybe there's some other method to do the same with the use of solrconfig.xml, but I have not found any docs about it so far. Regards. On 18 February 20

Custom shard key, shard partitioning

2013-02-18 Thread Markus Jelsma
Hi, By defaut SolrCloud partitions records by the hash of the uniqueKey field but we want to do some tests and partition the records by a signed integer field but keep the current uniqueKey unique. I've scanned through several issues concerning distributed index, custom hashing, shard policies