Re: Lucene to Solrcloud migration

2014-11-11 Thread Erick Erickson
bq: So I guess with compositeId router I am out of luck. No, not at all. Atomic updates are exactly about updating a doc and NOT changing the id. A different uniqueKey is a different doc by definition. So you can easily use atomic updates with composite IDs since you are changing a field of an e

Re: Lucene to Solrcloud migration

2014-11-11 Thread Michal Krajňanský
Hm. So I found that one can update stored fields with "atomic update" operation, however according to http://stackoverflow.com/questions/19058795/it-is-possible-to-update-uniquekey-in-solr-4 this will not work for uniqueKey. So I guess with compositeId router I am out of luck. I have been also sea

Re: Lucene to Solrcloud migration

2014-11-11 Thread Michael Della Bitta
Yeah, Erick confused me a bit too, but I think what he's talking about takes for granted that you'd have your various indexes directly set up as individual collections. If instead you're considering one big collection, or a few collections based on aggregations of your individual indexes, havi

Re: Lucene to Solrcloud migration

2014-11-11 Thread Michal Krajňanský
Hi Eric, Michael, thank you both for your comments. 2014-11-11 5:05 GMT+01:00 Erick Erickson : > bq: - the documents are organized in "shards" according to date (integer) > and > language (a possibly extensible discrete set) > > bq: - the indexes are disjunct > > OK, I'm having a hard time getti

Re: Lucene to Solrcloud migration

2014-11-10 Thread Erick Erickson
bq: - the documents are organized in "shards" according to date (integer) and language (a possibly extensible discrete set) bq: - the indexes are disjunct OK, I'm having a hard time getting my head around these two statements. If the indexes are disjunct in the sense that you only search one at

Re: Lucene to Solrcloud migration

2014-11-10 Thread Michael Della Bitta
Hi Michal, Is there a particular reason to shard your collections like that? If it was mainly for ease of operations, I'd consider just using CompositeId to prevent specific types of queries hotspotting particular nodes. If your ingest rate is fast, you might also consider making each "colle

Lucene to Solrcloud migration

2014-11-10 Thread Michal Krajňanský
Hi All, I have been working on a project that has long employed Lucene indexer. Currently, the system implements a proprietary document routing and index plugging/unplugging on top of the Lucene and of course contains a great body of indexes. Recently an idea came up to migrate from Lucene to Sol