Re: indexing data to solrcloud with "implicit" is not distributing across cluster.
Hi Erik, Thanks for your reply. I have no issues of using either Implicit or Composite routing but I want to insert the documents to a particular shard, so that when I want to query the data , I can hit a particular shard, which gives me the results in lesser time as it hits only particular shard. So, for eg: I am creating a collection with status as Active, Inactive and Terminated. Let me think that my data at present is equally distributed , i.e Active 400 records, Inactive 300 records and Terminated also 300 records. I tried creating a collection with compositeId routing which created shard1,shard2,shard3 , but when I indexed , all the documents went to one shard only. I also created a collection with Implicit routing mechanism with Active,Inactive and Terminated shard with routing key as status. When I indexed the documents , again all went to single shard. I want to route the documents based on some input value (with out based on the hash value of the field , I specified, because both values may always lead to same hash value and may point to store in same shard). So , Please let me know, how to route the documents to a particular shard based on composite id or implicit mechanism, by using one of the existing field value or extracting the content of the field before ! parameter. eg: if my field value is "Active!otherfieldvalue" should go to Active shard and if my field value is "Inactive!othercontent" should go to Inactive shard. Thanks Hemanth -Happy Christmas -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
Re: indexing data to solrcloud with "implicit" is not distributing across cluster.
I suspect that when you create your collections, somehow you're not doing it like you expect. The red flag is: I tried creating a collection with compositeId routing which created shard1,shard2,shard3 , but when I indexed , all the documents went to one shard only This simply shouldn't be happening. What is your evidence that all the docs went to one shard? You can tell by adding &distrib=false to your query and sending it to particular core, something like: solr_server/solr/collection1_shard1_replica1/query?q=*:*&distrib=false. Best, Erick On Mon, Dec 25, 2017 at 4:15 AM, hemanth wrote: > Hi Erik, > Thanks for your reply. I have no issues of using either Implicit or > Composite routing but I want to insert the documents to a particular shard, > so that when I want to query the data , I can hit a particular shard, which > gives me the results in lesser time as it hits only particular shard. So, > for eg: I am creating a collection with status as Active, Inactive and > Terminated. Let me think that my data at present is equally distributed , > i.e Active 400 records, Inactive 300 records and Terminated also 300 > records. I tried creating a collection with compositeId routing which > created shard1,shard2,shard3 , but when I indexed , all the documents went > to one shard only. I also created a collection with Implicit routing > mechanism with Active,Inactive and Terminated shard with routing key as > status. When I indexed the documents , again all went to single shard. I > want to route the documents based on some input value (with out based on the > hash value of the field , I specified, because both values may always lead > to same hash value and may point to store in same shard). So , Please let > me know, how to route the documents to a particular shard based on composite > id or implicit mechanism, by using one of the existing field value or > extracting the content of the field before ! parameter. eg: if my field > value is "Active!otherfieldvalue" should go to Active shard and if my field > value is "Inactive!othercontent" should go to Inactive shard. > > Thanks > Hemanth > > -Happy Christmas > > > > -- > Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
Is it possible to use limit and sort with BlockJoin Facet?
Hi, I am working on applying parent/child types to search using Solr, and wanted to inquire about two things. 1) BlockJoin Facet Currently, there are two cores. The first core (the item core) has 16 million documents, and the second core (the product core) has 3 million documents. The product core is the parent, and the item core is the child. To apply this parent/child relationship to searches, I thought that I could use BlockJoin Facet, but because the number of documents being searched is so large, I am worried about the decrease in performance of Solr when using BlockJoin Facet. I thought it may be possible to avoid dips in performance while using BlockJoin Facet by using limit and sort, however when I tried to look up more information about this, I was unsure of if that is possible. When using BlockJoin Facet, is it not possible to use limit and sort? 2) JSON Facet API While I was researching about the above problem, I came across JSON Facet API. Is it possible to do the same thing as BlockJoin Facet with JSON Facet API? If it is possible, what is the most appropriate way to use each one? I was unable to find an official document with more detailed information about Solr's JSON Facet API, so if anyone knows of a relevant resource or reference material, I would be grateful if you could share it. I apologize for the rather open-ended question, but an answer or even a point in the right direction (an article or resource) would be greatly appreciated. Thanks, Kamu
Re: indexing data to solrcloud with "implicit" is not distributing across cluster.
As per my understanding, distrib=false will be added in select query to restrict the document selection to particular shard. But how should i route the documents to only particular shard, is still my need. Thanks Hemanth -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
RE: help on implicit routing
I am trying here implicit routing and want to create a collection with 3 shards with names Active,Inactive and Terminated. I created a _route_ field in schema and copied my status field which contains Active or Inactive or Terminated. I used copyfield in schema.xml to copy from status to _route_. I specified _route_ as my route field in my implicit routing , while creating a collection with implicit routing and shard names as Active,Inactive and Terminated. But all my documents are still going to the same shard. Any hits are highly appreciated. Thanks Hemanth -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html