Re: indexing data to solrcloud with "implicit" is not distributing across cluster.

2017-12-25 Thread hemanth
Hi Erik,
Thanks for your reply. I have no issues of using either Implicit or
Composite routing but I want to insert the documents to a particular shard,
so that when I want to query the data , I can hit a particular shard, which
gives me the results in lesser time as it hits only particular shard. So,
for eg: I am creating a collection with status as Active, Inactive and
Terminated. Let me think that my data at present is equally distributed ,
i.e Active 400 records, Inactive 300 records and Terminated also 300
records. I tried creating a collection with compositeId routing which
created shard1,shard2,shard3 , but when I indexed , all the documents went
to one shard only. I also created a collection with Implicit routing
mechanism with Active,Inactive and Terminated shard with routing key as
status. When I indexed the documents , again all went to single shard. I
want to route the documents based on some input value (with out based on the
hash value of the field , I specified, because both values may always lead
to same hash value and may point to store in same shard).  So , Please let
me know, how to route the documents to a particular shard based on composite
id or implicit mechanism, by using one of the existing field value or
extracting the content of the field before ! parameter. eg: if my field
value is "Active!otherfieldvalue" should go to Active shard and if my field
value is  "Inactive!othercontent" should go to Inactive shard.

Thanks
Hemanth

-Happy Christmas



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html


Re: indexing data to solrcloud with "implicit" is not distributing across cluster.

2017-12-25 Thread Erick Erickson
I suspect that when you create your collections, somehow you're not
doing it like you expect.

The red flag is:

I tried creating a collection with compositeId routing which
created shard1,shard2,shard3 , but when I indexed , all the documents went
to one shard only

This simply shouldn't be happening. What is your evidence that all the docs went
to one shard? You can tell by adding &distrib=false to your query and
sending it to
particular core, something like:

solr_server/solr/collection1_shard1_replica1/query?q=*:*&distrib=false.

Best,
Erick

On Mon, Dec 25, 2017 at 4:15 AM, hemanth  wrote:
> Hi Erik,
> Thanks for your reply. I have no issues of using either Implicit or
> Composite routing but I want to insert the documents to a particular shard,
> so that when I want to query the data , I can hit a particular shard, which
> gives me the results in lesser time as it hits only particular shard. So,
> for eg: I am creating a collection with status as Active, Inactive and
> Terminated. Let me think that my data at present is equally distributed ,
> i.e Active 400 records, Inactive 300 records and Terminated also 300
> records. I tried creating a collection with compositeId routing which
> created shard1,shard2,shard3 , but when I indexed , all the documents went
> to one shard only. I also created a collection with Implicit routing
> mechanism with Active,Inactive and Terminated shard with routing key as
> status. When I indexed the documents , again all went to single shard. I
> want to route the documents based on some input value (with out based on the
> hash value of the field , I specified, because both values may always lead
> to same hash value and may point to store in same shard).  So , Please let
> me know, how to route the documents to a particular shard based on composite
> id or implicit mechanism, by using one of the existing field value or
> extracting the content of the field before ! parameter. eg: if my field
> value is "Active!otherfieldvalue" should go to Active shard and if my field
> value is  "Inactive!othercontent" should go to Inactive shard.
>
> Thanks
> Hemanth
>
> -Happy Christmas
>
>
>
> --
> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html


Is it possible to use limit and sort with BlockJoin Facet?

2017-12-25 Thread Kamuela Lau
Hi,

I am working on applying parent/child types to search using Solr, and
wanted to inquire about two things.

1) BlockJoin Facet

Currently, there are two cores. The first core (the item core) has 16
million documents, and the second core (the product core) has 3 million
documents.
The product core is the parent, and the item core is the child.

To apply this parent/child relationship to searches, I thought that I could
use BlockJoin Facet,
but because the number of documents being searched is so large, I am
worried about the decrease in performance of Solr when using BlockJoin
Facet.

I thought it may be possible to avoid dips in performance while using
BlockJoin Facet by using limit and sort,
however when I tried to look up more information about this, I was unsure
of if that is possible.

When using BlockJoin Facet, is it not possible to use limit and sort?

2) JSON Facet API

While I was researching about the above problem, I came across JSON Facet
API.
Is it possible to do the same thing as BlockJoin Facet with JSON Facet API?
If it is possible, what is the most appropriate way to use each one?

I was unable to find an official document with more detailed information
about Solr's JSON Facet API,
so if anyone knows of a relevant resource or reference material, I would be
grateful if you could share it.

I apologize for the rather open-ended question, but an answer or even a
point in the right direction (an article
or resource) would be greatly appreciated.

Thanks,
Kamu


Re: indexing data to solrcloud with "implicit" is not distributing across cluster.

2017-12-25 Thread hemanth
As per my understanding, distrib=false will be added in select query to
restrict the document selection to particular shard. But how should i route
the documents to only particular shard, is still my need.

Thanks
Hemanth



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html


RE: help on implicit routing

2017-12-25 Thread hemanth
I am trying here implicit routing and want to create a collection with 3
shards with names Active,Inactive and Terminated.  I created a _route_ field
in schema and copied my status field which contains Active or Inactive or
Terminated. I used copyfield in schema.xml to copy from status to _route_. I
specified _route_ as my route field in my implicit routing , while creating
a collection with implicit routing and shard names as Active,Inactive and
Terminated. But all my documents are still going to the same shard. Any hits
are highly appreciated.

Thanks
Hemanth



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html