Re: Solr document duplicated during pagination

2016-04-13 Thread Shawn Heisey
On 4/13/2016 4:57 AM, Anil wrote: > Yes Erick. > > I have the attached the queries generated from logs. > > i see many duplicate records :( . i could not see any duplicates on > solr admin console. > > Each run giving different number of duplicates. > > Do you think Not (-) on query is an issue? pl

Re: Solr document duplicated during pagination

2016-04-13 Thread Anil
Yes Erick. I have the attached the queries generated from logs. i see many duplicate records :( . i could not see any duplicates on solr admin console. Each run giving different number of duplicates. Do you think Not (-) on query is an issue? please advice. Thanks, Anil On 10 April 2016 at

Re: Solr document duplicated during pagination

2016-04-10 Thread Erick Erickson
If the index is being updated while indexing, this can happen. But what do you mean by "i see page 1 & 2 has common documents and similarly in other pages as well"? Is it the _same_ id ( as Lior mentions)? Docs are "the same" to Solr if and only if they have the same Best, Erick On Sun, Apr 1

Re: Solr document duplicated during pagination

2016-04-10 Thread Lior Sapir
It will not happen but you must: 1. Have Unique ID for each document 2. Make sure you define this field in the schema.xml YOUR_DOC_UQ_ID_FIELD_NAME 3. If you are using multiple shards query and not using solr cloud then you have to make sure you are not inserting the same document into two differ

Solr document duplicated during pagination

2016-04-10 Thread Anil
HI, i am loading solr recrods for a particular query to application cache. Lets say total number of eligible records (numFound) are 501. my solr queries would be page 1 : q=*:*&start=0&rows=100 page 2 : q=*:*&start=100&rows=100 page 3 : q=*:*&start=200&rows=100 page 4 : q=*:*&start=300&rows=10