Re: cursorMark and Solrcloud

2018-01-16 Thread Webster Homer
count is queryResponse.getResults().getNumFound() The code stops when the cursorMark is equal to the nextCursorMark so how can it exceed the numFound? setting the sort order to just the unique id and the code works. I would try to create an example case, but I'm under a deadline and have to get t

Re: cursorMark and Solrcloud

2018-01-16 Thread Webster Homer
sorry solr_returned is the total count of the documents retrieved from the queryResponse. So if I ask for 200 rows at at time it will be the increment of all the 200 numberRetrieved += queryResponse.getResults().size(); Where queryResponse is a solrj QueryResponse On Mon, Jan 15, 2018 at 6:11 PM

Re: cursorMark and Solrcloud

2018-01-15 Thread Shawn Heisey
On 1/15/2018 12:52 PM, Webster Homer wrote: When I don't have score in the sort, the solr_returned and count are the same I don't know what "solr_returned" means.  I haven't encountered that before, and nothing useful turns up in a google search. If you're getting different numFound values f

Re: cursorMark and Solrcloud

2018-01-15 Thread Erick Erickson
bq: When I don't have score in the sort, the solr_returned and count are the same. Hmmm, I don't know the inner workings of cursor mark all that well. But can you tell what the score of one of the omitted documents is and how it compares against the score of the mark returned on the previous call?

Re: cursorMark and Solrcloud

2018-01-15 Thread Webster Homer
When I don't have score in the sort, the solr_returned and count are the same On Mon, Jan 15, 2018 at 1:50 PM, Webster Homer wrote: > The problem is that the cursor mark query returns different numbers of > documents each time it is called when the collection has multiple replicas > per shard. >

Re: cursorMark and Solrcloud

2018-01-15 Thread Webster Homer
The problem is that the cursor mark query returns different numbers of documents each time it is called when the collection has multiple replicas per shard. I meant collection. The same collection is on different clouds. The collection in one cloud 1 has 2 shards with 1 replica per shard. In the s

Re: cursorMark and Solrcloud

2018-01-15 Thread Shawn Heisey
On 1/15/2018 11:56 AM, Webster Homer wrote: I have noticed strange behavior using cursorMark for deep paging in an application. We use solrcloud for searching. We have several clouds for development. For our development systems we have two different clouds. One cloud has 2 shards with 1 replica p