Re: SOLR Cursor Pagination Issue

2020-09-29 Thread vmakovsky
Hi Erick,"You still haven’t given an example of the results you’re seeing that are unexpected". I will give an example of the data I received. Before starting data update I have: solrCloud: Expected series criteria:386062 Collected series: 386062 Number of requests: 40 Collected unique series: 3

Re: SOLR Cursor Pagination Issue

2020-09-28 Thread Erick Erickson
I said nothing about docId changing. _any_ sort criteria changing is an issue. You’re sorting by score. Well, as you index documents, the new docs change the values used to calculate scores for _all_ documents will change, thus changing the sort order and potentially causing unexpected results w

Re: SOLR Cursor Pagination Issue

2020-09-28 Thread vmakovsky
Hi, Erick I have a python script that sends requests with CursorMark. This script checks data against the following Expected series criteria: Collected series: Number of requests: Collected unique series: The request looks like this: select?indent=off&defType=edismax&wt=json&facet.query={!key=

Re: SOLR Cursor Pagination Issue

2020-09-28 Thread Erick Erickson
Define “incorrect” please. Also, showing the exact query you use would be helpful. That said, indexing data at the same time you are using CursorMark is not guaranteed do find all documents. Consider a sort with date asc, id asc. doc53 has a date of 2001 and you’re already returned the doc. Ne