Re: CursorMarks and 'end of results'

2018-07-02 Thread Erick Erickson
OK, that makes sense then. I don't think we've mentioned streaming as an alternative. It has some restrictions (it can only export docValues), and frankly I don't really remember how much of it was in 5.5 so you'll have to check. Streaming is designed exactly to, well, stream the entire result se

Re: CursorMarks and 'end of results'

2018-07-02 Thread David Frese
Am 29.06.18 um 17:42 schrieb Erick Erickson: bq. It basically cuts down the search time in half in the usual case for us, so it's an important 'feature'. Wait. You mean that the "extra" call to get back 0 rows doubles your query time? That's surprising, tell us more. How many times does your "u

Re: CursorMarks and 'end of results'

2018-06-29 Thread Erick Erickson
bq. It basically cuts down the search time in half in the usual case for us, so it's an important 'feature'. Wait. You mean that the "extra" call to get back 0 rows doubles your query time? That's surprising, tell us more. How many times does your "usual" use case call using CursorMark? My off-th

Re: CursorMarks and 'end of results'

2018-06-29 Thread David Frese
Am 22.06.18 um 02:37 schrieb Chris Hostetter: : the documentation of 'cursorMarks' recommends to fetch until a query returns : the cursorMark that was passed in to a request. : : But that always requires an additional request at the end, so I wonder if I : can stop already, if a request returns

Re: CursorMarks and 'end of results'

2018-06-21 Thread Chris Hostetter
: the documentation of 'cursorMarks' recommends to fetch until a query returns : the cursorMark that was passed in to a request. : : But that always requires an additional request at the end, so I wonder if I : can stop already, if a request returns less results than requested (num rows). : Ther

Re: CursorMarks and 'end of results'

2018-06-19 Thread Anshum Gupta
I might have been wrong there. Having an explicit check for the # results returned vs rows requested, would allow you to avoid the last request that would otherwise come back with 0 results. That check isn’t automatically done within Solr.  Anshum > On Jun 19, 2018, at 2:39 PM, Anshum Gupta

Re: CursorMarks and 'end of results'

2018-06-19 Thread Anshum Gupta
Hi David, The cursormark would be the same if you get back fewer than the max records requested and so you should exit, as per the documentation. I think the documentation says just what you are suggesting, but if you think it could be improved, feel free to put up a patch.  Anshum > On Ju

CursorMarks and 'end of results'

2018-06-18 Thread David Frese
Hi List, the documentation of 'cursorMarks' recommends to fetch until a query returns the cursorMark that was passed in to a request. But that always requires an additional request at the end, so I wonder if I can stop already, if a request returns less results than requested (num rows). The