Without cursor, you are rerunning a full search every time. So, slow down is entirely expected.
With cursor, you do not. It does an internal skip based on cursor value. I think the sort is there to ensure the value is stable. Basically, you need to use the cursor. Regards, Alex. ---- Solr Analyzers, Tokenizers, Filters, URPs and even a newsletter: http://www.solr-start.com/ On 12 March 2015 at 19:05, vsriram30 <vsrira...@gmail.com> wrote: > Thanks Alex for quick response. I wanted to avoid reading the lucene index to > prevent complications of merging deleted info. Also I would like to do this > on very frequent basis as well like once in two or three days. > > I am wondering if the issues that I faced while scraping the index towards > higher order of millions will get resolved with Cursor. Do you think using > cursor to scrap solr with sort on unique key field is better than not using > it and does it not do the same skip operations and take more time as without > using cursor? > > Thanks, > Sriram > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Best-way-to-dump-out-entire-solr-content-tp4192734p4192745.html > Sent from the Solr - User mailing list archive at Nabble.com.
