Even if you could do this, I think you'd still have the "deep paging" issue.
Your irreducible problem is that you have to return all million docs, have you tried just setting the &rows=10000000? And maybe return JSON format for brevity? Best Erick On Mon, Aug 22, 2011 at 1:07 PM, jame vaalet <jamevaa...@gmail.com> wrote: > thanks erick for the answer.. > my index have around 20 million document in it.. and each query of mine will > yield around 1 million hits (numFound)..corresponding to each my query i > store the hit document id into data base for further processing.. > retrieving 1 million docids from solr through paging is resulting in deep > pagin issues..so i wonder if i can use filter queries to fetch all the 1 > mllion docids chunk by chunk .. so for me the best filter wiould score... if > i can find the maximum score i can filter out other docs .. > > what is the minimum value of solr score? i don think it will have negative > values.. so if its always above 0.. my first chunk wud be score [0 TO *]& > rows =10000 my next chunk will start from the max score from first chunk to > * with rows =10000 .. this will ensure that while fetching the 1000th chunk > solr don have to get all the previous doc ids into memory .. > > > > On 22 August 2011 19:51, Erick Erickson <erickerick...@gmail.com> wrote: > >> I don't believe that this is possible, and I strongly question >> whether it's useful (not to mention the syntax error, score:[1 TO *], >> notice >> the colon). >> >> Scores really are "dimensionless". A normalized score of 0.5 for a >> particular >> query doesn't really say anything about how "good" the document is, it just >> tells you that it's "better" than a doc of 0.4 >> >> This smells like an XY problem, see: >> http://people.apache.org/~hossman/#xyproblem >> >> What is a higher-level statement of the problem you're trying to solve? >> >> Best >> Erick >> >> >> >> On Mon, Aug 22, 2011 at 7:28 AM, jame vaalet <jamevaa...@gmail.com> wrote: >> > hi. >> > Is it possible to say fq=score[1 TO *] >> > i have tried but solr is throwing error ? can this be done with some >> other >> > syntax ? >> > >> > -- >> > >> > -JAME >> > >> > > > > -- > > -JAME >
