Re: Get all results from a solr query

2010-09-17 Thread Chris Hostetter
: stores, just a portion of it. Currently, I need to get 16 records at : once, not just the 10 that show. So I have the rows set to "99" for : the testing phase, and I can increase it later. I just wanted to have : a better way of getting all the results that didn't require hard : coding a value

Re: Get all results from a solr query

2010-09-17 Thread Lance Norskog
Look up _docid_ on the Solr wiki. It lets you walk the entire index about as fast as possible. On Fri, Sep 17, 2010 at 8:47 AM, Christopher Gross wrote: > Thanks for being so helpful!  You really helped me to answer my > question!  You aren't condescending at all! > > I'm not using it to pull dow

Re: Get all results from a solr query

2010-09-17 Thread Christopher Gross
Thanks for being so helpful! You really helped me to answer my question! You aren't condescending at all! I'm not using it to pull down *everything* that the Solr instance stores, just a portion of it. Currently, I need to get 16 records at once, not just the 10 that show. So I have the rows s

Re: Get all results from a solr query

2010-09-17 Thread Walter Underwood
Go ahead and put an absurdly large value as the rows parameter. Then wait, because that query is going to take a really long time, it can interfere with every other query on the Solr server (denial of service), and quite possibly cause your client to run out of memory as it parses the result. A

Re: Get all results from a solr query

2010-09-17 Thread kenf_nc
Chris, I agree, having the ability to make rows something like -1 to bring back everything would be convenient. However, the 2 call approach (q=blah&rows=0 followed by q=blah&rows=numFound) isn't that slow, and does give you more information up front. You can optimize your Array or List<> sizes in

Re: Get all results from a solr query

2010-09-17 Thread Christopher Gross
@Markus Jelsma - the wiki confirms what I said before: rows This parameter is used to paginate results from a query. When specified, it indicates the maximum number of documents from the complete result set to return to the client for every request. (You can consider it as the maximum number of re

Re: Get all results from a solr query

2010-09-16 Thread Scott Gonyea
lol, note to self: scratch out IPs. Good thing firewalls exist to keep my stupidity at bay. Scott On Thu, Sep 16, 2010 at 2:55 PM, Scott Gonyea wrote: > If you want to do it in Ruby, you can use this script as scaffolding: > require 'rsolr' # run `gem install rsolr` to get this > solr  = RSolr.

Re: Get all results from a solr query

2010-09-16 Thread Scott Gonyea
If you want to do it in Ruby, you can use this script as scaffolding: require 'rsolr' # run `gem install rsolr` to get this solr  = RSolr.connect(:url => 'http://ip-10-164-13-204:8983/solr') total = solr.select({:rows => 0})["response"]["numFound"] rows  = 10 query = {   :rows   => rows,   :sta

Re: Get all results from a solr query

2010-09-16 Thread Shashi Kant
Start with a *:*, then the “numFound” attribute of the element should give you the rows to fetch by a 2nd request. On Thu, Sep 16, 2010 at 4:49 PM, Christopher Gross wrote: > That will stil just return 10 rows for me.  Is there something else in > the configuration of solr to have it return all

RE: Re: Get all results from a solr query

2010-09-16 Thread Markus Jelsma
Not according to the wiki; http://wiki.apache.org/solr/CommonQueryParameters#rows   But you could always create an issue for this one.   -Original message- From: Christopher Gross Sent: Thu 16-09-2010 22:50 To: solr-user@lucene.apache.org; Subject: Re: Get all results from a solr

Re: Get all results from a solr query

2010-09-16 Thread Christopher Gross
That will stil just return 10 rows for me. Is there something else in the configuration of solr to have it return all the rows in the results? -- Chris On Thu, Sep 16, 2010 at 4:43 PM, Shashi Kant wrote: > q=*:* > > On Thu, Sep 16, 2010 at 4:39 PM, Christopher Gross wrote: >> I have some que

Re: Get all results from a solr query

2010-09-16 Thread Shashi Kant
q=*:* On Thu, Sep 16, 2010 at 4:39 PM, Christopher Gross wrote: > I have some queries that I'm running against a solr instance (older, > 1.2 I believe), and I would like to get *all* the results back (and > not have to put an absurdly large number as a part of the rows > parameter). > > Is there