Whoops, looks like I misdiagnosed this one. Just to add: you might want to make sure lazy field loading is enabled, too. On Nov 5, 2013 7:21 AM, "Erick Erickson" <erickerick...@gmail.com> wrote:
> As long as start=0, this is _not_ the deep paging problem. > > Raymond's comments are well taken. Try restricting the > returned fields to only id. If you have large fields, Solr 4.1+ > automatically compresses the data so you might be seeing > lots of time spent in decompression, that'd be my first guess. > > And it's important to look at your QTime return in the responses, > I forget whether SolrMeter reports that time or total time. That's > the time spent searching, exclusive of loading the documents > into the return packet. > > It looks like you're pegging the CPU (and the decompression > might be why) and getting into a resource-starved situation. > > Best, > Erick > > > On Tue, Nov 5, 2013 at 6:47 AM, Raymond Wiker <rwi...@gmail.com> wrote: > > > Are you restricting the set of fields that you return from the queries? > If > > not, it could be that you are returning fields that are potentially very > > large, and may affect query performance that way. > > > > > > On Tue, Nov 5, 2013 at 11:38 AM, michael.boom <my_sky...@yahoo.com> > wrote: > > > > > Thank you! > > > > > > I suspect that maybe my box was too small. > > > I'm upgrading my machines to more CPU & RAM and let's see how it goes > > from > > > there. > > > > > > Would limiting the number of returned fields to a smaller value would > > make > > > any improvement? > > > The behaviour I noticed was that: > > > at start=o&rows=10 avg qtime after 200queris was about 15ms > > > at start=o&rows=20 avg qtime after 200queris was about 20ms > > > at start=o&rows=30 avg qtime after 200queris was about 250ms and slowly > > > increasing. > > > at start=o&rows=50 avg qtime after 200queris was about 1400ms and > > > increasing > > > really fast. > > > > > > Tests were made using SolrMeter, using a set of keywords, each request > > > having specified the start=0&rows=N (N being one of the values above). > > So, > > > no deep paging, always requesting first N results, sorted by score. > > > > > > I will try again this scenario on the bigger boxes, and come back. > > > > > > > > > > > > ----- > > > Thanks, > > > Michael > > > -- > > > View this message in context: > > > > > > http://lucene.472066.n3.nabble.com/Performance-of-rows-and-start-parameters-tp4099194p4099370.html > > > Sent from the Solr - User mailing list archive at Nabble.com. > > > > > >
