Not users... robots! Slurp/Yahoo, Googlebot, etc. I had friendly URLs for query with filters like http://.../USA/ showing all documents from SOLR with country=USA, with pagination; I disabled it now. But URLs like http://.../?q=USA are still dangerous, I need to limit pagination programmatically.
> -----Original Message----- > From: Walter Underwood [mailto:wun...@wunderwood.org] > Sent: December-24-09 11:37 AM > To: solr-user@lucene.apache.org > Subject: Re: SOLR Performance Tuning: Pagination > > When do users do a query like that? --wunder > > On Dec 24, 2009, at 8:09 AM, Fuad Efendi wrote: > > > I used pagination for a while till found this... > > > > > > I have filtered query ID:[* TO *] returning 20 millions results (no > > faceting), and pagination always seemed to be fast. However, fast only > with > > low values for start=12345. Queries like start=28838540 take 40-60 > seconds, > > and even cause OutOfMemoryException. > > > > I use highlight, faceting on nontokenized "Country" field, standard > handler. > > > > > > It even seems to be a bug... > > > > > > Fuad Efendi > > +1 416-993-2060 > > http://www.linkedin.com/in/liferay > > > > Tokenizer Inc. > > http://www.tokenizer.ca/ > > Data Mining, Vertical Search > >
