Re: Search timeout for Solrcloud

2012-06-05 Thread arin_g
for example when we set the start parameter to 1000, 2000 or higher (page 100, 200 ...), it takes very long (20, 30 seconds, sometimes even 100 seconds). this usually happens when there is a big gap between pages, mostly hit by web crawlers (when they crawl the last page link on our website). --

Re: Search timeout for Solrcloud

2012-06-05 Thread Jack Krupansky
I'm curious... how deep is it that is becoming problematic? Tens of pages, hundreds, thousands, millions? And when you say deep paging, are you incrementing through all pages down to the depth or "gapping" to some very large depth outright? If the former, I am wondering if the Solr cache is bu

RE: Search timeout for Solrcloud

2012-06-05 Thread Markus Jelsma
There's an open issue for improving deep paging performance: https://issues.apache.org/jira/browse/SOLR-1726 -Original message- > From:arin_g > Sent: Tue 05-Jun-2012 12:03 > To: solr-user@lucene.apache.org > Subject: Search timeout for Solrcloud > > Hi, > We use solrcloud in producti

Re: Search timeout for Solrcloud

2012-06-05 Thread Jason Rutherglen
There isn't a solution for killing long running queries that works. On Tue, Jun 5, 2012 at 1:34 AM, arin_g wrote: > Hi, > We use solrcloud in production, and we are facing some issues with queries > that take very long specially deep paging queries, these queries keep our > servers very busy. i a