Re: Solr Cloud has lower performance with more servers

2014-10-11 Thread Erick Erickson
Perhaps a really silly question, but... Is your batch job sending queries serially? In which case this is understandable and would be sensitive to the lower hit ratios in your caches. If this is the case, you still won't get 2x the performance with two servers, I'm guessing your total time to run

Re: Solr Cloud has lower performance with more servers

2014-10-10 Thread Yannick
Hi guys, Thanks a lot for the cogent feedback, much appreciated. I'll group my answers in one message. 1- (Charlie): regarding the type of queries I make: here is a typical one; it's fairly vanilla, no faceting or anything fancy. q=+((titleStart:"was sixteen")(subTitleStart:"was sixteen"))+(p

Re: Solr Cloud has lower performance with more servers

2014-10-09 Thread Erick Erickson
Just to check: your index is NOT sharded, correct? Assuming not sharded, is it SolrCloud? If not SolrCloud, how are the indexes kept in synch? Master/slave? Manual copy? But for an unchanging index, this is definitely odd. Best, Erick On Thu, Oct 9, 2014 at 7:40 AM, Walter Underwood wrote: > I

Re: Solr Cloud has lower performance with more servers

2014-10-09 Thread Walter Underwood
Is this a production log of queries, with lots of repeats? If so, you may be seeing the normal effect of lower cache hit rates. Check the hit rate for the query result cache in the two setups. With a single machine, the second occurrence of a query will be a cache hit. With two machines, it wil

Re: Solr Cloud has lower performance with more servers

2014-10-09 Thread Charlie Hull
On 09/10/2014 14:06, Yannick wrote: Hello good Solr people, I have the following surprising situation. I created a group of 2 Solr servers with a load-balancer in front (Haproxy). I have a batch client that sends requests (read-only) continuously to the load-balancer. The problem is: the perfor

Re: Solr Cloud has lower performance with more servers

2014-10-09 Thread Yannick
Hi Toke, thanks for your suggestion - definitely an interesting idea. But unfortunately no, no indexing job is running; those are static indexes being queried. The execution time is also very consistent in each condition, I did quite a few tests. Yann On Thursday, October 9, 2014 3:56 PM, T

Re: Solr Cloud has lower performance with more servers

2014-10-09 Thread Toke Eskildsen
On Thu, 2014-10-09 at 15:06 +0200, Yannick wrote: > I created a group of 2 Solr servers with a load-balancer in front > (Haproxy). I have a batch client that sends requests (read-only) > continuously to the load-balancer. The problem is: the performance is > slower with 2 servers than it is with a

Solr Cloud has lower performance with more servers

2014-10-09 Thread Yannick
Hello good Solr people, I have the following surprising situation. I created a group of 2 Solr servers with a load-balancer in front (Haproxy). I have a batch client that sends requests (read-only) continuously to the load-balancer. The problem is: the performance is slower with 2 servers than