Re: Thread Usage

2016-02-26 Thread Toke Eskildsen
Azazel K wrote: [Toke: 1 shard instead of multiple?] > The nodes were unstable when we had single shard setup. > It used to run OOM frequently. Fair enough. [Toke: Use a queue instead of 1000+ concurrent requests?] > There are 16CPU on each node. Requests are live with > upstream client imp

Re: Thread Usage

2016-02-26 Thread Azazel K
softnofile 49151 Let me know what u think. Thanks, A From: Toke Eskildsen Sent: Friday, February 26, 2016 11:30 AM To: solr_user lucene_apache Subject: Re: Thread Usage Azazel K wrote: > We have solr cluster with 2 shards running 2 nodes on each shard

Re: Thread Usage

2016-02-26 Thread Toke Eskildsen
you tried with 1 shard to see if the latency is acceptable for that? > Two times this week we have seen the thread usage spike from the > usual 1000 to 4000 on all nodes at the same time and bring down > the cluster. First guess: You are updating too frequently and hitting multiple over

Thread Usage

2016-02-26 Thread Azazel K
Hi, We have solr cluster with 2 shards running 2 nodes on each shard. They are beefy physical boxes with index size of 162 GB , RAM of about 96 GB and around 153M documents. Two times this week we have seen the thread usage spike from the usual 1000 to 4000 on all nodes at the same time