Re: High CPU and Physical Memory Usage in solr with 4000 user load

2018-02-13 Thread rubi.hali
Hi Shawn As asked, have attached the gc log and snapshot of top command TopCommandSlave1.jpg and regarding blocked threads, we are fetching facets and doing grouping with the main query and for those fields docValues were no

Re: High CPU and Physical Memory Usage in solr with 4000 user load

2018-02-09 Thread Shawn Heisey
On 2/9/2018 12:48 AM, rubi.hali wrote: As threads are blocked , our cpu is reaching to 90% even even when heap or os memory is not getting used at all. One of the BLOCKED Thread Snippet Most of the threads are blocked either on Jetty Connector or FieldCacheIMPL for DOC values. Slave1ThreadDump5

Re: High CPU and Physical Memory Usage in solr with 4000 user load

2018-02-09 Thread rubi.hali
Hi Shawn We tried one more round of testing after We increased CPU cores on each server from 4 to 16 which amounts to 64 cores in total against 4 slaves.But Still CPU Usage was higher.So We took the thread dumps on one of our slaves and found that threads were blocked. Have also attached them. As

Re: High CPU and Physical Memory Usage in solr with 4000 user load

2018-02-08 Thread Shawn Heisey
On 2/8/2018 12:41 AM, rubi.hali wrote: > We are using Solr-6.6.2 with one master and 4 Slaves each having 4 CPU core > and 16GB RAM. We were doing load testing with 4000 users and 800 odd search > keywords which resulted into 95% of CPU usage in less than 3 minutes and > affected our QUERY Response

High CPU and Physical Memory Usage in solr with 4000 user load

2018-02-08 Thread rubi.hali
Hi We are using Solr-6.6.2 with one master and 4 Slaves each having 4 CPU core and 16GB RAM. We were doing load testing with 4000 users and 800 odd search keywords which resulted into 95% of CPU usage in less than 3 minutes and affected our QUERY Responses. There was spike in physical memory also