Re: Caching Solr Grouping Results

2018-05-20 Thread rubi.hali
Hi Yasufumi Thanks for the reply. Yes, you are correct. I also checked the code and it seems the same. We are facing performance issues due to grouping so wanted to be sure that we are not leaving out any possibility of caching the same in Query Result Cache. was just exploring field collapsing

Caching Solr Grouping Results

2018-05-18 Thread rubi.hali
Hi All Can somebody please explain if we can cache solr grouping results in query result cache as i dont see any inserts in query result cache once we enabled grouping? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: High CPU and Physical Memory Usage in solr with 4000 user load

2018-02-13 Thread rubi.hali
Hi Shawn As asked, have attached the gc log and snapshot of top command TopCommandSlave1.jpg and regarding blocked threads, we are fetching facets and doing grouping with the main query and for those fields docValues were no

Re: High CPU and Physical Memory Usage in solr with 4000 user load

2018-02-09 Thread rubi.hali
Hi Shawn We tried one more round of testing after We increased CPU cores on each server from 4 to 16 which amounts to 64 cores in total against 4 slaves.But Still CPU Usage was higher.So We took the thread dumps on one of our slaves and found that threads were blocked. Have also attached them. As

High CPU and Physical Memory Usage in solr with 4000 user load

2018-02-08 Thread rubi.hali
Hi We are using Solr-6.6.2 with one master and 4 Slaves each having 4 CPU core and 16GB RAM. We were doing load testing with 4000 users and 800 odd search keywords which resulted into 95% of CPU usage in less than 3 minutes and affected our QUERY Responses. There was spike in physical memory also

Re: No inserts in Query Result Cache

2018-01-24 Thread rubi.hali
Did some further digging and found that as grouping is enabled query result cache is not having any inserts . Only disabling grouping adds an entry in query result cache. Is there a way we can cache grouped results because as per wiki there is parameter group.cache.percent but then again it doesnt

Re: how to recover from OpenSearcher called on closed core

2017-09-29 Thread rubi.hali
Hi Eric No its not NFS. It is ext4. Our solr is going again and again into OOM error. I am really not sure will it be because of this exception. But what I observed was Whenever we will increase polling interval, heap memory will grow at slower rate as compared to lesser polling interval. But we

Re: how to recover from OpenSearcher called on closed core

2017-09-28 Thread rubi.hali
Hi Nawaz No we are not doing any upgradation. We hardly have 3 documents so we dont feel the need of having a cloud configuration Regarding d exception we analyzed before this error comes We always see Cahching Directory Factory closing the core Plus we tried Solr 6.2 version and the same e

how to recover from OpenSearcher called on closed core

2017-09-28 Thread rubi.hali
Hi we are using Solr 6.1.0 version. We have done a Master/Slave Setup where in Slaves we have enabled replication polling after 300 seconds But after every replication poll, we are getting an error : Index Fetch Failed: opening NewSearcher called on closed core. We have enabled softcommit after

how to recover from OpenSearcher called on closed core

2017-09-28 Thread rubi.hali
Hi We are using solr6.1 version and have a master slave setup. We have one master and two slaves . We have enabled replication poll on slaves at an interval of 300s which results into an error and says *Index Fetch Failed : Open NewSearcher Called on closed core* And our commit strategy involve