On 5/11/2019 8:05 AM, Saurabh Sharma wrote:
I have been observing a very unique pattern in our solr resource usage.
I am running a cluster with 3 nodes and RAM on each node is 12GB.
We are doing hard commits every 1 minute and soft commits every 15 seconds.
Under normal circumstances solr response time is ~15 ms and CPU usage of
around 200% (~2 cores) . But we have few instances where CPU load suddenly
increase to around 2000%(~ 20 cores) and response time increase to 1000ms
.At the time this situation happen , almost every query start taking time
and CPU usage keeps on increasing for around 30 mins and even restart don't
help. RAM usage remains constant for this duration.Do solr start behaving
like this under high traffic situations ? what can be the possible reasons
of very high CPU usage in real time solr.
If you get the maxDoc number from every core (index) in that Solr
instance, and add those numbers up, you'll get a total document count
for the whole node. What are those numbers?
How much disk space do all the indexes take?
What is Solr's max heap size? Are there any other programs running on
that node other than the one Solr instance? This would include multiple
Solr instances.
If you can get the screenshot mentioned at the link below, that can
reveal some of the information I have asked for above, but not all of it.
https://wiki.apache.org/solr/SolrPerformanceProblems#Asking_for_help_on_a_memory.2Fperformance_issue
What query rate is Solr handling?
Do you have multiple Solr servers for this use, or just one?
Thanks,
Shawn
