Hi,
I am committing every 5 minutes using a periodic cron job "curl
http://localhost:8984/solr/core1/update?commit=true";. Besides this, my app
doesn't do any soft or hard commits. With Solr 7 upgrade, I am noticing
that query throughput plummets every 5 minutes - probably when the commit
happens.
What can I do to improve this? I didn't use to happen like this in solr4.5.
(i.e., i used to get a stable query throughput of 50-60 queries per
second. Now there are spikes to 60 qps interleaved by drops to almost
**0**). Between those 5 minutes, I am able to achieve high throughput,
hence I guess that issue is related to indexing or merging, and not query
flow.
I have 48G allotted to each solr process, and it seems that only ~50% is
being used at any time, similarly CPU is not spiking beyond 50% either.
There is frequent merging (every 5 minute) , but i am not sure if that is
a cause of the slowdown.
Here are my merge and cache settings:
Thanks
Nawab
<mergePolicyFactory class="org.apache.solr.index.TieredMergePolicyFactory">
<int name="maxMergeAtOnce">5</int>
<int name="segmentsPerTier">5</int>
<int name="maxMergeAtOnceExplicit">10</int>
<int name="floorSegmentMB">16</int>
<!-- 50 gb -->
<double name="maxMergedSegmentMB">50000</double>
<double name="forceMergeDeletesPctAllowed">1</double>
</mergePolicyFactory>
<filterCache class="solr.FastLRUCache"
size="10240"
initialSize="5120"
autowarmCount="1024"/>
<queryResultCache class="solr.LRUCache"
size="10240"
initialSize="5120"
autowarmCount="0"/>
<documentCache class="solr.LRUCache"
size="10240"
initialSize="5120"
autowarmCount="0"/>
<useColdSearcher>false</useColdSearcher>
<maxWarmingSearchers>2</maxWarmingSearchers>
<listener event="newSearcher" class="solr.QuerySenderListener">
<arr name="queries">
</arr>
</listener>
<listener event="firstSearcher" class="solr.QuerySenderListener">
<arr name="queries">
</arr>
</listener>
