bq. The new documents are reflected right away but updates to existing document take sometime from 30 seconds to couple of minutes.
Certainly your soft commit interval is far too short for comfort. If you absolutely can't lengthen it then you should not use any caching/autowarming. But I suspect you're not measuring what you think you are. New docs and updated docs are exposed by a single mechanism, so your statement seems unlikely to be true. It's possible that your very short commit intervals are causing searchers to _not_ be opened in some cases (you should be seeing warnings in your logs about "too many on deck searchers" or similar. And/or your searcher opens are being queued up and you happen to see it on updates when it's actually happening all the time. Best, Erick On Fri, Oct 12, 2018 at 8:53 AM root23 <s.manuj...@gmail.com> wrote: > > Hi all, > We are having an issue where we are seeing latency in updates. We are on > solr 6. > The new documents are reflected right away but updates to existing document > take sometime from 30 seconds to couple of minutes. > > This is some relevant things from our solrconfig. > > Our autosoft commit time is 500ms.(I know its low.) > <autoSoftCommit> > <maxTime>500</maxTime> > </autoSoftCommit> > > RambufferSize > <ramBufferSizeMB>2048</ramBufferSizeMB> > <mergeFactor>25</mergeFactor > > <int name="maxThreadCount">8</int> > <int name="maxMergeCount">16</int> > > We have ssd and 16 physical cores with HT enabled. > > > Also in our logs i see following . > Lucene flush took 0.003 seconds with 2 segments flushed and 0.022 MB flushed > > SolrMetricsEventListener.java:65 - Lucene flush took 0.001 seconds with 1 > segments flushed and 0.009 MB flushed > > SolrMetricsEventListener.java:65 - Lucene flush took 0.006 seconds with 2 > segments flushed and 0.057 MB flushed > > SolrMetricsEventListener.java:65 - Lucene flush took 0.008 seconds with 5 > segments flushed and 0.046 MB flushed > > > so if you see we are flushing too often and very small amount . May be its > because of the low autosoft commit time ? > Can someone explain to me what is going on. Are these things related. > And why is that new document addition is fast but updates take time. I know > updates have to do a delete first. Is that a reason ? > > > > -- > Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
