This is very odd. Do you by any chance have custom code in place that's not closing searchers properly? If you take a heap dump, how many searchers to you have open?
If you issue a manual commit (http://blah/solr/core/update?commit=true) what happens? Best, Erick On Wed, Feb 7, 2018 at 8:01 PM, mmb1234 <m...@vmware.com> wrote: > > I am seeing that after some time hard commits in all my solr cores stop and > each one's searcher has an "opened at" date to be hours ago even though they > are continuing to ingesting data successfully (index size increasing > continuously). > > http://localhost:8983/solr/#/xxxxx-core/plugins?type=core&entry=searcher > "openedAt: 2018-02-08T01:52:24.950Z" > > Is there something I am doing incorrectly in my config ? > > I setup my solrconfig.xml without <updateLog> for my "bulk indexing" use > cases. > > solrConfig.xml:- > <indexConfig> > <lockType>none</lockType> > <ramBufferSizeMB>200</ramBufferSizeMB> > <mergeScheduler > class="org.apache.lucene.index.ConcurrentMergeScheduler"> > <int name="maxThreadCount">1</int> > <int name="maxMergeCount">5</int> > </mergeScheduler> > </indexConfig> > > <updateHandler class="solr.DirectUpdateHandler2"> > <autoCommit> > <maxTime>${solr.autoCommit.maxTime:10000}</maxTime> > <openSearcher>true</openSearcher> > </autoCommit> > <autoSoftCommit> > <maxTime>${solr.autoSoftCommit.maxTime:-1}</maxTime> > <maxDocs>${solr.autoSoftCommit.maxDocs:-1}</maxDocs> > <openSearcher>false</openSearcher> > </autoSoftCommit> > </updateHandler> > > Thread dump:- > "commitScheduler-20-thread-1" #391 prio=5 os_prio=0 tid=0x00007ef194011000 > nid=0x43a in Object.wait() [0x00007ec99533f000] > java.lang.Thread.State: TIMED_WAITING (on object monitor) > at java.lang.Object.wait(Native Method) > at > org.apache.lucene.index.ConcurrentMergeScheduler.doStall(ConcurrentMergeScheduler.java:616) > - eliminated <0x000000027005a0f0> (a > org.apache.lucene.index.ConcurrentMergeScheduler) > at > org.apache.lucene.index.ConcurrentMergeScheduler.maybeStall(ConcurrentMergeScheduler.java:602) > - locked <0x000000027005a0f0> (a > org.apache.lucene.index.ConcurrentMergeScheduler) > at > org.apache.lucene.index.ConcurrentMergeScheduler.merge(ConcurrentMergeScheduler.java:524) > - locked <0x000000027005a0f0> (a > org.apache.lucene.index.ConcurrentMergeScheduler) > at > org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:2083) > at > org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:487) > at > org.apache.lucene.index.StandardDirectoryReader.doOpenFromWriter(StandardDirectoryReader.java:291) > at > org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:276) > at > org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:235) > at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1980) > at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2189) > at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1926) > at > org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:675) > - locked <0x000000026f20bb88> (a java.lang.Object) > at org.apache.solr.update.CommitTracker.run(CommitTracker.java:217) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > > > > -- > Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
