I am seeing that after some time hard commits in all my solr cores stop and
each one's searcher has an "opened at" date to be hours ago even though they
are continuing to ingesting data successfully (index size increasing
continuously).

http://localhost:8983/solr/#/xxxxx-core/plugins?type=core&entry=searcher
"openedAt: 2018-02-08T01:52:24.950Z"

Is there something I am doing incorrectly in my config ?

I setup my solrconfig.xml without <updateLog> for my "bulk indexing" use
cases.

solrConfig.xml:-
  <indexConfig>
    <lockType>none</lockType>
    <ramBufferSizeMB>200</ramBufferSizeMB>
    <mergeScheduler
class="org.apache.lucene.index.ConcurrentMergeScheduler">
      <int name="maxThreadCount">1</int>
      <int name="maxMergeCount">5</int>
    </mergeScheduler>
  </indexConfig>

  <updateHandler class="solr.DirectUpdateHandler2">
    <autoCommit>
      <maxTime>${solr.autoCommit.maxTime:10000}</maxTime>
      <openSearcher>true</openSearcher>
    </autoCommit>
    <autoSoftCommit>
      <maxTime>${solr.autoSoftCommit.maxTime:-1}</maxTime>
      <maxDocs>${solr.autoSoftCommit.maxDocs:-1}</maxDocs>
      <openSearcher>false</openSearcher>
    </autoSoftCommit>
  </updateHandler>

Thread dump:-
"commitScheduler-20-thread-1" #391 prio=5 os_prio=0 tid=0x00007ef194011000
nid=0x43a in Object.wait() [0x00007ec99533f000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at
org.apache.lucene.index.ConcurrentMergeScheduler.doStall(ConcurrentMergeScheduler.java:616)
        - eliminated <0x000000027005a0f0> (a
org.apache.lucene.index.ConcurrentMergeScheduler)
        at
org.apache.lucene.index.ConcurrentMergeScheduler.maybeStall(ConcurrentMergeScheduler.java:602)
        - locked <0x000000027005a0f0> (a
org.apache.lucene.index.ConcurrentMergeScheduler)
        at
org.apache.lucene.index.ConcurrentMergeScheduler.merge(ConcurrentMergeScheduler.java:524)
        - locked <0x000000027005a0f0> (a
org.apache.lucene.index.ConcurrentMergeScheduler)
        at
org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:2083)
        at
org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:487)
        at
org.apache.lucene.index.StandardDirectoryReader.doOpenFromWriter(StandardDirectoryReader.java:291)
        at
org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:276)
        at
org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:235)
        at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1980)
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2189)
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1926)
        at
org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:675)
        - locked <0x000000026f20bb88> (a java.lang.Object)
        at org.apache.solr.update.CommitTracker.run(CommitTracker.java:217)
        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Reply via email to