Do you have auto commit (not softAutoCommit) on? At what value? Are you ever opening a new searcher?
- Mark On 12/27/2013 05:17 AM, YouPeng Yang wrote: > Hi > There is a failed core in my solrcloud cluster(solr 4.6 with hdfs 2.2) > when I start my solrcloud . I noticed that there are lots of tlog files [1] > . > The start proccess was stuck ,it need to do log replay.However it > encountered error[2]. > I do think that it is abnormal that there are still a lot of tlogs.(I > compare it with other normal cores in my solrCloud, even there are only 1 > tlog file in normal cores). Which conditions wil lead to this abnormal > lots of tlog files? I try many times hoping to replay the this,but i > failed. > Please give some suggestions. > > > Regards > [1]------------------------------------------- > ...... > -rw-r--r-- 1 solr solr 23462198 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000676 > -rw-r--r-- 1 solr solr 26083634 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000677 > -rw-r--r-- 1 solr solr 25428275 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000678 > -rw-r--r-- 1 solr solr 15794489 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000679 > -rw-r--r-- 1 solr solr 23593272 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000680 > -rw-r--r-- 1 solr solr 23068981 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000681 > -rw-r--r-- 1 solr solr 21889334 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000682 > -rw-r--r-- 1 solr solr 23331127 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000683 > -rw-r--r-- 1 solr solr 22675763 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000684 > -rw-r--r-- 1 solr solr 21954870 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000685 > -rw-r--r-- 1 solr solr 21496118 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000686 > -rw-r--r-- 1 solr solr 20775222 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000687 > -rw-r--r-- 1 solr solr 24183093 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000688 > -rw-r--r-- 1 solr solr 24183090 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000689 > -rw-r--r-- 1 solr solr 24379701 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000690 > -rw-r--r-- 1 solr solr 25887033 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000691 > -rw-r--r-- 1 solr solr 25231672 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000692 > -rw-r--r-- 1 solr solr 15335737 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000693 > -rw-r--r-- 1 solr solr 8529530 2013-12-27 14:33 > /solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000742 > > [2]------------------------------------------------------------- > 133462 [recoveryExecutor-48-thread-1] WARN > org.apache.solr.update.UpdateLog – Starting log replay hdfs > tlog{file=hdfs://lklcluster/solr/repCore/repCore/core_node2 > 0/data/tlog/tlog.0000000000000000693 refcount=2} active=false starting pos=0 > 133576 [recoveryExecutor-48-thread-1] WARN > org.apache.solr.update.UpdateLog – REYPLAY_ERR: IOException reading log > org.apache.solr.common.SolrException: Invalid Number: > java.math.BigDecimal:238124404 > at > org.apache.solr.schema.TrieField.readableToIndexed(TrieField.java:396) > at > org.apache.solr.update.AddUpdateCommand.getIndexedId(AddUpdateCommand.java:98) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:582) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:435) > at > org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100) > at > org.apache.solr.update.UpdateLog$LogReplayer.doReplay(UpdateLog.java:1313) > at org.apache.solr.update.UpdateLog$LogReplayer.run(UpdateLog.java:1202) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) > at java.lang.Thread.run(Thread.java:662) > 133623 [recoveryExecutor-48-thread-1] WARN > org.apache.solr.update.UpdateLog – REYPLAY_ERR: IOException reading log > org.apache.solr.common.SolrException: Invalid Number: > java.math.BigDecimal:238124405 > at > org.apache.solr.schema.TrieField.readableToIndexed(TrieField.java:396) > at > org.apache.solr.update.AddUpdateCommand.getIndexedId(AddUpdateCommand.java:98) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:582) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:435) > at > org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100) > at > org.apache.solr.update.UpdateLog$LogReplayer.doReplay(UpdateLog.java:1313) > at org.apache.solr.update.UpdateLog$LogReplayer.run(UpdateLog.java:1202) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) >