Hi
There is a failed core in my solrcloud cluster(solr 4.6 with hdfs 2.2)
when I start my solrcloud . I noticed that there are lots of tlog files [1]
.
The start proccess was stuck ,it need to do log replay.However it
encountered error[2].
I do think that it is abnormal that there are still a lot of tlogs.(I
compare it with other normal cores in my solrCloud, even there are only 1
tlog file in normal cores). Which conditions wil lead to this abnormal
lots of tlog files? I try many times hoping to replay the this,but i
failed.
Please give some suggestions.
Regards
[1]-------------------------------------------
......
-rw-r--r-- 1 solr solr 23462198 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000676
-rw-r--r-- 1 solr solr 26083634 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000677
-rw-r--r-- 1 solr solr 25428275 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000678
-rw-r--r-- 1 solr solr 15794489 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000679
-rw-r--r-- 1 solr solr 23593272 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000680
-rw-r--r-- 1 solr solr 23068981 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000681
-rw-r--r-- 1 solr solr 21889334 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000682
-rw-r--r-- 1 solr solr 23331127 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000683
-rw-r--r-- 1 solr solr 22675763 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000684
-rw-r--r-- 1 solr solr 21954870 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000685
-rw-r--r-- 1 solr solr 21496118 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000686
-rw-r--r-- 1 solr solr 20775222 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000687
-rw-r--r-- 1 solr solr 24183093 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000688
-rw-r--r-- 1 solr solr 24183090 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000689
-rw-r--r-- 1 solr solr 24379701 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000690
-rw-r--r-- 1 solr solr 25887033 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000691
-rw-r--r-- 1 solr solr 25231672 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000692
-rw-r--r-- 1 solr solr 15335737 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000693
-rw-r--r-- 1 solr solr 8529530 2013-12-27 14:33
/solr/repCore/repCore/core_node20/data/tlog/tlog.0000000000000000742
[2]-------------------------------------------------------------
133462 [recoveryExecutor-48-thread-1] WARN
org.apache.solr.update.UpdateLog – Starting log replay hdfs
tlog{file=hdfs://lklcluster/solr/repCore/repCore/core_node2
0/data/tlog/tlog.0000000000000000693 refcount=2} active=false starting pos=0
133576 [recoveryExecutor-48-thread-1] WARN
org.apache.solr.update.UpdateLog – REYPLAY_ERR: IOException reading log
org.apache.solr.common.SolrException: Invalid Number:
java.math.BigDecimal:238124404
at
org.apache.solr.schema.TrieField.readableToIndexed(TrieField.java:396)
at
org.apache.solr.update.AddUpdateCommand.getIndexedId(AddUpdateCommand.java:98)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:582)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:435)
at
org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100)
at
org.apache.solr.update.UpdateLog$LogReplayer.doReplay(UpdateLog.java:1313)
at org.apache.solr.update.UpdateLog$LogReplayer.run(UpdateLog.java:1202)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
133623 [recoveryExecutor-48-thread-1] WARN
org.apache.solr.update.UpdateLog – REYPLAY_ERR: IOException reading log
org.apache.solr.common.SolrException: Invalid Number:
java.math.BigDecimal:238124405
at
org.apache.solr.schema.TrieField.readableToIndexed(TrieField.java:396)
at
org.apache.solr.update.AddUpdateCommand.getIndexedId(AddUpdateCommand.java:98)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:582)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:435)
at
org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100)
at
org.apache.solr.update.UpdateLog$LogReplayer.doReplay(UpdateLog.java:1313)
at org.apache.solr.update.UpdateLog$LogReplayer.run(UpdateLog.java:1202)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
