I have a Replica marked as down in Production, but the diagnostics as to
why it's down are useless. All we see is a NullPointerException
I see this error message in the log:
2017-10-30 14:17:39.008 ERROR (qtp472654579-39773) [ ] o.a.s.s.HttpSolrCall
null:org.apache.solr.common.SolrException: SolrCore
'bb-catalog-product_shard1_replica2' is not available due to init failure:
null
This is the stack trace:
Exception in thread "Thread-7970" org.apache.solr.common.SolrException:
SolrCore 'bb-catalog-product_shard1_replica2' is not available due to init
failure: null
at org.apache.solr.core.CoreContainer.getCore(
CoreContainer.java:1092)
at org.apache.solr.handler.admin.CoreAdminOperation.lambda$
null$9(CoreAdminOperation.java:566)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
at org.apache.solr.update.TransactionLog$FSReverseReader.<init>(
TransactionLog.java:715)
at org.apache.solr.update.TransactionLog.getReverseReader(
TransactionLog.java:597)
at org.apache.solr.update.UpdateLog$RecentUpdates.
update(UpdateLog.java:995)
at org.apache.solr.update.UpdateLog$RecentUpdates.<init>
(UpdateLog.java:935)
at org.apache.solr.update.UpdateLog.getRecentUpdates(
UpdateLog.java:1099)
at org.apache.solr.update.UpdateLog.seedBucketsWithHighestVersion(
UpdateLog.java:1575)
at org.apache.solr.update.UpdateLog.seedBucketsWithHighestVersion(
UpdateLog.java:1603)
at org.apache.solr.core.SolrCore.seedVersionBuckets(SolrCore.
java:859)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:843)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:688)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:838)
at org.apache.solr.core.CoreContainer.lambda$load$0(
CoreContainer.java:494)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$
MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(
ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(
ThreadPoolExecutor.java:624)
... 1 more
Exception in thread "Thread-7971" org.apache.solr.common.SolrException:
SolrCore 'bb-catalog-product_shard1_replica2' is not available due to init
failure: null
at org.apache.solr.core.CoreContainer.getCore(
CoreContainer.java:1092)
at org.apache.solr.handler.admin.CoreAdminOperation.lambda$
null$9(CoreAdminOperation.java:566)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
at org.apache.solr.update.TransactionLog$FSReverseReader.<init>(
TransactionLog.java:715)
at org.apache.solr.update.TransactionLog.getReverseReader(
TransactionLog.java:597)
at org.apache.solr.update.UpdateLog$RecentUpdates.
update(UpdateLog.java:995)
at org.apache.solr.update.UpdateLog$RecentUpdates.<init>
(UpdateLog.java:935)
at org.apache.solr.update.UpdateLog.getRecentUpdates(
UpdateLog.java:1099)
at org.apache.solr.update.UpdateLog.seedBucketsWithHighestVersion(
UpdateLog.java:1575)
at org.apache.solr.update.UpdateLog.seedBucketsWithHighestVersion(
UpdateLog.java:1603)
at org.apache.solr.core.SolrCore.seedVersionBuckets(SolrCore.
java:859)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:843)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:688)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:838)
at org.apache.solr.core.CoreContainer.lambda$load$0(
CoreContainer.java:494)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$
MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(
ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(
ThreadPoolExecutor.java:624)
... 1 more
This is from a Solr 6.2.0 solrcloud
This is a cdcr replication target
There was an error in a Zookeeper log, it's hard to know if it is symptom
or a cause
2017-10-28 14:42:18,951 [myid:2] - ERROR [LearnerHandler-/10.121.0.61:43192
:LearnerHandler@631] - Unexpected exception causing shutdown while sock
still open
java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:210)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
at java.io.DataInputStream.readInt(DataInputStream.java:387)
at
org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:63)
at
org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:83)
at
org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:99)
at
org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:542)
Any suggestions?
--
This message and any attachment are confidential and may be privileged or
otherwise protected from disclosure. If you are not the intended recipient,
you must not copy this message or attachment or disclose the contents to
any other person. If you have received this transmission in error, please
notify the sender immediately and delete the message and any attachment
from your system. Merck KGaA, Darmstadt, Germany and any of its
subsidiaries do not accept liability for any omissions or errors in this
message which may arise as a result of E-Mail-transmission or for damages
resulting from any unauthorized changes of the content of this message and
any attachment thereto. Merck KGaA, Darmstadt, Germany and any of its
subsidiaries do not guarantee that this message is free of viruses and does
not accept liability for any damages caused by any virus transmitted
therewith.
Click http://www.emdgroup.com/disclaimer to access the German, French,
Spanish and Portuguese versions of this disclaimer.
