FWIW the real error is msg":"SolrCore is loading which is bad if you are in the middle of indexing
What is happening on solr at this time? > On Jul 20, 2020, at 4:46 AM, Charlie Hull <char...@flax.co.uk> wrote: > > Hi Austin, > > Sitecore is a commercial product so your first port of call should be whoever > sold you or is supporting Sitecore....a quick (and by no means deep) bit of > research shows this error may be generated by the Sitecore indexer process > calling Solr. We won't be able to see how it does that if it's closed source > code. > > Cheers > > Charlie > >> On 20/07/2020 04:53, Austin Kimmel wrote: >> Hello, >> >> We are seeing the following errors with Sitecore 9.3 connecting to a Solr >> 8.1.1 cluster running on Zookeeper and haven't been able to resolve: >> >> >> 2020-07-17 18:10:58.238 WARN (zkCallback-8-thread-3) >> [c:pj4_sitecore_web_index s:shard1 r:core_node5 >> x:pj4_sitecore_web_index_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: >> core=pj4_sitecore_web_index_shard1_replica_n2 >> url=https://10.5.64.40:8984/solr got a 503 from >> https://10.5.64.41:8984/solr/pj4_sitecore_web_index_shard1_replica_n1/, >> counting as success => >> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error >> from server at >> https://10.5.64.41:8984/solr/pj4_sitecore_web_index_shard1_replica_n1: >> Expected mime type application/octet-stream but got application/json. { >> "error":{ "metadata":[ >> "error-class","org.apache.solr.common.SolrException", >> "root-error-class","org.apache.solr.common.SolrException"], >> "msg":"SolrCore is loading", "code":503}} >> >> at >> org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:613) >> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error >> from server at >> https://10.5.64.41:8984/solr/pj4_sitecore_web_index_shard1_replica_n1: >> Expected mime type application/octet-stream but got application/json. { >> "error":{ "metadata":[ >> "error-class","org.apache.solr.common.SolrException", >> "root-error-class","org.apache.solr.common.SolrException"], >> "msg":"SolrCore is loading", "code":503}} >> >> >> 2020-07-17 18:10:58.276 ERROR (zkCallback-8-thread-3) >> [c:pj4_sitecore_web_index s:shard1 r:core_node5 >> x:pj4_sitecore_web_index_shard1_replica_n2] o.a.s.c.SyncStrategy Sync >> request error: >> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error >> from server at >> https://10.5.64.41:8984/solr/pj4_sitecore_web_index_shard1_replica_n1: >> Expected mime type application/octet-stream but got application/json. { >> "error":{ "metadata":[ >> "error-class","org.apache.solr.common.SolrException", >> "root-error-class","org.apache.solr.common.SolrException"], >> "msg":"SolrCore is loading", "code":503}} >> >> >> 2020-07-17 18:10:59.598 ERROR (qtp1661210650-149) [ ] o.a.s.s.HttpSolrCall >> null:org.apache.solr.common.SolrException: Error trying to proxy request for >> url: https://10.5.64.42:8984/solr/pj4_sitecore_web_index/admin/ping at >> org.apache.solr.servlet.HttpSolrCall.remoteQuery(HttpSolrCall.java:692) >> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:526) at >> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:397) >> at >> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:343) >> at >> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1602) >> at >> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) >> at >> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) >> at >> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) >> at >> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1588) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) >> at >> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) >> at >> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480) >> at >> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1557) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) >> at >> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) >> at >> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) >> at >> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126) >> at >> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) >> at >> org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335) >> at >> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) >> at org.eclipse.jetty.server.Server.handle(Server.java:502) at >> org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:364) at >> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) >> at >> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) >> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) >> at >> org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:411) >> at >> org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:305) >> at >> org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:159) >> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) >> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) >> at >> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) >> at >> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) >> at >> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) >> at >> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) >> at >> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) >> at >> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765) >> at >> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683) >> at java.base/java.lang.Thread.run(Thread.java:830) Caused by: >> org.apache.http.conn.HttpHostConnectException: Connect to 10.5.64.42:8984 >> [/10.5.64.42] failed: Connection refused: no further information at >> org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159) >> at >> org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:373) >> at >> org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:394) >> at >> org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) >> at >> org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) >> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) >> at >> org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) >> at >> org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) >> at >> org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) >> at >> org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56) >> at >> org.apache.solr.servlet.HttpSolrCall.remoteQuery(HttpSolrCall.java:664) >> ... 41 more Caused by: java.net.ConnectException: Connection refused: no >> further information at java.base/sun.nio.ch.Net.pollConnect(Native >> Method) at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:579) at >> java.base/sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:549) >> at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:597) >> at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:339) >> at java.base/java.net.Socket.connect(Socket.java:603) at >> org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339) >> at >> org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) >> ... 51 more >> >> >> 2020-07-17 18:10:59.603 ERROR (qtp1661210650-22) [ ] o.a.s.s.HttpSolrCall >> null:org.apache.solr.common.SolrException: Error trying to proxy request for >> url: https://10.5.64.42:8984/solr/pj4_sitecore_web_index/admin/ping at >> org.apache.solr.servlet.HttpSolrCall.remoteQuery(HttpSolrCall.java:692) >> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:526) at >> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:397) >> at >> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:343) >> at >> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1602) >> at >> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) >> at >> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) >> at >> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) >> at >> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1588) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) >> at >> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) >> at >> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480) >> at >> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1557) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) >> at >> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) >> at >> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) >> at >> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126) >> at >> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) >> at >> org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335) >> at >> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) >> at org.eclipse.jetty.server.Server.handle(Server.java:502) at >> org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:364) at >> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) >> at >> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) >> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) >> at >> org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:411) >> at >> org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:305) >> at >> org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:159) >> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) >> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) >> at >> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) >> at >> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) >> at >> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) >> at >> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) >> at >> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) >> at >> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765) >> at >> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683) >> at java.base/java.lang.Thread.run(Thread.java:830) Caused by: >> org.apache.http.conn.HttpHostConnectException: Connect to 10.5.64.42:8984 >> [/10.5.64.42] failed: Connection refused: no further information at >> org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159) >> at >> org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:373) >> at >> org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:394) >> at >> org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) >> at >> org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) >> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) >> at >> org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) >> at >> org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) >> at >> org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) >> at >> org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56) >> at >> org.apache.solr.servlet.HttpSolrCall.remoteQuery(HttpSolrCall.java:664) >> ... 41 more Caused by: java.net.ConnectException: Connection refused: no >> further information at java.base/sun.nio.ch.Net.pollConnect(Native >> Method) at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:579) at >> java.base/sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:549) >> at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:597) >> at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:339) >> at java.base/java.net.Socket.connect(Socket.java:603) at >> org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339) >> at >> org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) >> ... 51 more >> >> >> 2020-07-17 18:11:05.350 ERROR >> (updateExecutor-5-thread-7-processing-n:10.5.64.40:8984_solr >> x:pj4_sitecore_web_index_shard1_replica_n2 c:pj4_sitecore_web_index s:shard1 >> r:core_node5) [c:pj4_sitecore_web_index s:shard1 r:core_node5 >> x:pj4_sitecore_web_index_shard1_replica_n2] o.a.s.u.SolrCmdDistributor >> org.apache.solr.client.solrj.SolrServerException: IOException occured when >> talking to server at: null >> >> at >> org.apache.solr.client.solrj.impl.Http2SolrClient.request(Http2SolrClient.java:416) >> >> >> Thanks! >> >> Austin Kimmel >> Software Developer >> Vail Resorts, Inc. >> 303-404-1922 >> akim...@vailresorts.com<mailto:akim...@vailresorts.com> >> >> VAILRESORTS(r) >> EXPERIENCE OF A LIFETIME >> >> The information contained in this message is confidential and intended only >> for the use of the individual or entity named above, and may be privileged. >> Any unauthorized review, use, disclosure, or distribution is prohibited. If >> you are not the intended recipient, please reply to the sender immediately, >> stating that you have received the message in error, then please delete this >> e-mail. Thank you. >> > > -- > Charlie Hull > OpenSource Connections, previously Flax > > tel/fax: +44 (0)8700 118334 > mobile: +44 (0)7767 825828 > web: www.o19s.com > >
