In addition to Alexandre's comments, I've occasionally seen something like this happen when _very_ large packets were being transmitted back and forth. You might have to up the packet size allowed by the servelet. But that's a guess...
Best, Erick On Fri, Nov 21, 2014 at 4:04 AM, Alexandre Rafalovitch <arafa...@gmail.com> wrote: > Looks like something reset the connection between the Solr server you are > talking to and the one hosting the other shard ( > http://192.168.120.202:8080/solr) > > I would check the logs of the _other_ server and see if something is there. > > Otherwise, I would look into something like a firewall in between two Solr > servers and perhaps a response taking so long that the firewall kills the > connection in between. > > Regards, > Alex. > > On 21/11/2014 6:02 am, "馬 飛虎" <f...@chip1stop.com> wrote: >> >> Hi >> >> We used Solr4.6 for search and there was a exception occured randomly. >> The exception message in application(use SolrJ) was : >> >> org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: >> org.apache.solr.client.solrj.SolrServerException: IOException occured >> when talking to server at: http://192.168.xxx.xxx:8080/solr >> at >> > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:495) >> at >> > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199) >> at >> > org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90) >> at > org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:310) >> at search.Searcher.search(Searcher.java:379) >> at search.Searcher.doSearchFull(Searcher.java:105) >> at >> > com.c1s.common.search.YuukyuuSearcher.doSearchFull(YuukyuuSearcher.java:128) >> at >> > com.c1s.common.dispPartInfoList.DispPartInfoListUtils.getNewPatSyubetu(DispPartInfoListUtils.java:802) >> at >> > com.c1s.common.dispPartInfoList.DispPartInfoListUtils.getDetailPartInfo(DispPartInfoListUtils.java:1459) >> at >> > userweb.action.dispDetail.DispDetailAction.doExecute(DispDetailAction.java:411) >> at com.c1s.action.BaseAction.execute(BaseAction.java:193) >> at >> > org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:431) >> at >> > org.seasar.struts.processor.S2RequestProcessor.processActionPerform(S2RequestProcessor.java:145) >> at > org.seasar.struts.processor.AcceptorImpl.process(AcceptorImpl.java:133) >> at >> > org.seasar.struts.processor.S2RequestProcessor.process(S2RequestProcessor.java:74) >> at > org.apache.struts.action.ActionServlet.process(ActionServlet.java:1196) >> at > org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:414) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:718) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:831) >> at >> > org.apache.catalina.core.ApplicationFilterChain.servletService(ApplicationFilterChain.java:411) >> at >> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:317) >> at >> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:198) >> at >> > com.c1s.action.RequestParameterFilter.doFilter(RequestParameterFilter.java:84) >> at >> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230) >> at >> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:198) >> at >> > org.seasar.extension.filter.EncodingFilter.doFilter(EncodingFilter.java:62) >> at >> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230) >> at >> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:198) >> at > org.seasar.struts.filter.S2StrutsFilter.doFilter(S2StrutsFilter.java:50) >> at >> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230) >> at >> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:198) >> at >> > org.seasar.framework.container.filter.S2ContainerFilter.doFilter(S2ContainerFilter.java:60) >> at >> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230) >> at >> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:198) >> at com.c1s.action.SessionFilter.doFilter(SessionFilter.java:99) >> at >> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230) >> at >> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:198) >> at com.c1s.action.UrlFilter.doFilter(UrlFilter.java:354) >> at >> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230) >> at >> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:198) >> at >> > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:288) >> at >> > org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:271) >> at >> > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:202) >> at >> > org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) >> at >> > org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) >> at com.sun.enterprise.web.WebPipeline.invoke(WebPipeline.java:94) >> at >> > com.sun.enterprise.web.PESessionLockingStandardPipeline.invoke(PESessionLockingStandardPipeline.java:96) >> at >> > com.sun.enterprise.ee.web.sessmgmt.SessionLockingStandardPipeline.invoke(SessionLockingStandardPipeline.java:120) >> at >> > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:206) >> at >> > org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) >> at >> > org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) >> at >> > org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) >> at > org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:1080) >> at >> > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:150) >> at >> > org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) >> at >> > org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) >> at >> > org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) >> at > org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:1080) >> at > org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:272) >> at > org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:200) >> at > org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:283) >> at > org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:773) >> at >> > org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:703) >> at >> > org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java:895) >> at >> > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:666) >> at java.lang.Thread.run(Thread.java:619) >> >> >> >> And the message in solr server is : >> org.apache.solr.common.SolrException: >> org.apache.solr.client.solrj.SolrServerException: IOException occured >> when talking to server at: http://192.168.120.202:8080/solr >> at >> > org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:302) >> at >> > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) >> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1859) >> at >> > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:721) >> at >> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:417) >> at >> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201) >> at >> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) >> at >> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) >> at >> > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) >> at >> > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) >> at >> > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) >> at >> > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98) >> at >> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) >> at >> > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) >> at >> > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408) >> at >> > org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1040) >> at >> > org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607) >> at >> > org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:313) >> at >> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >> at >> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >> at java.lang.Thread.run(Thread.java:745) >> Caused by: org.apache.solr.client.solrj.SolrServerException: IOException >> occured when talking to server at: http://192.168.120.202:8080/solr >> at >> > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:507) >> at >> > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199) >> at >> > org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156) >> at >> > org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:118) >> at java.util.concurrent.FutureTask.run(FutureTask.java:262) >> at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >> at java.util.concurrent.FutureTask.run(FutureTask.java:262) >> ... 3 more >> Caused by: java.net.SocketException: Connection reset >> at java.net.SocketInputStream.read(SocketInputStream.java:196) >> at java.net.SocketInputStream.read(SocketInputStream.java:122) >> at >> > org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:166) >> at >> > org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:90) >> at >> > org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:281) >> at >> > org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:92) >> at >> > org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:61) >> at >> > org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254) >> at >> > org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289) >> at >> > org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252) >> at >> > org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191) >> at >> > org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300) >> at >> > org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127) >> at >> > org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:715) >> at >> > org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:520) >> at >> > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906) >> at >> > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805) >> at >> > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784) >> at >> > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:395) >> ... 9 more >> >> We thought this occured because of the solrServer has too many >> connections at 1 second, >> But we used Jmeter to simulate a very heavy load on the solrSever,and >> the similar Excepion was not hanppened. >> >> We used SolrJ in the application,and the SolrServer class was >> HttpSolrServer class with the default HttpClient. >> The solr was run on Tomcat,and the Tomcat config was the default config. >> And now we still receive this Exception a few times a day. >> >> Any ideas on what the root cause of this issue may be and how we can >> remediate it. >> >> Thanks.
