On 7/26/2014 5:15 PM, Nathan Neulinger wrote: > Recently deployed haproxy in front of my solr instances, and seeing a > large number of exceptions in the logs now... Example below. I can pound > the server with requests against /solr/admin/ping via curl, with no > obvious issue, but the haproxy checks appear to be aggravating something. > > Solr 4.8.0 w/ solr cloud, 2 nodes, 3 zk, linux x86_64 > > It seems like when the issue occurs, I get a set of the errors all in a > burst (below), never just one. > > Suggestions? > > -- Nathan > > ------------------------------------------------------------ > Nathan Neulinger nn...@neulinger.org > Neulinger Consulting (573) 612-1412 > > > > 2014-07-26 23:04:36,506 ERROR qtp1532385072-4864 > [g.apache.solr.servlet.SolrDispatchFilter] - > null:org.eclipse.jetty.io.EofException
EofException means that the client has disconnected the TCP connection before Solr has responded to the request. I assume that this is the httpchk config to make sure that the server is operational. If so, you need to increase the "timeout check" value, because it is too small. The ping request is taking longer to run than you have allowed in the timeout. Here's part of my haproxy config: listen idx_nc bind 0.0.0.0:8984 option httpchk GET /solr/ncmain/admin/ping balance leastconn timeout check 4990 server idxa1 10.100.0.240:8981 check inter 5s fastinter 2s rise 3 fall 2 weight 100 server idxb1 10.100.0.241:8981 check inter 5s fastinter 2s rise 3 fall 2 weight 100 backup server idxa2 10.100.0.242:8981 check inter 15s fastinter 2s rise 2 fall 1 weight 2 backup server idxb2 10.100.0.243:8981 check inter 15s fastinter 2s rise 2 fall 1 weight 1 backup If you have allowed what you think is plenty of time, then you may need to investigate Solr's performance or the specific query that you are using for the ping. http://wiki.apache.org/solr/SolrPerformanceProblems Thanks, Shawn