On 7/26/2014 5:15 PM, Nathan Neulinger wrote:
> Recently deployed haproxy in front of my solr instances, and seeing a
> large number of exceptions in the logs now... Example below. I can pound
> the server with requests against /solr/admin/ping via curl, with no
> obvious issue, but the haproxy checks appear to be aggravating something.
>
> Solr 4.8.0 w/ solr cloud, 2 nodes, 3 zk, linux x86_64
>
> It seems like when the issue occurs, I get a set of the errors all in a
> burst (below), never just one.
>
> Suggestions?
>
> -- Nathan
>
> ------------------------------------------------------------
> Nathan Neulinger [email protected]
> Neulinger Consulting (573) 612-1412
>
>
>
> 2014-07-26 23:04:36,506 ERROR qtp1532385072-4864
> [g.apache.solr.servlet.SolrDispatchFilter] -
> null:org.eclipse.jetty.io.EofException
EofException means that the client has disconnected the TCP connection
before Solr has responded to the request.
I assume that this is the httpchk config to make sure that the server is
operational. If so, you need to increase the "timeout check" value,
because it is too small. The ping request is taking longer to run than
you have allowed in the timeout. Here's part of my haproxy config:
listen idx_nc
bind 0.0.0.0:8984
option httpchk GET /solr/ncmain/admin/ping
balance leastconn
timeout check 4990
server idxa1 10.100.0.240:8981 check inter 5s fastinter 2s rise
3 fall 2 weight 100
server idxb1 10.100.0.241:8981 check inter 5s fastinter 2s rise
3 fall 2 weight 100 backup
server idxa2 10.100.0.242:8981 check inter 15s fastinter 2s
rise 2 fall 1 weight 2 backup
server idxb2 10.100.0.243:8981 check inter 15s fastinter 2s
rise 2 fall 1 weight 1 backup
If you have allowed what you think is plenty of time, then you may need
to investigate Solr's performance or the specific query that you are
using for the ping.
http://wiki.apache.org/solr/SolrPerformanceProblems
Thanks,
Shawn