: No, I wasn't aware of these. I will give that a try. If I stop the Solr
: jetty service manually, things recover fine, but the hang occurs when I
: 'stop' or 'terminate' the EC2 instance. The Zookeeper leader reports a

I don't know squat about AWS Auto-Scaling, (and barely anything about AWS) 
but what you describe makes it sound like maybe your "machine" (ie AMI?) 
isn't really configured very well?

Do you have some init.d/systemd type scripts to ensure a clean shutdown of 
Solr when the machine is shutdown/rebooted?  That seems like a pretty good 
idea in general (in dependent of wether you are using Auto-Scaling) and -- 
assuming AWS auto-scaling does clean OS shutdowns when terminating 
instances -- would probably solve your problem.  It would help ensure you 
would never have to wait on the timeouts -- the nodes will each explicitly 
tell ZK they are going bye-bye.

if you do have things setup so that *manually* shutting down your 
instances executes a clean shutdown of solr, but AWS Auto-Scaling is 
actaully totally brutal and doesn't even do a clean shutdown of your 
virtual machines -- just yanks the virtual power cord -- perhaps you could 
implement one of these "LifecycleHook" options that poped up when i did 
some googling for "AWS Auto-Scale termination" to explicitly do a clean 
shutdown of the Solr process" before the machine vanishes into thin air?



-Hoss
http://www.lucidworks.com/

Reply via email to