Re: ZookeeperServer not running/Client Session timed out

2018-10-23 Thread Susheel Kumar
Hi Shawn, Thanks for pointing out that it may be due to network/VM issue. I looked the ZK logs in detail and i see below Socket timeout issue after which ZK shutdown is called. Is that good enough to confirm some VM/network issue not any ZK/Solr issue. I am also including dmesg output during the

Re: ZookeeperServer not running/Client Session timed out

2018-10-22 Thread Susheel Kumar
Hi Shawn, Here is the link for Solr GC log and it doesn't look Solr GC problem. The total GC is 12 GB. The GC log is from yesterday and the issue happened this morning i.e. 10/22. https://www.dropbox.com/s/zdlu9sk8kc469ls/Screen%20Shot%202018-10-22%20at%2010.08.37%20PM.png?dl=0 It may be netwo

Re: ZookeeperServer not running/Client Session timed out

2018-10-22 Thread Shawn Heisey
On 10/22/2018 7:32 PM, Susheel Kumar wrote: Hi Shawn, you meant ZK GC log correct? There was another potential cause I was thinking of, but when I got to where I was going to list them in the previous message, I could not for the life of me remember what the other one was. I just remembered

Re: ZookeeperServer not running/Client Session timed out

2018-10-22 Thread Shawn Heisey
On 10/22/2018 7:32 PM, Susheel Kumar wrote: Hi Shawn, you meant ZK GC log correct? No, the GC log from Solr.  A heap that's too small could happen to ZK as well, but I would expect that problem more on the Solr side. You could try increasing the heap size to see if that makes any difference

Re: ZookeeperServer not running/Client Session timed out

2018-10-22 Thread Susheel Kumar
Hi Shawn, you meant ZK GC log correct? Thnx On Mon, Oct 22, 2018 at 7:03 PM Shawn Heisey wrote: > On 10/22/2018 3:31 PM, Susheel Kumar wrote: > > Hello, > > > > I am seeing "ZookeeperServer not running" WARM messages in zookeeper logs > > which is causing the Solr client connections to timeout.

Re: ZookeeperServer not running/Client Session timed out

2018-10-22 Thread Shawn Heisey
On 10/22/2018 3:31 PM, Susheel Kumar wrote: Hello, I am seeing "ZookeeperServer not running" WARM messages in zookeeper logs which is causing the Solr client connections to timeout... What could be the problem? ZK: 3.4.10 Zookeeper.out == For help with the ZK server log, you'll need to cons

ZookeeperServer not running/Client Session timed out

2018-10-22 Thread Susheel Kumar
Hello, I am seeing "ZookeeperServer not running" WARM messages in zookeeper logs which is causing the Solr client connections to timeout... What could be the problem? ZK: 3.4.10 Zookeeper.out == 2018-10-22 06:04:51,071 [myid:2] - INFO [WorkerReceiver[myid=2]:FastLeaderElection@600] - Notificati