I guess errors like "fsync-ing the write ahead log in SyncThread:5 took 7268ms which will adversely effect operation latency."
and: "likely client has closed socket" make me wonder if something went wrong in terms of running out of disk space for logs (thus giving your OS no space for necessary functions) or if you ran into memory issues, or if something changed your network / firewall settings to prevent communication on ports that used to work...? I'm not an expert on the code, but those kind of external problems is where I'd start looking if I saw errors like this. Were all the VM's up and running or were they down too? On Wed, Apr 20, 2016 at 10:06 PM, Zap Org <zapor...@gmail.com> wrote: > I have 5 zookeeper and 2 solr machines and after a month or two whole > clustre shutdown i dont know why. The logs i get in zookeeper are attached > below. otherwise i dont get any error. All this is based on linux VM. > > 2016-03-11 16:50:18,159 [myid:5] - WARN [SyncThread:5:FileTxnLog@334] - > fsync-ing the write ahead log in SyncThread:5 took 7268ms which will > adversely effect operation latency. See the ZooKeeper troubleshooting guide > 2016-03-11 16:50:18,161 [myid:5] - WARN [NIOServerCxn.Factory: > 0.0.0.0/0.0.0.0:2185:NIOServerCnxn@357] - caught end of stream exception > EndOfStreamException: Unable to read additional data from client sessionid > 0x4535f00ee370001, likely client has closed socket > at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) > at > > org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) > at java.lang.Thread.run(Thread.java:745) > 2016-03-11 16:50:18,163 [myid:5] - INFO [NIOServerCxn.Factory: > 0.0.0.0/0.0.0.0:2185:NIOServerCnxn@1007] - Closed socket connection for > client /localhost which had sessionid 0x4535f00ee370001 > 2016-03-11 16:50:18,166 [myid:5] - WARN [NIOServerCxn.Factory: > 0.0.0.0/0.0.0.0:2185:NIOServerCnxn@357] - caught end of stream exception > EndOfStreamException: Unable to read additional data from client sessionid > 0x2535ef744dd0005, likely client has closed socket > at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) > at > > org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) > at java.lang.Thread.run(Thread.java:745) >
