Re: OperationTimedOutException (NoHostAvailableException)

2016-11-24 Thread Shalom Sagges
69, 192.168.198.75) that indicates they had >> problems at that time, perhaps GCInspector or StatusLogger messages about >> pauses, or any drops in network utilization to indicate a networking >> problem? >> >> >> >> >> >> >> *From:

Re: OperationTimedOutException (NoHostAvailableException)

2016-11-24 Thread techpyaasa .
techpyaasa ." > *Reply-To: *"user@cassandra.apache.org" > *Date: *Thursday, November 24, 2016 at 1:43 AM > *To: *"user@cassandra.apache.org" > *Subject: *OperationTimedOutException (NoHostAvailableException) > > > > Hi all, > > Following excep

Re: OperationTimedOutException (NoHostAvailableException)

2016-11-24 Thread Vladimir Yudovin
pache.org" <user@cassandra.apache.org> Subject: OperationTimedOutException (NoHostAvailableException) Hi all, Following exception thrown sometimes though all nodes are up. SEVERE : This error occurs if there are not enough Cassandra nodes for the required QUORUM to persist data. Please ma

Re: OperationTimedOutException (NoHostAvailableException)

2016-11-24 Thread Jeff Jirsa
pauses, or any drops in network utilization to indicate a networking problem? From: "techpyaasa ." Reply-To: "user@cassandra.apache.org" Date: Thursday, November 24, 2016 at 1:43 AM To: "user@cassandra.apache.org" Subject: OperationTimedOutException (NoHost

OperationTimedOutException (NoHostAvailableException)

2016-11-24 Thread techpyaasa .
Hi all, Following exception thrown sometimes though all nodes are up. * SEVERE : This error occurs if there are not enough Cassandra nodes for the required QUORUM to persist data. Please make sure enough nodes are up at this point of time. Error Count is at 150 Exception com.datastax.driver.core

Re: NoHostAvailableException

2016-11-21 Thread Vladimir Yudovin
Hi, as I mentioned about rpc_address: 0.0.0.0 YAML says it is allowed to specify 0.0.0.0 ... but that will break clients that rely on node auto-discovery. Try set rpc_address: external_ip Best regards, Vladimir Yudovin, Winguzone - Hosted Cloud Cassandra Launch your cluster in minutes.

Re: NoHostAvailableException

2016-11-21 Thread techpyaasa .
Hi Vladimir, I have attached cassandra.yaml we have in our setup, please check once. - do you have native port 9042 open in firewall ? Yes, 9042 is opened on our firewall, checked with our team - Can you connect to cluster with cqlsh? Yes, Im able to connect cluster using cqlsh. What else could

Re: NoHostAvailableException

2016-11-21 Thread Vladimir Yudovin
Yaml in 2.0.17 says # The address to bind the Thrift RPC service and native transport # server -- clients connect here. # # Leaving this blank has the same effect it does for ListenAddress, # (i.e. it will be based on the configured hostname of the node). # # Note that unlike ListenAddress a

Re: NoHostAvailableException

2016-11-21 Thread techpyaasa .
Sorry it was typo.. It is *broadcast_address and not **broadcast_*rpc*_address.* And also there is no such configuration in cass.yaml with *broadcast_rpc_address *in c*-2.0.17. Very sorry once again. This is configrn I have in cass.yaml *listen_address: [external IP]* *# Address to broadcast to

Re: NoHostAvailableException

2016-11-21 Thread Vladimir Yudovin
Not broadcast_address, but broadcast_rpc_address (you gave this example:rpc_address: 0.0.0.0 , broadcast_rpc_address: 1.2.3.4) Best regards, Vladimir Yudovin, Winguzone - Hosted Cloud Cassandra Launch your cluster in minutes. On Mon, 21 Nov 2016 08:14:38 -0500techpyaasa .

Re: NoHostAvailableException

2016-11-21 Thread techpyaasa .
Hi Vladimir, I have not modified anything for broadcasr_address, I left as it was.. *# Leaving this blank will set it to the same value as listen_address* *# broadcast_address: 1.2.3.4* So the comment above says "*Leaving this blank will set it to the same value as listen_address" *, so it shud

Re: NoHostAvailableException

2016-11-21 Thread Vladimir Yudovin
Try to set broadcast_rpc_address on each node to its real external IP address. Best regards, Vladimir Yudovin, Winguzone - Hosted Cloud Cassandra Launch your cluster in minutes. On Mon, 21 Nov 2016 05:47:00 -0500techpyaasa . wrote Following exception

NoHostAvailableException

2016-11-21 Thread techpyaasa .
Following exception intermittently thrown by datastax java driver though all nodes are up.(Happening for both read & write queries) *"Exception com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.exception

Re: NoHostAvailableException coming up on our server

2016-07-13 Thread Abhinav Solan
Thanks a lot for suggestion Romain, I have done the setup to see the driver logs, but haven't seen that error again. Also thanks for the MaxRequestPerConnection tip, I will change it to 32K. Regards, Abhinav On Wed, Jul 13, 2016 at 1:02 PM Romain Hardouin wrote: > Put the driver logs in debug m

Re: NoHostAvailableException coming up on our server

2016-07-13 Thread Romain Hardouin
Put the driver logs in debug mode to see what's happen.Btw I am surprised by the few requests by connections in your setup: .setConnectionsPerHost(HostDistance.LOCAL, 20, 20) .setMaxRequestsPerConnection(HostDistance.LOCAL, 128) It looks like a protocol v2 settings (Cassandra 2.0

Re: NoHostAvailableException coming up on our server

2016-07-12 Thread Abhinav Solan
I am using 3.0.0 version over apache-cassandra-3.3 On Tue, Jul 12, 2016 at 2:37 PM Riccardo Ferrari wrote: > What driver version are you using? > > You can look at the LoggingRetryPolicy to have more meaningful messages in > your logs. > > best, > > On Tue, Jul 12, 2016 at 9:02 PM, Abhinav Solan

Re: NoHostAvailableException coming up on our server

2016-07-12 Thread Riccardo Ferrari
What driver version are you using? You can look at the LoggingRetryPolicy to have more meaningful messages in your logs. best, On Tue, Jul 12, 2016 at 9:02 PM, Abhinav Solan wrote: > Thanks, Johnny > Actually, they were running .. it went through a series of read and writes > .. and recovered

Re: NoHostAvailableException coming up on our server

2016-07-12 Thread Abhinav Solan
Thanks, Johnny Actually, they were running .. it went through a series of read and writes .. and recovered after the error. Is there any settings I can specify in preparing the Session at java client driver level, here are my current settings - PoolingOptions poolingOptions = new PoolingOptions()

Re: NoHostAvailableException coming up on our server

2016-07-12 Thread Johnny Miller
Abhinav - your getting that as the driver isn’t finding any hosts up for your query. You probably need to check if all the nodes in your cluster are running. See: http://docs.datastax.com/en/drivers/java/3.0/com/datastax/driver/core/exceptions/NoHostAvailableException.html Johnny > On 12 Jul 2

NoHostAvailableException coming up on our server

2016-07-12 Thread Abhinav Solan
Hi Everyone, I am getting this error on our server, it comes and goes seems the connection drops a comes back after a while - Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: :9042 (com.datastax.driver.core.excepti

NoHostAvailableException happens when a lot of concurrent Spark threads reading one table in cassandra

2015-03-23 Thread 苏放
Hello, I am using Spark1.2 and Cassandra 2.0.12. And the table I am about to read is with 20 million rows When I use 10 threads of spark to read from cassandra, then it works fine. val sc = new SparkContext("local[10]", "tungsten", conf) When I use 40 threads of spark to read from cassandra, then

Re: What causes NoHostAvailableException, WriteTimeoutException, and UnavailableException?

2014-11-24 Thread Robert Coli
On Mon, Nov 24, 2014 at 3:01 PM, Parag Shah wrote: > In our case, the timeouts were happening because internode > authentication was turned on and by default the user column family in the > system_auth keyspace is replicated only on 1 node. We also had to tune the > permissions_validity_in_ms fr

Re: What causes NoHostAvailableException, WriteTimeoutException, and UnavailableException?

2014-11-24 Thread Parag Shah
lt;mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Date: Monday, November 24, 2014 at 2:52 PM To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: Re: What causes NoHostAvailableException

Re: What causes NoHostAvailableException, WriteTimeoutException, and UnavailableException?

2014-11-24 Thread Robert Coli
On Mon, Nov 24, 2014 at 12:57 PM, Kevin Burton wrote: > I’m trying to track down some exceptions in our production cluster. I > bumped up our write load and now I’m getting a non-trivial number of these > exceptions. Somewhere on the order of 100 per hour. > > All machines have a somewhat high

Re: What causes NoHostAvailableException, WriteTimeoutException, and UnavailableException?

2014-11-24 Thread Shane Hansen
Not sure if this is what you're looking for, but api docs can be useful (I won't copy/paste the docs themselves) http://www.datastax.com/drivers/java/2.0/com/datastax/driver/core/exceptions/NoHostAvailableException.html http://www.datastax.com/drivers/java/2.0/com/datastax/driver/core/exceptions/

Re: What causes NoHostAvailableException, WriteTimeoutException, and UnavailableException?

2014-11-24 Thread Bulat Shakirzyanov
Check out Ruby Driver documentation on these topics: Error Handling Retry Policies While the documentation is for the Ruby Driver, the concepts were borrowed from and

What causes NoHostAvailableException, WriteTimeoutException, and UnavailableException?

2014-11-24 Thread Kevin Burton
I’m trying to track down some exceptions in our production cluster. I bumped up our write load and now I’m getting a non-trivial number of these exceptions. Somewhere on the order of 100 per hour. All machines have a somewhat high CPU load because they’re doing other tasks. I’m worried that per

Re: Random NoHostAvailableException using DataStax Java driver

2014-11-04 Thread Olivier Michallat
Hi, Let's move the discussion to the Java driver mailing list: https://groups.google.com/a/lists.datastax.com/forum/#!forum/java-driver-user I'm posting a reply to this message there. -- Olivier Michallat Driver & tools engineer, DataStax On Tue, Nov 4, 2014 at 12:45 PM, Ola Nowak wrote: >

Random NoHostAvailableException using DataStax Java driver

2014-11-04 Thread Ola Nowak
Hi All :) I have an application which use DataStax Java driver v2.0.2 to connect to Cassandra Cluster (6 nodes, v 2.0.11). Application is deployed in three copies on 3 different servers. From time to time on random application server I get this exception: 2014-11-04 10:37:15,301 - ERROR: Servlet.s

nondeterministic NoHostAvailableException occurs while dropping a table

2014-09-05 Thread Clint Kelly
Hi all, TL;DR - I think my unit tests are sometimes failing because of read timeouts to an EmbeddedCassandraService when dropping a table triggers a compaction on a highly-loaded build slave. Does this sound reasonable? What options should I change in my Cluster.Builder (or elsewhere) to prevent

Re: NoHostAvailableException/TransportException

2013-10-31 Thread Robert Coli
On Thu, Oct 31, 2013 at 10:01 AM, Les Hartzman wrote: > I did notice on startup the message "JNA not found. Native methods will > be disabled". Not sure if this means anything or not. > While not relevant to the problem you were having, in general one really does want to have JNA available when

Re: NoHostAvailableException/TransportException

2013-10-31 Thread Les Hartzman
Thank you! That was it. Les On Thu, Oct 31, 2013 at 10:06 AM, Sylvain Lebresne wrote: > cqlsh uses thrift, the java driver uses the native protocol. Thirft is on > port 9160 by default, the native protocol is on port 9042 by default. Try > connecting on port 9042 with the driver instead (which

Re: NoHostAvailableException/TransportException

2013-10-31 Thread Sylvain Lebresne
cqlsh uses thrift, the java driver uses the native protocol. Thirft is on port 9160 by default, the native protocol is on port 9042 by default. Try connecting on port 9042 with the driver instead (which is the driver default really). -- Sylvain On Thu, Oct 31, 2013 at 6:01 PM, Les Hartzman wrot

NoHostAvailableException/TransportException

2013-10-31 Thread Les Hartzman
I'm running Cassandra 2.0.1 on Ubuntu in a VirtualBox VM. I'm using the Datastax Java driver, 1.0.4, and am trying to connect to 127.0.0.1, port 9160. I'm getting the NoHostAvailable exception and on the TransportException it states [127.0.0.1] Channel has been closed. The server is running. I ca