Re: FileNotFoundException

HI Batranut; In both errors you described above the files seem to be missing while compaction is running. Without knowing what else is going on your system,  I would presume that this error occurs on this single node only and not your entire cluster.  Some guesses:a)  You may have a disk corrupt

Fw: FileNotFoundException

Also I must add that grepping the logs for a particular file I see this:  INFO [CompactionExecutor:19] 2015-02-24 10:44:35,618 CompactionTask.java (line 120) Compacting [SSTableReader(path='/data/ranks/positions/ranks-positions-jb-339-Data.db'), SSTableReader(path='/data/ranks/positions/ranks-po

FileNotFoundException

Hello all, One of my C* throws a big amount of exceptions like this: ERROR [ReadStage:792] 2015-02-24 10:43:54,183 CassandraDaemon.java (line 199) Exception in thread Thread[ReadStage:792,5,main]java.lang.RuntimeException: java.lang.RuntimeException: java.io.FileNotFoundException: /data/ranks/p

Re: FileNotFoundException during reboot (Cassandra-2.1.1)

Maybe you're running out of file descriptors? On 29 September 2014 01:31, Jay Patel wrote: > Hey there, > > We've trying out Cassandra-2.1.1 and facing the below exception > frequently, mainly during the node reboot. File is there with proper > permissions (as below), not sure why C* is not able

FileNotFoundException during reboot (Cassandra-2.1.1)

Hey there, We've trying out Cassandra-2.1.1 and facing the below exception frequently, mainly during the node reboot. File is there with proper permissions (as below), not sure why C* is not able to find it. >>> ERROR [OptionalTasks:1] 2014-09-27 16:00:20,888 CassandraDaemon.java:167 - Exception

How to deal with SSTable FileNotFoundException?

Hi all, I have a Cassandra 2.0.6 cluster with 12 nodes. I find in some nodes' system.log, there are many RuntimeException such like: java.lang.RuntimeException: java.io.FileNotFoundException: /disk4/cassandra/data/{keyspace}/{cfname}/{keyspace}-{cfname}-jb-87-Data.db (No such file or directory) I

Re: FileNotFoundException ...-Data.db

Well grepping the logs for a file resulted in this: During startup that file was opened OK. During runtime the compactionexecutor tried to compact more files that included this one but threw and exception for another one that is first in that list. So I do not have more info. In one particular da

Re: FileNotFoundException ...-Data.db

I thought someone asked "what was your startup/shutdown procedure," and I didn't see how startup could impact it. Maybe I mis-rememberd. On Tue, Mar 25, 2014 at 3:36 PM, Robert Coli wrote: > On Tue, Mar 25, 2014 at 3:24 PM, James Rothering wrote: > >> What message would be on the log, or not o

Re: FileNotFoundException ...-Data.db

On Tue, Mar 25, 2014 at 3:24 PM, James Rothering wrote: > What message would be on the log, or not on the log, what would you be > grep-ing for? > You'd be looking for the broken SSTable to appear in either a MemtableFlusher line or a compaction line. > Also, why were you interested in startup

Re: FileNotFoundException ...-Data.db

What message would be on the log, or not on the log, what would you be grep-ing for? Also, why were you interested in startup procedure? Is there some "best practices: for that which could impact this? On Tue, Mar 25, 2014 at 2:55 PM, Robert Coli wrote: > On Tue, Mar 25, 2014 at 1:55 PM, Batra

Re: FileNotFoundException ...-Data.db

On Tue, Mar 25, 2014 at 1:55 PM, Batranut Bogdan wrote: > I believe that no matter how I stop cassandra, I should not be missing > data. Even if compaction is in progress. > Well, excepting that what you describe is impossible if you "crash" cassandra (kill -9, etc.), I agree. It's possible that

Re: FileNotFoundException ...-Data.db

I believe that no matter how I stop cassandra, I should not be missing data. Even if compaction is in progress. As far as I can tell during compaction cassa reads from some files and creates a new temp file. Here I believe that it stores the info and after the new file is complete it should rena

Re: FileNotFoundException ...-Data.db

Hi, On 25/03/14 19:30, Robert Coli wrote: On Tue, Mar 25, 2014 at 5:36 AM, Batranut Bogdan mailto:batra...@yahoo.com>> wrote: I am running 2.0.6 and I use /etc/init.d/cassandra start / stop . Also before stopping I do : nodetool disablegossip nodetool disablethrift nodetool

Re: FileNotFoundException ...-Data.db

On Tue, Mar 25, 2014 at 11:34 AM, Benedict Elliott Smith < belliottsm...@datastax.com> wrote: > Note that drain stops gossip and thrift anyway, so they are redundant. > While we're noting implementation details... none of these functions necessarily stop writes to your node, which is probably wha

Re: FileNotFoundException ...-Data.db

Note that drain stops gossip and thrift anyway, so they are redundant. On 25 March 2014 18:30, Robert Coli wrote: > On Tue, Mar 25, 2014 at 5:36 AM, Batranut Bogdan wrote: > >> I am running 2.0.6 and I use /etc/init.d/cassandra start / stop . Also >> before stopping I do : >> nodetool disablego

Re: FileNotFoundException ...-Data.db

On Tue, Mar 25, 2014 at 5:36 AM, Batranut Bogdan wrote: > I am running 2.0.6 and I use /etc/init.d/cassandra start / stop . Also > before stopping I do : > nodetool disablegossip > nodetool disablethrift > nodetool drain > after that /etc/init.d/cassandra stop > This seems reasonable/best practi

Re: FileNotFoundException ...-Data.db

I am running 2.0.6 and I use /etc/init.d/cassandra start / stop . Also before stopping I do : nodetool disablegossip nodetool disablethrift nodetool drain after that /etc/init.d/cassandra stop On Monday, March 24, 2014 9:48 PM, Robert Coli wrote: On Mon, Mar 24, 2014 at 9:41 AM, Batranut Bo

Re: FileNotFoundException ...-Data.db

On Mon, Mar 24, 2014 at 9:41 AM, Batranut Bogdan wrote: > I am reposting a question about missing files on one of the nodes of my > cluster. > After I first saw that I was missing a ...-Data.db file, I decomissioned > the node, deleted the data and added it back into the cluster. Now I see > agai

FileNotFoundException ...-Data.db

Hello all, I am reposting a question about missing files on one of the nodes of my cluster. After I first saw that I was missing a ...-Data.db file, I decomissioned the node, deleted the data and added it back into the cluster. Now I see again that I am missing some files. Do you have an ideea

Cassandra FileNotFoundException .db file not found

Hello, A investigation on one of the nodes reveals that I am missing several .db files. I got FileNotFoundException in the logs on one node in the cluster. How can I fix this? nodetool repair doesn't seem to work in this case. Thank you.

Re: cleanup failure; FileNotFoundException deleting (wrong?) db file

On Fri, Nov 8, 2013 at 10:31 AM, Elias Ross wrote: > On Thu, Nov 7, 2013 at 7:01 PM, Krishna Chaitanya > wrote: > >> Check if its an issue with permissions or broken links.. >> >> > I don't think permissions are an issue. You might be on to something > regarding the links. > > As it turns out (

Re: cleanup failure; FileNotFoundException deleting (wrong?) db file

On Thu, Nov 7, 2013 at 7:01 PM, Krishna Chaitanya wrote: > Check if its an issue with permissions or broken links.. > > I don't think permissions are an issue. You might be on to something regarding the links. I've been seeing this on 4 nodes, configured identically. Here's what I think the prob

Re: cleanup failure; FileNotFoundException deleting (wrong?) db file

Check if its an issue with permissions or broken links.. On Nov 6, 2013 11:17 AM, "Elias Ross" wrote: > > I'm seeing the following: > > Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: > /data05/rhq/data/rhq/six_hour_metrics/rhq-six_hour_metrics-ic-1-Data.db (No > such file o

Re: cleanup failure; FileNotFoundException deleting (wrong?) db file

On Wed, Nov 6, 2013 at 9:10 AM, Keith Freeman <8fo...@gmail.com> wrote: > Is it possible that the keyspace was dropped then re-created ( > https://issues.apache.org/jira/browse/CASSANDRA-4857)? I've seen similar > stack traces in that case. > > Thanks for the pointer. There's a program (RHQ) that

Re: cleanup failure; FileNotFoundException deleting (wrong?) db file

Is it possible that the keyspace was dropped then re-created ( https://issues.apache.org/jira/browse/CASSANDRA-4857)? I've seen similar stack traces in that case. On 11/05/2013 10:47 PM, Elias Ross wrote: I'm seeing the following: Caused by: java.lang.RuntimeException: java.io.FileNotFoundEx

cleanup failure; FileNotFoundException deleting (wrong?) db file

I'm seeing the following: Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: /data05/rhq/data/rhq/six_hour_metrics/rhq-six_hour_metrics-ic-1-Data.db (No such file or directory) at org.apache.cassandra.io.util.ThrottledReader.open(ThrottledReader.java:53) at org.a

Re: FileNotFoundException while inserting (1.2.8)

The reason this is happening is that there are two instances of SStablereader object. A restart of Cassandra will fix the issue. On Sep 11, 2013, at 10:23, Robert Coli wrote: > On Wed, Sep 11, 2013 at 10:12 AM, Keith Freeman <8fo...@gmail.com> wrote: >> I had seen that issue before, but it'

Re: FileNotFoundException while inserting (1.2.8)

I had seen that issue before, but it's marked Resolved/Fixed in v1.1.1, and I'm on v1.2.8. Also it talks about not being able to re-create the keyspace, while my problem is that after re-creating, I eventually get FileNotFound exceptions. This has happened to me several times in testing, this

Re: FileNotFoundException while inserting (1.2.8)

On Wed, Sep 11, 2013 at 10:12 AM, Keith Freeman <8fo...@gmail.com> wrote: > I had seen that issue before, but it's marked Resolved/Fixed in v1.1.1, > and I'm on v1.2.8. Also it talks about not being able to re-create the > keyspace, while my problem is that after re-creating, I eventually get >

Re: FileNotFoundException while inserting (1.2.8)

On Wed, Sep 11, 2013 at 6:49 AM, Keith Freeman <8fo...@gmail.com> wrote: > Yes, I started with a fresh keyspace (dropped and re-created) to run this > test. > https://issues.apache.org/jira/browse/CASSANDRA-4219 =Rob

Re: FileNotFoundException while inserting (1.2.8)

Yes, I started with a fresh keyspace (dropped and re-created) to run this test. On 09/10/2013 02:01 PM, sankalp kohli wrote: Have you dropped and recreated a keyspace with the same name recently? On Tue, Sep 10, 2013 at 8:40 AM, Keith Freeman <8fo...@gmail.com > wrot

Re: FileNotFoundException while inserting (1.2.8)

Have you dropped and recreated a keyspace with the same name recently? On Tue, Sep 10, 2013 at 8:40 AM, Keith Freeman <8fo...@gmail.com> wrote: > While running a heavy insert load, one of my nodes started throwing this > exception when trying a compaction: > > INFO [CompactionExecutor:23] 2013-

FileNotFoundException while inserting (1.2.8)

While running a heavy insert load, one of my nodes started throwing this exception when trying a compaction: INFO [CompactionExecutor:23] 2013-09-09 16:08:07,528 CompactionTask.java (line 105) Compacting [SSTableReader(p ath='/var/lib/cassandra/data/smdb/tracedata/smdb-tracedata-ic-6-Data.db')

Re: mutation stalls and FileNotFoundException

writing at low volume. I have > doubled the volume and suddenly 3 of my 6 nodes are showing much higher load > than the others (30 vs 3) and tpstats show the mutation stage as completely > full (see below). I did find a FileNotFoundException that I pasted below > which appears to b

mutation stalls and FileNotFoundException

I am running 1.2.4 with Vnodes and have been writing at low volume. I have doubled the volume and suddenly 3 of my 6 nodes are showing much higher load than the others (30 vs 3) and tpstats show the mutation stage as completely full (see below). I did find a FileNotFoundException that I

Re: FileNotFoundException in ROW-READ-STAGE

we really need to know what the file history is. if it's a freshly flushed file, that's Bad. if it's a file that was a compaction victim, that's annoying but not something we need to worry about. both flush and compaction are logged at INFO. On Sun, May 16, 2010 at 11:13 AM, Mason Hale wrote:

Re: FileNotFoundException in ROW-READ-STAGE

Grepping through the logs, I haven't been able to deduce what was going on at the same time, but I have found many instances of these errors for multiple files going back for weeks nows. (Found 848 of these errors since 4-23-2010). The files not found include Index and Data files spanning multiple

Re: FileNotFoundException in ROW-READ-STAGE

grep for Entry-28-Index.db in the logs, see what was going on before the exceptions. (was it compacted?) On Sat, May 15, 2010 at 12:43 AM, Mason Hale wrote: > One of our Cassandra nodes is throwing multiple of these errors: > ERROR [ROW-READ-STAGE:185] 2010-04-27 14:56:59,543 CassandraDaemon.jav

FileNotFoundException in ROW-READ-STAGE

One of our Cassandra nodes is throwing multiple of these errors: ERROR [ROW-READ-STAGE:185] 2010-04-27 14:56:59,543 CassandraDaemon.java (line 78) Fatal exception in thread Thread[ROW-READ-STAGE:185,5,main] java.lang.RuntimeException: java.io.FileNotFoundException: /data/cassandra/data/Onespot/Ent