Re: Too many open files [was Re: Minimizing the impact of compaction on latency and throughput]

2010-07-14 Thread Thomas Downing
On 7/14/2010 11:07 AM, Jonathan Ellis wrote: socketexception means this is coming from the network, not the sstables knowing the full error message would be nice, but just about any problem on that end should be fixed by adding connection pooling to your client. (moving to user@) On Wed, Jul 1

Re: Too many open files [was Re: Minimizing the impact of compaction on latency and throughput]

2010-07-14 Thread Jonathan Ellis
socketexception means this is coming from the network, not the sstables knowing the full error message would be nice, but just about any problem on that end should be fixed by adding connection pooling to your client. (moving to user@) On Wed, Jul 14, 2010 at 5:09 AM, Thomas Downing wrote: > On

Re: Too many open files [was Re: Minimizing the impact of compaction on latency and throughput]

2010-07-14 Thread Peter Schuller
> As a Cassandra newbie, I'm not sure how to tell, but they are all > to *.Data.db files, and all under the DataFileDirectory (as spec'ed > in storage-conf.xml), which is a separate directory than the > CommitLogDirectory.  I did not see any *Index.db or *Filter.db > files, but I may have missed th

Hudson build is back to normal : Cassandra #491

2010-07-14 Thread Apache Hudson Server
See

Re: Too many open files [was Re: Minimizing the impact of compaction on latency and throughput]

2010-07-14 Thread Thomas Downing
On 7/14/2010 7:16 AM, Peter Schuller wrote: More than one fd can be open on a given file, and many of open fd's are on files that have been deleted. The stale fd's are all on Data.db files in the data directory, which I have separate from the commit log directory. I haven't had a chance to look

Re: Too many open files [was Re: Minimizing the impact of compaction on latency and throughput]

2010-07-14 Thread Peter Schuller
> More than one fd can be open on a given file, and many of open fd's are > on files that have been deleted.  The stale fd's are all on Data.db files in > the > data directory, which I have separate from the commit log directory. > > I haven't had a chance to look at the code handling files, and I

Too many open files [was Re: Minimizing the impact of compaction on latency and throughput]

2010-07-14 Thread Thomas Downing
On 7/13/2010 9:20 AM, Jonathan Ellis wrote: On Tue, Jul 13, 2010 at 4:19 AM, Thomas Downing wrote: On a related note: I am running some feasibility tests looking for high ingest rate capabilities. While testing Cassandra the problem I've encountered is that it runs out of file handles du