Re: Too many open files [was Re: Minimizing the impact of compaction on latency and throughput]

2010-07-14 Thread Thomas Downing
14, 2010 at 5:09 AM, Thomas Downing wrote: On 7/13/2010 9:20 AM, Jonathan Ellis wrote: On Tue, Jul 13, 2010 at 4:19 AM, Thomas Downing wrote: On a related note: I am running some feasibility tests looking for high ingest rate capabilities. While testing Cassandra the

Re: Too many open files [was Re: Minimizing the impact of compaction on latency and throughput]

2010-07-14 Thread Thomas Downing
On 7/14/2010 7:16 AM, Peter Schuller wrote: More than one fd can be open on a given file, and many of open fd's are on files that have been deleted. The stale fd's are all on Data.db files in the data directory, which I have separate from the commit log directory. I haven't had a chance to look

Too many open files [was Re: Minimizing the impact of compaction on latency and throughput]

2010-07-14 Thread Thomas Downing
On 7/13/2010 9:20 AM, Jonathan Ellis wrote: On Tue, Jul 13, 2010 at 4:19 AM, Thomas Downing wrote: On a related note: I am running some feasibility tests looking for high ingest rate capabilities. While testing Cassandra the problem I've encountered is that it runs out of file ha

Re: Minimizing the impact of compaction on latency and throughput

2010-07-13 Thread Thomas Downing
them along. Thanks much for all your work Thomas Downing On 7/12/2010 10:52 PM, Jonathan Ellis wrote: This looks relevant: http://chbits.blogspot.com/2010/06/lucene-and-fadvisemadvise.html (see comments for directions to code sample) On Fri, Jul 9, 2010 at 1:52 AM, Peter Schuller wrote: I