Re: Cassandra read optimization

2012-04-19 Thread Dan Feldman
. If possible break the task up for multiple > threads / processes. > > Is that a task you need to repeat ? Can you use Hadoop to export ? > > Cheers > > > - > Aaron Morton > Freelance Developer > @aaronmorton > http://www.thelastpickle.com > >

Re: Cassandra read optimization

2012-04-19 Thread Dan Feldman
doesn't work, copy the JNA jar into Cassandra's lib directory > (been there, done that). > > Paolo > > On Thu, Apr 19, 2012 at 8:26 AM, Dan Feldman wrote: > > Hi Tyler and Aaron, > > > > Thanks for your replies. > > > > Tyler, > > fetching scs

Re: Cassandra read optimization

2012-04-18 Thread Dan Feldman
able to see if the request is timing out a couple of > times before it succeeds. > > It might also be good to make sure that you've got JNA in place and your > heap size is sufficient. > > > On Wed, Apr 18, 2012 at 8:59 PM, Aaron Turner wrote: > >> On Wed, Apr 18,

Cassandra read optimization

2012-04-18 Thread Dan Feldman
Hi all, I'm trying to optimize moving data from Cassandra to HDFS using either Ruby or Python client. Right now, I'm playing around on my staging server, an 8 GB single node machine. My data in Cassandra (1.0.8) consist of 2 rows (for now) with ~150k super columns each (I know, I know - super colu