reading sstables stored in hdfs

2013-03-23 Thread Amit Kumar
I am starting some work on an input-format that would let us read sstables stored in HDFS, I wonder if anyone has worked on something similar before. I did come across http://techblog.netflix.com/2012/02/aegisthus-bulk-data-pipeline-out-of.html However it's not open sourced/available yet. I am w

Re: reading sstables stored in hdfs

2013-03-23 Thread Amit Kumar
that impacts production Cassandra. Amit On Sat, Mar 23, 2013 at 2:40 PM, Michael Kjellman wrote: > Just curious, why would you want to store sstables in HDFS? > > On 3/23/13 12:43 PM, "Amit Kumar" wrote: > >>I am starting some work on an input-format that would let

Re: reading sstables stored in hdfs

2013-03-23 Thread Amit Kumar
leReader > and/or SSTableWriter. > > On Sat, Mar 23, 2013 at 7:01 PM, Amit Kumar wrote: >> We don't want to setup a parallel workflow for analytics, for which >> we use hadoop and it will be trivial to copy the new sstables that get >> created to the hdfs per