SSTableWriter to hdfs

2012-05-10 Thread Shawna Qian
Hi Can I use sstableunsortedwriter to write the data directly to hdfs or I have to use hdfs copyfromlocal to copy the sstable file from local dist to hdfs after they get generated? Thx Shawna Sent from my iPhone On May 7, 2012, at 3:48 AM, "aaron morton" mailto:aa...@thelastpickle.com>> wrot

using the proxy on the cli or configHelper to connect to cassandra server

2012-05-07 Thread Shawna Qian
Hello: In our cassandra settings, we need to specify the proxy to access the cassandra: if using the java code, it will be like this: Proxy proxy = new Proxy(Proxy.Type.SOCKS, new InetSocketAddress("socks.corp.yahoo.com", 1080)); Socket socket = new Socket (proxy); socket.connect(new InetSocketAd

stream data using bulkoutputformat

2012-05-04 Thread Shawna Qian
Hi Group: I am following this great example to use bulkouputformat to streaming the data from hadoop to cassandra. http://shareitexploreit.blogspot.com/2012/03/bulkloadto-cassandra-with-hado op.html. It works perfectly when my keyspace has one cf. But in my case, I have 2 coulumn families defined

stream data using bulkoutputformat on hdfs?

2012-05-02 Thread Shawna Qian
Hello: I am trying to use bulkoutputformat and seeing some nice docs on how to use it to stream the data to an existing cassandra cluster using configHelper class. I am wondering if it is possible to use it just to stream the data (sstable etc) into the hdfs? Thx Shawna