Re: Cassandra and Pig - how to get column values?

2010-10-16 Thread Eric Lee
Ah nice, even better, thanks! On Sat, Oct 16, 2010 at 2:31 PM, Brandon Williams wrote: > On Sat, Oct 16, 2010 at 3:55 PM, Eric Lee wrote: > >> I have this working now with the following: >> >> rows = LOAD 'cassandra://TwitterExample/User' using CassandraStorage(); >> *cols = FOREACH rows GENERA

Re: Cassandra and Pig - how to get column values?

2010-10-16 Thread Brandon Williams
On Sat, Oct 16, 2010 at 3:55 PM, Eric Lee wrote: > I have this working now with the following: > > rows = LOAD 'cassandra://TwitterExample/User' using CassandraStorage(); > *cols = FOREACH rows GENERATE > FLATTEN((bag{tuple(chararray,chararray)})$1);* > users = FOREACH cols GENERATE $1; > > Not s

Re: Cassandra and Pig - how to get column values?

2010-10-16 Thread Eric Lee
I have this working now with the following: rows = LOAD 'cassandra://TwitterExample/User' using CassandraStorage(); *cols = FOREACH rows GENERATE FLATTEN((bag{tuple(chararray,chararray)})$1);* users = FOREACH cols GENERATE $1; Not sure if that operation with *cols *is correct or not, but it appea

Re: Cassandra and Pig

2010-08-20 Thread Christian Decker
nal Message- > From: "Christian Decker" > Sent: Wednesday, August 18, 2010 7:08am > To: user@cassandra.apache.org > Subject: Re: Cassandra and Pig > > I got one step further by cheating a bit, I just took all the Cassandra > Jars > and dropped them into the Hado

Re: Cassandra and Pig

2010-08-18 Thread Stu Hood
Needing to manually copy the jars to all of the nodes would mean that you aren't applying the Pig 'register ;' command properly. -Original Message- From: "Christian Decker" Sent: Wednesday, August 18, 2010 7:08am To: user@cassandra.apache.org Subject: Re: Cas

Re: Cassandra and Pig

2010-08-18 Thread Christian Decker
I got one step further by cheating a bit, I just took all the Cassandra Jars and dropped them into the Hadoop lib folder, so at least now I can run some pig scripts over the data in Cassandra, but this is far from optimal since it means I'd have to distribute my UDFs also to the Hadoop cluster, or

Re: Cassandra and Pig

2010-08-17 Thread Christian Decker
Ok, by now it's getting very strange. I deleted the entire installation and restarted from scratch and now I'm getting a similar error even though I'm going through the pig_cassandra script. 2010-08-17 15:54:10,049 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduce

Re: Cassandra and Pig

2010-08-15 Thread Christian Decker
pt. > > -Original Message- > From: "Stu Hood" > Sent: Friday, August 13, 2010 2:31pm > To: user@cassandra.apache.org > Subject: Re: Cassandra and Pig > > Hmm, the example code there may not have been run in distributed mode > recently, or perhaps Pig perfo

Re: Cassandra and Pig

2010-08-13 Thread Stu Hood
nk/0.7-beta2 requires properties to be set by your startup script. -Original Message- From: "Stu Hood" Sent: Friday, August 13, 2010 2:31pm To: user@cassandra.apache.org Subject: Re: Cassandra and Pig Hmm, the example code there may not have been run in distributed mode recently,

Re: Cassandra and Pig

2010-08-13 Thread Stu Hood
m To: user@cassandra.apache.org Subject: Re: Cassandra and Pig Wow, that was extremely quick, thanks Stu :-) I'm still a bit unclear on what the pig_cassandra script does. It sets some variables (PIG_CLASSPATH for one) and then starts the original pig binary but injects some libraries in it (li

Re: Cassandra and Pig

2010-08-13 Thread Christian Decker
Wow, that was extremely quick, thanks Stu :-) I'm still a bit unclear on what the pig_cassandra script does. It sets some variables (PIG_CLASSPATH for one) and then starts the original pig binary but injects some libraries in it (libthrift and pig-core) but strangely not the cassandra loadfunc, why

RE: Cassandra and Pig

2010-08-13 Thread Stu Hood
That error is coming from the frontend: the jars must also be on the local classpath. Take a look at how contrib/pig/bin/pig_cassandra sets up $PIG_CLASSPATH. -Original Message- From: "Christian Decker" Sent: Friday, August 13, 2010 11:30am To: user@cassandra.apache.org Subject: Cassand