Re: error deleting messages

2015-03-24 Thread James Schappet
This talk from DataStax was talking about deletes as an Anti-pattern. It may be worth watching. > Thanks for your interest in the following webinar: > > Avoiding anti-patterns: How to stay in love with Cassandra > > Here are the links to the video recording and presentation slides. > > Than

Re: Reading Cassandra Data From Pig/Hadoop

2014-05-30 Thread James Schappet
To specify your cassandra cluster, you only need to define one node: In you profile or batch command set and export these variables: export PIG_HOME= export PIG_INITIAL_ADDRESS=localhost export PIG_RPC_PORT=9160 # the partitioner must match your cassandra partitioner export PIG_PARTITIONER=or

Re: CqlStorage can't perform INSERTs with Pig?

2014-05-21 Thread James Schappet
In CQL Updates and Inserts are the same thing. You need to convert your insert statements to UPDATE Here is a quick example loading from a JSON file, into two cassandra tables Notice the the output query is URL Encoded. a = load 'barcode_uuid_mapping_current.json' using JsonLoader('u

Re: Pig / Map Reduce on Cassandra

2013-01-17 Thread James Schappet
-- Cyril Scetbon On Jan 17, 2013, at 2:42 PM, James Schappet wrote: > CFS is Cassandra File System: > http://www.datastax.com/dev/blog/cassandra-file-system-design > > > But you don't need CFS to connect from PIG to Cassandra. The latest versions > of Cassandra Source

Re: Pig / Map Reduce on Cassandra

2013-01-17 Thread James Schappet
CFS is Cassandra File System: http://www.datastax.com/dev/blog/cassandra-file-system-design But you don't need CFS to connect from PIG to Cassandra. The latest versions of Cassandra Source ship with examples of connecting from pig to cassandra. apache-cassandra-1.2.0-src/examples/pig -- http

Re: Pig / Map Reduce on Cassandra

2013-01-16 Thread James Schappet
er, but I just want to use Hadoop Jobs (Pig and Hive) to read >data from it. I would like to use the same configuration as >http://www.datastax.com/dev/blog/hadoop-mapreduce-in-the-cassandra-cluster > but I want to know if there are alternatives to DataStax Enterprise >package. > >

Re: Pig / Map Reduce on Cassandra

2013-01-16 Thread James Schappet
Here are a few examples I have worked on, reading from xml.gz files then writing to cassandara. https://github.com/jschappet/medline You will also need: https://github.com/jschappet/medline-base These examples are Hadoop Jobs using Cassandra as the Data Store. This one is a good place to st

Re: error when creating column family using cql3 and persisting data using thrift

2013-01-15 Thread James Schappet
I also saw this while testing the https://github.com/boneill42/naughty-or-nice example project. --Jimmy From: Kuldeep Mishra Reply-To: Date: Tuesday, January 15, 2013 10:29 AM To: Subject: error when creating column family using cql3 and persisting data using thrift Hi, I am facing f

Re: Null Error Running pig_cassandra

2012-12-14 Thread James Schappet
per.java:176) > > This line does not match the source code for the 1.2.0-beta3 tag. > > Can you try it with the 1.1.7 bin distro ? > > Cheers > > - > Aaron Morton > Freelance Cassandra Developer > New Zealand > > @aaronmorton > http://www.thelastpi

Null Error Running pig_cassandra

2012-12-12 Thread James Schappet
When trying to run the example-script.pig, I get the following error, null error. tsunami:pig schappetj$ bin/pig_cassandra -x local example-script.pig Using /Library/pig-0.10.0/pig-0.10.0.jar. 2012-12-12 11:02:54,079 [main] INFO org.apache.pig.Main - Apache Pig version 0.10.0 (r1328203) compil