Mass update of a table column

2018-11-10 Thread Peter Zende
Hi all, We feed a Cassandra v3.7 DB from a streaming application. From time to time we need to update a boolean column for an entire table based on some logic . For this we wrote a Spark job but this always crashed after a while with tombstone threshold error ("Scanned over 11 tombstones duri

Datastax BulkTableWriter vs Apache Cassandra version

2018-01-25 Thread Peter Zende
Hello, I'm trying to bulk insert data with a Spark job into our Apache Cassandra 3.7. For this I'm trying to use com.datastax.bdp.spark.writer.BulkTableWriter from Datastax. I managed to set a up a job which creates the sstables using dse-spark 5.1.5 . However, when they are being loaded on the C