Re: Skipping corrupted rows when doing compaction

2010-06-01 Thread hive13 Wong
Thanks, Jonathan I'm using 0.6.1 And another thing is that I get lots of zero-sized tmp files in the data directory. When I restarted cassandra those tmp files will be deleted then new empty tmp files will be generated gradually, while still lots of UTFDataFormatException in the system.log Using

Re: Skipping corrupted rows when doing compaction

2010-06-01 Thread Jonathan Ellis
If you're on a version earlier than 0.6.1, you might be running into https://issues.apache.org/jira/browse/CASSANDRA-866. Upgrading will fix it, you don't need to reload data. It's also worth trying 0.6.2 and DiskAccessMode=standard, in case you've found another similar bug. On Tue, Jun 1, 2010

Skipping corrupted rows when doing compaction

2010-06-01 Thread hive13 Wong
Hi, Is there a way to skip corrupted rows when doing compaction? We are currently deploying 2 nodes with replicationfactor=2 but one node reports lots of exceptions like java.io.UTFDataFormatException: malformed input around byte 72. My guess is that some of the data in the SSTable is corrupted b