I need to understand how compaction Algorithm works at high level. 1. What is the significance of systems.compactions_in_progress table and files in compactions_in_progress directory. 2. We are on 2.0.3. We frequently face scenarios where Cassandra fails to restart with Exception regarding unfinished compactions. The problem is how to deal with such scenario "Till we upgrade".
When we delete files in compactions_in_progress folder, we are able to start Cassandra. Is that a SAFE thing to do in PRODUCTION? Are there any better alternatives? We are concerned about data integrity. Thanks Anuj