Re: Large temporary files generated during cleaning up

2017-06-25 Thread wxn...@zjqunshuo.com
Thanks for the reply. I tried with "./nodetool cleanup -j 1". It's very useful because the command reduces the amount of free space needed while only one sstable is being processed at a time. From: Alain RODRIGUEZ Date: 2017-06-20 17:03 To: user Subject: Re: Large temporary

Re: Large temporary files generated during cleaning up

2017-06-20 Thread Alain RODRIGUEZ
Hi Simon, I know for sure that clean up (like compaction) need to copy the entire SSTable (Data + index) excepted from the part being evicted by the cleanup. As SSTables are immutable, to manipulate (remove) data, cleanup like compaction need to copy the data we want to keep before removing the o

Large temporary files generated during cleaning up

2017-06-19 Thread wxn...@zjqunshuo.com
Hi, Cleaning up is generating temporary files which are occupying large disk space. I noticed for every source sstable file, it is generating 4 temporary files, and two of them is almost as large as the source sstable file. If there are two concurrent cleaning tasks running, I have to leave the