C* memory leak during compaction
I have 7 nodes of C* v2.2.5 running on CentOS 7 and using jemalloc for dynamic storage allocation. Use only one keyspace and one table with Leveled compaction strategy. I've loaded ~500 GB of data into the cluster with replication factor equals to 3 and waiting until compaction is finished. But during compaction each of the C* nodes allocates all the available memory (~128GB) and just stops its process. This is a known bug ? -- Thanks, Serj
profiling tools for cassandra
Hi What kind of profiling tools are available for cassandra? Other than datastax that shows read/write throughput, is there a way to visually inspect if the node fielding the question is being burdened? Where and how can i get more info on: 1. Correct balance of data stored and nodes required in the cluster? 2. i/o overload Some components of the above question may be displayed in datastax, but they are not displayed in a way that provides conclusive evidence that something is being overloaded. thanks
[GitHub] cassandra pull request: Cass: Implement ...
GitHub user vkasar opened a pull request: https://github.com/apache/cassandra/pull/63 Cass: Implement compaction for a specific t⦠â¦oken range You can merge this pull request into a Git repository by running: $ git pull https://github.com/vkasar/cassandra trunk Alternatively you can review and apply these changes as the patch at: https://github.com/apache/cassandra/pull/63.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #63 commit ff4f668ba81fcc6cea3078dcc1310130209981ca Author: Vishy Kasar Date: 2016-03-11T22:11:20Z Cass: Implement compaction for a specific token range --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cassandra pull request: Cass: Implement ...
Github user jasobrown commented on the pull request: https://github.com/apache/cassandra/pull/63#issuecomment-195596203 What version of c* are you targeting? Looks like you've based it on whatever our current trunk is. For the OSS c*, you are probably best targeting > 2.2, and the back port to our internal versions probably won't be too hard. I have further questions, as well, but waiting on this first piece of info. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cassandra pull request: Cass: Implement ...
Github user vkasar commented on the pull request: https://github.com/apache/cassandra/pull/63#issuecomment-195597797 This is based on OSS c* trunk. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cassandra pull request: Cass: Implement ...
Github user jasobrown commented on the pull request: https://github.com/apache/cassandra/pull/63#issuecomment-195602892 I thought this was an internal repo, hence my comments. We don't accept PRs for the Apache Cassandra project, so please upload a patch to the JIRA ticket or add a link to your guthub branch in the ticket --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] cassandra pull request: Cass: Implement ...
Github user vkasar closed the pull request at: https://github.com/apache/cassandra/pull/63 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Compaction Filter in Cassandra
Hello there, RocksDB has the feature called "Compaction Filter" to allow application to modify/delete a key-value during the background compaction. https://github.com/facebook/rocksdb/blob/v4.1/include/rocksdb/options.h#L201-L226 I'm wondering is there a plan/value to add this into C* as well? Or is there already a similar thing in C*? Thanks -- Dikang
