Have you checked the logs on the nodes to see if there are any
errors?
On 7/21/11 10:43 PM, Nilabja Banerjee wrote:
Hi All,
I am following this following link " http://www.datastax.com/docs/0.7/utilities/stress_java
" for a stress test. I am getting th
Hi All,
I am following this following link " *
http://www.datastax.com/docs/0.7/utilities/stress_java *" for a stress test.
I am getting this notification after running this command
*xxx.xxx.xxx.xx= my ip*
*contrib/stress/bin/stress -d xxx.xxx.xxx.xx*
*Created keyspaces. Sleeping 1s for propaga
All:
Is there an easy way to fix the bug by change server's code?
Best Regards
Donna li
-邮件原件-
发件人: Donna Li [mailto:donna...@utstar.com]
发送时间: 2011年7月8日 11:29
收件人: user@cassandra.apache.org
主题: cassandra server disk full
Does CASSANDRA-809 resolved or any other path can resolve the
SStable Rebuilding, it might be the problem of CASSANDRA-2280
On Thu, Jul 21, 2011 at 7:52 PM, aaron morton wrote:
> What are you seeing in compaction stats ?
>
> You may see some of https://issues.apache.org/jira/browse/CASSANDRA-2280
>
> Cheers
>
> -
> Aaron Morton
> Freelance
Did you check for a JVM crash log?
You should make sure you're running the latest Sun JVM, older versions
and OpenJDK in particular are prone to segfaulting.
On Thu, Jul 21, 2011 at 6:53 PM, Sameer Farooqui
wrote:
> We are starting Cassandra with "brisk cassandra", so as a stand-alone
> process,
We are starting Cassandra with "brisk cassandra", so as a stand-alone
process, not a service.
The syslog on the node doesn't show anything regarding the Cassandra Java
process around the time the last entries were made in the Cassandra
system.log (2011-07-21 13:01:51):
Jul 21 12:35:01 ip-10-2-206
The default init.d script will direct std out/err to that file, how are you
starting brisk / cassandra ?
Check the syslog and other logs in /var/log to see if the OS killed cassandra.
Also, what was the last thing in the casandra log before INFO [main] 2011-07-21
15:48:07,233 AbstractCassandra
Hey Aaron,
I don't have any output.log files in that folder:
ubuntu@ip-10-2-x-x:~$ cd /var/log/cassandra
ubuntu@ip-10-2-x-x:/var/log/cassandra$ ls
system.log system.log.11 system.log.4 system.log.7
system.log.1 system.log.2 system.log.5 system.log.8
system.log.10 system.log.3 system
Check /var/log/cassandra/output.log (assuming the default init scripts)
A
-
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com
On 22 Jul 2011, at 10:13, Sameer Farooqui wrote:
> Hmm. Just looked at the log more closely.
>
> So, what actually hap
Yes
-
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com
On 22 Jul 2011, at 10:06, Oleg Tsvinev wrote:
> Hi All,
>
> Cassandra documentation here:
>
> http://www.datastax.com/docs/0.8/data_model/supercolumns
>
> states that:
>
> Any request f
Looks like nodetool drain has been run.
Anything else in the logs ?
-
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com
On 22 Jul 2011, at 05:48, lebron james wrote:
> Why cassandra fall when i start comaction with nodetool on 35+gb database.
nit pick: nodetool repair is just called repair (or the Anti Entropy Service).
Read Repair is something that happens during a read request.
Short answer, yes it's safe to kill cassandra during a repair. It's one of the
nice things about never mutating data.
Longer answer: If nodetool compacti
I've no idea about the game or how long you will have to live to compute all
the combinations but how about:
- row key is byte array describing the position of white/black pieces and the
move indicator. You would need to have both rows keyed from blacks perspective
and rows keyed from whites pe
Hmm. Just looked at the log more closely.
So, what actually happened is while Repair was running on this specific
node, the Cassandra java process terminated itself automatically. The last
entries in the log are:
INFO [ScheduledTasks:1] 2011-07-21 13:00:20,285 GCInspector.java (line 128)
GC for
In my DB the keys added by the client were ascii strings like "foo", but these
are stored as binary arrays in cassandra. So I cannot use the string "foo" with
22table2json I have to use the ascii encoding 666f6f .
This will *probably* be what you see in the output from cassandra-cli list
(unles
Hi All,
Cassandra documentation here:
http://www.datastax.com/docs/0.8/data_model/supercolumns
states that:
Any request for a sub-column deserializes all sub-columns for that super
column, so you should avoid data models that rely on on large numbers of
sub-columns.
Is this still true?
Thank
See the online help in cassandra-cli on CREATE / UPDATE COLUMN FAMILY for
min_compaction_threshold and max_compaction_threshold.
Also look in the cassandra.yaml file for information on configuring compaction.
If compaction is really hurting your system it may be a sign that you need to
scale
> But how will you be able to maintain it while it evolves and new data is
> added without transactions?
What is the situation you think you need transactions for ?
Cheers
-
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com
On 22 Jul 2011, at
I wonder if it wont make problems...
Anyine did it already?
On Jul 21, 2011 10:39 PM, "Jonathan Ellis" wrote:
> dsh -c -g cassandra /etc/init.d/cassandra stop
>
> http://www.netfort.gr.jp/~dancer/software/dsh.html.en
>
> P.S. mostly people are concerned about making sure their entire
> cluster do
dsh -c -g cassandra /etc/init.d/cassandra stop
http://www.netfort.gr.jp/~dancer/software/dsh.html.en
P.S. mostly people are concerned about making sure their entire
cluster does NOT stop at the same time :)
On Thu, Jul 21, 2011 at 2:23 PM, Dean Hiller wrote:
> Is there a framework for stopping
Looks harmless to me.
On Thu, Jul 21, 2011 at 1:41 PM, Sameer Farooqui
wrote:
> While running Repair on a 0.8.1 node, we got this error in the system.log:
>
> ERROR [Thread-23] 2011-07-21 15:48:43,868 AbstractCassandraDaemon.java (line
> 113) Fatal exception in thread Thread[Thread-23,5,main]
> j
I have been thinking about the problem of repair for a while.
if we do not consider the need for partition-tolerance, then the
eventual consistency approach is probably the ultimate reason for
needing repairs: compared to Zookeeper/Spinnaker (recent VLDB
paper)/Chubby/HBase, those systems only nee
Is there a framework for stopping all nodes/starting all nodes for
cassandra? I am okay with something like password-less ssh setup that
hadoop scripts did...just something that allows me to start and stop the
whole cluster.
thanks,
Dean
While running Repair on a 0.8.1 node, we got this error in the system.log:
ERROR [Thread-23] 2011-07-21 15:48:43,868 AbstractCassandraDaemon.java (line
113) Fatal exception in thread Thread[Thread-23,5,main]
java.io.IOError: java.io.EOFException
at
org.apache.cassandra.net.IncomingTcpConnection.ru
Why cassandra fall when i start comaction with nodetool on 35+gb database.
all parameter are default.
ERROR [pool-2-thread-1] 2011-07-21 15:25:36,622 Cassandra.java (line 3294)
Internal error processing insert
java.util.concurrent.RejectedExecutionException: ThreadPoolExecutor has shut
down
Sounds like this one:
http://comments.gmane.org/gmane.comp.db.cassandra.user/15828
or
http://comments.gmane.org/gmane.comp.db.cassandra.user/15936
Hope you have a backup. That would make your life much easier ...
On Jul 21, 2011, at 4:54 PM, cbert...@libero.it wrote:
> Hi all,
> I can't get
thanks, and sorry for the noise
:)
On Thu, Jul 21, 2011 at 2:36 PM, Hartog C. de Mik
wrote:
> On Thu, Jul 21, 2011 at 07:41:26AM -0500, Rick Hohler wrote:
> > On Jul 21, 2011, at 5:07 AM, vicent roca daniel
> wrote:
> >
> > On Thu, Jul 21, 2011 at 11:57 AM, Zhu Han wrote:
> >
> > >
>
> See htt
On Thu, Jul 21, 2011 at 10:43 AM, wrote:
> from ticket 2818:
> "One (reasonably simple) proposition to fix this would be to have repair
> schedule validation compactions across nodes one by one (i.e, one CF/range
> at a time), waiting for all nodes to return their tree before submitting the
> nex
We have a 4 node 0.7.6 cluster. RF=2 , 3 TB data per node.
A read repair was kicked off on node 4 last week and is still in progress.
Later I kicked of read repair on node 2 a few days back.
We were writing(read/write/updates/NO deletes) data while the repair was in
progress but no data has been wr
from ticket 2818:
"One (reasonably simple) proposition to fix this would be to have repair
schedule validation compactions across nodes one by one (ie, one CF/range
at a time), waiting for all nodes to return their tree before submitting
the next request. Then on each node, we should make su
Just saw this and created a lhf ticket for it -
http://issues.apache.org/jira/browse/CASSANDRA-2932
On Jul 21, 2011, at 8:20 AM, Stephen Pope wrote:
> Boo-urns. Ok, thanks.
>
> -Original Message-
> From: Brandon Williams [mailto:dri...@gmail.com]
> Sent: Thursday, July 21, 2011 9:10 AM
On Thu, Jul 21, 2011 at 9:18 AM, Stephen Pope wrote:
> For a side project I’m working on I want to store the entire set of
> possible Reversi boards. There are an estimated 10^28 possible boards. Each
> board (from the best way I could think of to implement it) is made up of 2,
> 64-bit numbers (
Hi all,
I can't get the repair in my production.
We are out since 6 months but before we did not perform any delete do we
didn't need to run repair.
Now we are out since 2 weeks with a new version of our software that performs
delete but we can not get the nodetool repair working,
The first prob
On Thu, Jul 21, 2011 at 9:14 AM, Jonathan Colby
wrote:
> I regularly run repair on my cassandra cluster. However, I often seen that
> during the repair operation very large amounts of data are transferred to
> other nodes.
https://issues.apache.org/jira/browse/CASSANDRA-2280
https://issues.ap
You should be able to tell from earlier in the log if this is from a
request, from hinted handoff replay, or something else
On Wed, Jul 20, 2011 at 10:42 PM, Yan Chunlu wrote:
> thans for the reply.
> now the problem is how can I get rid of the ""N of 2147483647 ", it seems
> never ends, and the
Nice work, Todd!
On Thu, Jul 21, 2011 at 4:59 AM, Nilabja Banerjee
wrote:
> Thank you Nice work.
>
> On 21 July 2011 15:27, Zhu Han wrote:
>>
>> Very helpful. Thank you!
>>
>> best regards,
>> Zhu Han
>>
>>
>>
>> On Thu, Jul 21, 2011 at 12:24 PM, Todd Burruss
>> wrote:
>>>
>>> I put tog
I regularly run repair on my cassandra cluster. However, I often seen that
during the repair operation very large amounts of data are transferred to other
nodes.
My questions is, if only some data is out of sync, why are entire Data files
being transferred?
/var/lib/cassandra/data/DFS/ma
Boo-urns. Ok, thanks.
-Original Message-
From: Brandon Williams [mailto:dri...@gmail.com]
Sent: Thursday, July 21, 2011 9:10 AM
To: user@cassandra.apache.org
Subject: Re: cqlsh error using assume
'assume' is only valid in the cli, not cql.
On Thu, Jul 21, 2011 at 7:59 AM, Stephen Pope
For a side project I'm working on I want to store the entire set of possible
Reversi boards. There are an estimated 10^28 possible boards. Each board (from
the best way I could think of to implement it) is made up of 2, 64-bit numbers
(black pieces, white pieces...pieces in neither of those are
Thank You...
But truely speaking I dnt get you what do you mean by* key is binary, so
thats the ascii encoding for foo *
and another thing... this is the output of "list BTP" command
RowKey: 0902
=> (super_column=0902,
(column=30, value=303039303030303032, timestamp=1310471032735
'assume' is only valid in the cli, not cql.
On Thu, Jul 21, 2011 at 7:59 AM, Stephen Pope wrote:
> I’m trying to use cqlsh (on Windows) to get some values from my database
> using secondary indexes. I’m not sure if it’s something I’m doing or not (I
> can’t seem to find any syntactical help for a
I'm trying to use cqlsh (on Windows) to get some values from my database using
secondary indexes. I'm not sure if it's something I'm doing or not (I can't
seem to find any syntactical help for assume). I'm running:
assume TransactionLogs comparator as ascii
where TransactionLogs is my column fa
On Thu, Jul 21, 2011 at 07:41:26AM -0500, Rick Hohler wrote:
> On Jul 21, 2011, at 5:07 AM, vicent roca daniel wrote:
>
> On Thu, Jul 21, 2011 at 11:57 AM, Zhu Han wrote:
>
> >
See http://wiki.apache.org/cassandra/FAQ#unsubscribe
:-)
Grtz,
Hartog.
On Jul 21, 2011, at 5:07 AM, vicent roca daniel wrote:
On Thu, Jul 21, 2011 at 11:57 AM, Zhu Han wrote:
> Very helpful. Thank you!
>
> best regards,
> Zhu Han
>
>
>
> On Thu, Jul 21, 2011 at 12:24 PM, Todd Burruss wrote:
>
>> I put together a blog post on Cassandra Storage Sizing so I don’t
Hi! Tell me please, how i can manage compacting process, turn them off and
start manualy when i need. How i can improve performance of compacting
process? Thanks!
Hi Jeffery,
I meant for binary tree. go an watch the video (in my first email), it will
give you a better understanding.
Eldad
On Wed, Jul 20, 2011 at 11:33 PM, Jeffrey Kesselman wrote:
> Im not sure if I have an answer for you, anyway, but I'm curious
>
> A b-tree and a binary tree are not
Aaron,
Nested set is exactly what I had in mind.
But how will you be able to maintain it while it evolves and new data is
added without transactions?
Thanks!
On Thu, Jul 21, 2011 at 1:44 AM, aaron morton wrote:
> Just throwing out a (half baked) idea, perhaps the Nested Set Model of
> trees woul
mmm, there is no -f option for sstable2json / SSTableExport. Datastax
guys/girls ??
this works for me
bin/sstable2json /var/lib/cassandra/data/dev/data-g-1-Data.db -k 666f6f >
output.txt
NOTE: key is binary, so thats the ascii encoding for foo
Cheers
-
Aaron Morton
Freelanc
The data file with rows and columns, the bloom filter for the rows in the data
file, the index for rows in the data file and the statistics.
Cheers
-
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com
On 21 Jul 2011, at 23:26, Nilabja Banerje
What are you seeing in compaction stats ?
You may see some of https://issues.apache.org/jira/browse/CASSANDRA-2280
Cheers
-
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com
On 21 Jul 2011, at 23:17, Yan Chunlu wrote:
> after tried nodetool
*One more thing I want to ask here* ...in the data folder of cassandra, for
each columnfamily four type of .db files are generated. for example:
CFname-f-1-*Data*.db, CFname-f-1-*Filter*.db, CFname-f-1-*Index*.db,
CFname-f-1-*Statistic*.db,
*What are these extensions are?
*Thank you
On 21 July
This is the full path of SSTables:
/Users/nilabja/Development/Cassandra/apache-cassandra-0.7.5/data/*cctest*
/BTP-f-1-Data.db
*cctest= *keyspace
*BTP*= Columnfamily name
json file= /Users/nilabja/Development/Cassandra/testjson.txt
commands are:
bin/sstable2json -f output.txt
/Users/nilabja/Deve
after tried nodetool -h reagon repair key cf, I found that even repair
single CF, it involves rebuild all sstables(using nodetool compactionstats),
is that normal?
On Thu, Jul 21, 2011 at 7:56 AM, Aaron Morton wrote:
> If you have never run repair also check the section on repair on this page
> h
I've never used it myself as it's not something I need. You'll have to try and
build it yourself I'm afraid.
Cheers
-
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com
On 21 Jul 2011, at 23:02, Selcuk Bozdag wrote:
> Thanks for the reply. I d
Thanks for the reply. I don't have the specific setup environment for
the tool chiton. It could be more convenient for me to see some
screenshots to grab the idea.
Would you please send me(or the mailing list) a couple of them?
Thanks indeed,
Selcuk
On 21 July 2011 01:55, aaron morton wrote:
>
Thanks Aaron and samal for your quick response. Its going to be helpful
On Thu, Jul 21, 2011 at 4:15 PM, aaron morton wrote:
> Try the project wiki here
> http://wiki.apache.org/cassandra/ArchitectureOverview or the my own blog
> here
> http://thelastpickle.com/2011/04/28/Forces-of-Write-and-
Thanks samal... I got it now
On Thu, Jul 21, 2011 at 4:11 PM, samal wrote:
>
> Any ways , some where memtable has to be stored right, like we say memtable
> data is flushed to create sstable on disk.
>
>> Exactly from which location or memory it will be getting from. is it like
>> an objects
background http://wiki.apache.org/cassandra/FAQ#slows_down_after_lotso_inserts
Without more info my initial guess is some GC pressure and/or IO pressure from
compaction. Check the logs for messages from the GCInspector or connect
JConsole to the instance and take a look at the heap. Here is some
Try the project wiki here http://wiki.apache.org/cassandra/ArchitectureOverview
or the my own blog here
http://thelastpickle.com/2011/04/28/Forces-of-Write-and-Read/
There is also a list of articles on the wiki here
http://wiki.apache.org/cassandra/ArticlesAndPresentations
in short, writes got
Any ways , some where memtable has to be stored right, like we say memtable
data is flushed to create sstable on disk.
> Exactly from which location or memory it will be getting from. is it like
> an objects streams or like it is storing the values in commitlog.
>
A Memtable is Cassandra's in-mem
What is the command line you are executing ?
That error is only returned by sstable2json when an sstable path is not passed
on the command line.
Cheers
-
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com
On 21 Jul 2011, at 18:50, Nilabja Ba
To clear the key cache use the invalidateKeyCache() operation on the column
family in JConsole / JMX
Cheers
-
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com
On 21 Jul 2011, at 18:15, 魏金仙 wrote:
> Can any one tell how to reset "keys_cached"?
On Thu, Jul 21, 2011 at 11:57 AM, Zhu Han wrote:
> Very helpful. Thank you!
>
> best regards,
> Zhu Han
>
>
>
> On Thu, Jul 21, 2011 at 12:24 PM, Todd Burruss wrote:
>
>> I put together a blog post on Cassandra Storage Sizing so I don’t need
>> to keep figuring it out again and again. Hope ever
Thank you Nice work.
On 21 July 2011 15:27, Zhu Han wrote:
> Very helpful. Thank you!
>
> best regards,
> Zhu Han
>
>
>
> On Thu, Jul 21, 2011 at 12:24 PM, Todd Burruss wrote:
>
>> I put together a blog post on Cassandra Storage Sizing so I don’t need
>> to keep figuring it out again an
Very helpful. Thank you!
best regards,
Zhu Han
On Thu, Jul 21, 2011 at 12:24 PM, Todd Burruss wrote:
> I put together a blog post on Cassandra Storage Sizing so I don’t need to
> keep figuring it out again and again. Hope everyone finds it useful, and
> give feedback if you find errors.
Please help me solve one problem I have server with 4 GB RAM and 2x 4 cores
CPU When i start do massive writes in cassandra all works fine. but after
couple hours with 10K inserts per second database grows up to 25+ GB
performance go down to 500 insert per seconds I find out this because
compacting
Hi,
You r right but i too have some concerns...
Any ways , some where memtable has to be stored right, like we say memtable
data is flushed to create sstable on disk.
Exactly from which location or memory it will be getting from. is it like an
objects streams or like it is storing the values in c
It was easier than what I though :-)
thanks
>Messaggio originale
>Da: jeremy.hanna1...@gmail.com
>Data: 20/07/2011 22.25
>A:
>Ogg: Re: My "nodetool" in Java
>
>If you look at the bin/nodetool file, it's just a shell script to run org.
apache.cassandra.tools.NodeCmd. You could probably ca
That looks very much the same, yes.
--
Sylvain
On Thu, Jul 21, 2011 at 3:15 AM, Boris Yen wrote:
> Not sure if this is the same. I saw exceptions like this:
> INFO 15:33:49,336 Finished reading
> /root/commitlog_tmp/CommitLog-1311135088656.log
> ERROR 15:33:49,336 Exception encountered during s
SSTable is stored on disk not memtable.
Memtable is memory representation of data, which is on flush to create
SSTable on disk.
This is the location where SSTable is stored
https://github.com/apache/cassandra/blob/trunk/conf/cassandra.yaml#L71
Where as Commitlog which is back up (log) for memta
Hi,
Can you please let me know where exactly the memtables are getting stored. I
wanted to know the physical location
Yes Sure,
That would be better if could make it out like fee kind or meetup some where
some time...
On Thu, Jul 21, 2011 at 11:35 AM, Sasha Dolgy wrote:
> I am quite certain if you find enough people and pony up the fees a few
> people on this list would be willing to make the journey...
> On J
72 matches
Mail list logo
