Hi,
We are using cassandra 0.6.5 to store some analysis data. Recently we added
a timer task to remove data older than a month and deployed on a test
setup.
The removal worked fine but immediately after the data was removed cassandra
node got OutOfMemory in compaction thread. Heap size is configur
aha, there was a bug in the cleanup for the System keyspace. patched:
https://issues.apache.org/jira/browse/CASSANDRA-1564
On Thu, Sep 30, 2010 at 9:54 PM, Jonathan Ellis wrote:
> they are cleaned out on every start, yes. this is logged.
>
> On Thu, Sep 30, 2010 at 9:51 PM, Aaron Morton wrote:
they are cleaned out on every start, yes. this is logged.
On Thu, Sep 30, 2010 at 9:51 PM, Aaron Morton wrote:
> No in my app. Only the default one in Keyspace1 which would not have been in
> use.
>
> Out of interest, are these the same tmp files generated during (minor)
> compaction? Would they
No in my app. Only the default one in Keyspace1 which would not have been in use. Out of interest, are these the same tmp files generated during (minor) compaction? Would they have been left over from a clumsy dev shutting down the process during compaction? Looking at the timestamps on the files t
tmp files should be fine.
do you have 2ary indexes defined?
On Thu, Sep 30, 2010 at 9:23 PM, Aaron Morton wrote:
> Yes, these were the tmp files in the system directory.
> -rw-r--r-- 1 root root 0 2010-09-01 11:19
> HintsColumnFamily-tmp-e-81-Index.db
> -rw-r--r-- 1 root root
Yes, these were the tmp files in the system directory.-rw-r--r-- 1 root root 0 2010-09-01 11:19 HintsColumnFamily-tmp-e-81-Index.db-rw-r--r-- 1 root root 0 2010-09-01 11:20 HintsColumnFamily-tmp-e-82-Index.db-rw-r--r-- 1 root root 0 2010-09-01 11:20 HintsColumnFamily-t
Do you have a zero-byte sstable somewhere?
On Thu, Sep 30, 2010 at 5:34 PM, Aaron Morton wrote:
> The last line in the log before the error was
> INFO [main] 2010-10-01 11:18:06,654 SSTableReader.java (line 162) Sampling
> index for
> /local1/junkbox/cassandra/data/system/HintsColumnFamily-tmp-e-
OK, turns out the sky was not falling :)driftx helped me on IRC, we added the node tokens to the yaml file then deleted the entire system directory, restarted and it worked. Guess I need to go back and read http://www.riptano.com/blog/live-schema-updates-cassandra-07 to understand schema propagatio
On Thu, Sep 30, 2010 at 5:25 PM, Peter Harrison wrote:
> If you delete a row, and it therefore is marked as tombstone, and
> subsequently you try to insert the row again it appears to succeed,
> but if you try to request the row you don't get a result.
>
> If you try to insert a row that has been
Upgrading from 0.7 nightly for 31/08 to beta 2. This one seems serious, schema migration is failing. I'm dead in the water here, so any quick ideas appreciated. Have done an import schema on one node, and also tried system_add_keyspace on the same node. It's showing the Keyspace1 and my keyspace. B
The last line in the log before the error was INFO [main] 2010-10-01 11:18:06,654 SSTableReader.java (line 162) Sampling index for /local1/junkbox/cassandra/data/system/HintsColumnFamily-tmp-e-87-<>There were several tmp files for the HintColumnFamily there. I moved them and it started. I did run a
Am upgrading from the 0.7.0 nightly build for 31/08 to the beta 2. I've deleted the Schema* CF's in the system Keyspace and when I start the new install I get this...java.lang.NullPointerException at org.apache.cassandra.io.sstable.IndexSummary.complete(IndexSummary.java:60) at org.ap
On Thu, Sep 30, 2010 at 1:08 PM, Gabor Torok
wrote:
> I added a comment to an existing issue:
> https://issues.apache.org/jira/browse/AVRO-537
Cool. I'll work with Jeff (who sits about 10 feet from me) to get this fixed. :)
-ryan
I ran the nodetool cleanup...but the scenario doesn't change...
On Thu, Sep 30, 2010 at 1:14 PM, Edward Capriolo wrote:
> After nodetool move you have to run nodetool cleanup.
>
> On Thu, Sep 30, 2010 at 3:45 PM, Rana Aich wrote:
> > I have arranged my initial tokens and get this result:
> > Add
Are you re-using the timestamp from the first insert on the second insert? The insert must occur after the tombstone, otherwise cassandra will assume the tombstone is the current version and ignore the delete. AaronOn 01 Oct, 2010,at 10:25 AM, Peter Harrison wrote:If you delete a row, and it ther
If you delete a row, and it therefore is marked as tombstone, and
subsequently you try to insert the row again it appears to succeed,
but if you try to request the row you don't get a result.
If you try to insert a row that has been recently deleted, and has an
active tombstone I would expect eith
After nodetool move you have to run nodetool cleanup.
On Thu, Sep 30, 2010 at 3:45 PM, Rana Aich wrote:
> I have arranged my initial tokens and get this result:
> Address Status Load Range
> Ring
>
> 17014118346046923173168730371588000
> 192.168.202.1 Up 208.39
Okay, I've tested again with the latest build. I am using cleanup() reducer's
method to write
10 rows with 2 columns each.
With default value of
mapreduce.output.columnfamilyoutputformat.batch.threshold, 10 rows are written
with second (!!!) column only.
When mapreduce.output.columnfamilyoutput
I added a comment to an existing issue:
https://issues.apache.org/jira/browse/AVRO-537
Thanks,
--Gabor
It's specified as part of the schema functions such as system_add_keyspace. So it will depend on which language/client you are using to add the keyspace. Take a look at /test/system/test_thrift_server.py in test_column_validators() line 1237 for an example of using the ThriftAPI in Python (you wou
Coool. Would you mind opening an Avro issue for that, or should I?
-Original Message-
From: "Gabor Torok"
Sent: Thursday, September 30, 2010 2:36pm
To: "user@cassandra.apache.org"
Subject: RE: avro + cassandra + ruby
The ruby code creates a new http connection for each call to transceiv
I have arranged my initial tokens and get this result:
Address Status Load Range
Ring
17014118346046923173168730371588000
192.168.202.1 Up 208.39 GB
3402823669209384634633746074317700 |<--|
192.168.202.2 Up 333.52 GB
6805647338418769269267492148
Sorry for my continued questioning, by now I must have bored everyone about
this topic. I have one last question: how do you create such an index? I
found only ColumnFamilyStoreText.testIndexCreate(), but it appears that this
uses internal API, and thus cannot be invoked from a client side or throu
If you turn logging up to DEBUG do you see any lines such as this when running your script.DEBUG [pool-1-thread-22] 2010-10-01 08:22:12,723 ClientState.java (line 107) logged out: #And out of interest, if you send two multiget_slice calls, do they both log from the same thread? e.g. DEBUG [pool-1-t
The ruby code creates a new http connection for each call to transceive. Here
is what I changed to make it work:
gabor$ diff /usr/local/lib/ruby/gems/1.8/gems/avro-1.4.0/lib/avro/ipc.rb
~/avro-trunk/lang/ruby/lib/avro/ipc.rb
518d517
< require "net/http"
525d523
< @conn = Net::HTTP.start
I ran the python code like Gary suggested and it succeeded. (As an aside, it
would be nice if I could run the python code for avro without having thrift
installed.)
Then I re-created my ruby example in python (essentially calling set_keyspace
and then making a multiget_slice call) and it also s
or d...@riptano.com
On Wed, Sep 29, 2010 at 11:43 AM, Jonathan Ellis wrote:
> We'll get those fixed.
>
> Here or tho...@riptano.com directly is fine.
>
> Thanks!
>
The server exception is:
WARN 09:49:56,644 user error
org.apache.cassandra.avro.KeyspaceNotDefinedException
at
org.apache.cassandra.avro.AvroValidation.validateKeyspace(AvroValidation.java:73)
at
org.apache.cassandra.avro.AvroValidation.validateColumnParent(AvroValidation.java:12
Yes, I was aware of the memlock approach, and the Jira ticket. Just thought
someone might want to see how mysql handled some of the same issues.
On Wed, Sep 29, 2010 at 9:02 PM, Narendra Sharma
wrote:
> Read "Use mlockall via JNA, if present, to prevent Linux from swapping out
> parts of the JV
Take a look at the get_indexed_slices method in the 0.7.0-beta Thrift interface.
-Original Message-
From: "Christian Decker"
Sent: Thursday, September 30, 2010 4:38am
To: user@cassandra.apache.org
Subject: Re: LongType from user input
I just read through the tickets on Jira, and it appea
BTW is there an official Roadmap which states when the 0.7 release is to be
expected?
On Thu, Sep 30, 2010 at 11:38 AM, Christian Decker <
decker.christ...@gmail.com> wrote:
> I just read through the tickets on Jira, and it appears that indices are
> implemented in the 0.7 source tree, but I cann
I just read through the tickets on Jira, and it appears that indices are
implemented in the 0.7 source tree, but I cannot find any pointer on how to
use them. I'll be trying to create a custom CassandraStorage that loads data
through the indices, anyone else interested?
Regards,
Chris
On Thu, Sep
AFAIK indexes are still in dev. The only example is in the system_tests.py in
the source tree.
Aaron
On 30 Sep 2010, at 20:10, Christian Decker wrote:
> Apparently I have blanked the 0.7 completely out of my memory. I was trying
> to implement application layer indices and ignored the fact th
Apparently I have blanked the 0.7 completely out of my memory. I was trying
to implement application layer indices and ignored the fact that Cassandra
0.7 is implementing them by default. I found ticket CASSANDRA-749 about the
indices and am reading through the code right now, but is there a higher
34 matches
Mail list logo
