Build failed in Hudson: Cassandra #411

2010-04-20 Thread Apache Hudson Server 
See 

Changes:

[jbellis] add conf/cassandra-rack.properties example

[jbellis] add SimpleSnitch and make it the default
patch by Erick Tryzelaar; reviewed by jbellis for CASSANDRA-994

[jbellis] rename snitches to emphasize that RackAware is adding extra 
functionality that is not needed for simpler replication strategies.
patch by Erick Tryzelaar; reviewed by jbellis for CASSANDRA-994

[jbellis] rename EndPoint classes -> Endpoint, part 2.
patch by Erick Tryzelaar; reviewed by jbellis for CASSANDRA-994

[jbellis] avoid treating ttl <= 0 the same as ttl not specified
patch by jbellis; reviewed by Sylvain Lebresne for CASSANDRA-1003

[jbellis] r/m redundant specification of ThriftValidation classname.  patch by 
jbellis

[jbellis] r/m left-over old EndPoint classes (damn case-insensitive OS X)

[jbellis] rename EndPoint classes -> Endpoint (case change).
patch by Erick Tryzelaar; reviewed by jbellis for CASSANDRA-994

[jbellis] rename EndPoint -> Endpoint, part 1.  patch by Erick Tryzelaar; 
reviewed by jbellis for CASSANDRA-994

[jbellis] r/m contrib/cassandra_browser.  patch by jbellis for CASSANDRA-993

--
[...truncated 1167 lines...]
[junit] 
[junit] Cobertura: Loaded information on 766 classes.
[junit] Cobertura: Saved information on 766 classes.
[junit] Testsuite: org.apache.cassandra.db.RecoveryManager2Test
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.087 sec
[junit] 
[junit] Cobertura: Loaded information on 766 classes.
[junit] Cobertura: Saved information on 766 classes.
[junit] Testsuite: org.apache.cassandra.db.RecoveryManagerTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.789 sec
[junit] 
[junit] Cobertura: Loaded information on 766 classes.
[junit] Cobertura: Saved information on 766 classes.
[junit] Testsuite: org.apache.cassandra.db.RemoveColumnFamilyTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.583 sec
[junit] 
[junit] Cobertura: Loaded information on 766 classes.
[junit] Cobertura: Saved information on 766 classes.
[junit] Testsuite: org.apache.cassandra.db.RemoveColumnFamilyWithFlush1Test
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.676 sec
[junit] 
[junit] Cobertura: Loaded information on 766 classes.
[junit] Cobertura: Saved information on 766 classes.
[junit] Testsuite: org.apache.cassandra.db.RemoveColumnFamilyWithFlush2Test
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.666 sec
[junit] 
[junit] Cobertura: Loaded information on 766 classes.
[junit] Cobertura: Saved information on 766 classes.
[junit] Testsuite: org.apache.cassandra.db.RemoveColumnTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.672 sec
[junit] 
[junit] Cobertura: Loaded information on 766 classes.
[junit] Cobertura: Saved information on 766 classes.
[junit] Testsuite: org.apache.cassandra.db.RemoveSubColumnTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.673 sec
[junit] 
[junit] Cobertura: Loaded information on 766 classes.
[junit] Cobertura: Saved information on 766 classes.
[junit] Testsuite: org.apache.cassandra.db.RemoveSuperColumnTest
[junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.93 sec
[junit] 
[junit] Cobertura: Loaded information on 766 classes.
[junit] Cobertura: Saved information on 766 classes.
[junit] Testsuite: org.apache.cassandra.db.RowTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.535 sec
[junit] 
[junit] Cobertura: Loaded information on 766 classes.
[junit] Cobertura: Saved information on 766 classes.
[junit] Testsuite: org.apache.cassandra.db.SuperColumnTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.142 sec
[junit] 
[junit] Cobertura: Loaded information on 766 classes.
[junit] Cobertura: Saved information on 766 classes.
[junit] Testsuite: org.apache.cassandra.db.SystemTableTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.595 sec
[junit] 
[junit] Cobertura: Loaded information on 766 classes.
[junit] Cobertura: Saved information on 766 classes.
[junit] Testsuite: org.apache.cassandra.db.TableTest
[junit] Tests run: 10, Failures: 0, Errors: 0, Time elapsed: 3.786 sec
[junit] 
[junit] Cobertura: Loaded information on 766 classes.
[junit] Cobertura: Saved information on 766 classes.
[junit] Testsuite: org.apache.cassandra.db.TimeSortTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 4.583 sec
[junit] 
[junit] Cobertura: Loaded information on 766 classes.
[junit] Cobertura: Saved information on 766 classes.
[junit] Testsuite: org.apache.cassandra.db.commitlog.CommitLogHeaderTest
[junit] Tests run: 5, Failures: 0, Error

How to increase cassandra's performance in read?

2010-04-20 Thread yangfeng 
I  get 10 columns Family by keys and  one columns Family has 30 columns.
I use multigetSlice once to get 10 column Family.but the performance is so
poor.
anyone has other  thought to increase the performance.

Filters

2010-04-20 Thread Christian Torres 
Hello!

Is there any way to make filters (WHEREs) in cassandra? Or I have to manages
to do it

For example:

I have a ColumnFamily with a column in each row whose value is a state...
Public or Private, so I want to filter all rows that are private and also
the public ones in other form... Beside in that rows I will have names of
persons and I'll need to filter by Initials or Complete Lastnames, etc.

*So any idea?*

Regards

-- 
Christian Torres * Desarrollador Web * Guegue.com *
Celular: +505 84 65 92 62 * Loving of the Programming

Re: Filters

2010-04-20 Thread Roger Schildmeijer 
http://wiki.apache.org/cassandra/API#get_slice

// Roger Schildmeijer
On 20 apr 2010, at 18.50em, Christian Torres wrote:

> Hello!
> 
> Is there any way to make filters (WHEREs) in cassandra? Or I have to manages
> to do it
> 
> For example:
> 
> I have a ColumnFamily with a column in each row whose value is a state...
> Public or Private, so I want to filter all rows that are private and also
> the public ones in other form... Beside in that rows I will have names of
> persons and I'll need to filter by Initials or Complete Lastnames, etc.
> 
> *So any idea?*
> 
> Regards
> 
> -- 
> Christian Torres * Desarrollador Web * Guegue.com *
> Celular: +505 84 65 92 62 * Loving of the Programming

Re: Filters

2010-04-20 Thread Christian Torres 
Thanks a lot!!

On Tue, Apr 20, 2010 at 10:58 AM, Roger Schildmeijer  wrote:

> http://wiki.apache.org/cassandra/API#get_slice
>
> // Roger Schildmeijer
> On 20 apr 2010, at 18.50em, Christian Torres wrote:
>
> > Hello!
> >
> > Is there any way to make filters (WHEREs) in cassandra? Or I have to
> manages
> > to do it
> >
> > For example:
> >
> > I have a ColumnFamily with a column in each row whose value is a state...
> > Public or Private, so I want to filter all rows that are private and also
> > the public ones in other form... Beside in that rows I will have names of
> > persons and I'll need to filter by Initials or Complete Lastnames, etc.
> >
> > *So any idea?*
> >
> > Regards
> >
> > --
> > Christian Torres * Desarrollador Web * Guegue.com *
> > Celular: +505 84 65 92 62 * Loving of the Programming
>
>


-- 
Christian Torres * Desarrollador Web * Guegue.com *
Celular: +505 84 65 92 62 * Loving of the Programming

Re: 0.6 insert performance .... Re: [RELEASE] 0.6.1

2010-04-20 Thread Masood Mortazavi 
You're welcome Schubert.
I look forward to any new results you may come up with.

{ It would also be interesting, when you run your tests again, to look at
the GC logs and see to what extent
https://issues.apache.org/jira/browse/CASSANDRA-896 is the culprit for what
you will see. Identifying any other bottlenecks would be good, too. By the
way, it is always good to list what JVM you're using. }

On Mon, Apr 19, 2010 at 8:18 PM, Schubert Zhang  wrote:

> Since the scale of GC graph in the slides is different from the throughput
> ones. I will do another test for this issue.
> Thanks for your advices, Masood and Jonathan.
>
> ---
> Here, i just post my cossandra.in.sh.
> JVM_OPTS=" \
> -ea \
> -Xms128M \
> -Xmx6G \
> -XX:TargetSurvivorRatio=90 \
> -XX:+AggressiveOpts \
> -XX:+UseParNewGC \
> -XX:+UseConcMarkSweepGC \
> -XX:+CMSParallelRemarkEnabled \
> -XX:SurvivorRatio=128 \
> -XX:MaxTenuringThreshold=0 \
> -Dcom.sun.management.jmxremote.port=8081 \
> -Dcom.sun.management.jmxremote.ssl=false \
> -Dcom.sun.management.jmxremote.authenticate=false"
>
>
> On Tue, Apr 20, 2010 at 5:46 AM, Masood Mortazavi <
> masoodmortaz...@gmail.com> wrote:
>
>> Minimizing GC pauses or minimizing time slots allocated to GC pauses --
>> either through configuration or re-implementations of garbage collection
>> "bottlenecks" (i.e. object-generation "bottlenecks") -- seem to be the
>> immediate approach. (Other approaches appear to be more intrusive.)
>> At code level, using the GC logs, one can investigate further. There may
>> be places were some object recycling can make some larger difference.
>> Trying this first will probably bear more immediate fruit.
>>
>> - m.
>>
>>
>> On Mon, Apr 19, 2010 at 9:11 AM, Daniel Kluesing  wrote:
>>
>>>  We see this behavior as well with 0.6, heap usage graphs look almost
>>> identical. The GC is a noticeable bottleneck, we’ve tried jdku19 and jrockit
>>> vm’s. It basically kills any kind of soft real time behavior.
>>>
>>>
>>>
>>> *From:* Masood Mortazavi [mailto:masoodmortaz...@gmail.com]
>>> *Sent:* Monday, April 19, 2010 4:15 AM
>>> *To:* u...@cassandra.apache.org; dev@cassandra.apache.org
>>> *Subject:* 0.6 insert performance  Re: [RELEASE] 0.6.1
>>>
>>>
>>>
>>> I wonder if anyone can use:
>>>
>>>  * Add logging of GC activity (CASSANDRA-813)
>>> to confirm this:
>>>
>>> http://www.slideshare.net/schubertzhang/cassandra-060-insert-throughput
>>>
>>> - m.
>>>
>>>  On Sun, Apr 18, 2010 at 6:58 PM, Eric Evans 
>>> wrote:
>>>
>>>
>>> Hot on the trails of 0.6.0 comes our latest, 0.6.1. This stable point
>>> release contains a number of important bugfixes[1] and is a painless
>>> upgrade from 0.6.0.
>>>
>>> Enjoy!
>>>
>>> [1]: http://bit.ly/9NqwAb (changelog)
>>>
>>> --
>>> Eric Evans
>>> eev...@rackspace.com
>>>
>>>
>>>
>>
>>
>

Cassandra 0.5.1 restarts slow

2010-04-20 Thread Anthony Molinaro 
Hi,

  I have a cassandra cluster where a couple things are happening.  Every
once in a while a node will start to get backed up.  Checking tpstats I
see a very large value for ROW-MUTATION-STAGE.  Sometimes it will be able
to clear it if I give it enough time, other times the vm OOMs.  With some
nodes I also see this happen during restarts, I'll restart and have to
wait 6-12 hours for the node to not be marked as 'Down'.
I've seen
http://wiki.apache.org/cassandra/FAQ#slows_down_after_lotso_inserts
and ended up with the following settings.

KeysCachedFraction: 0.01
MemtableSizeInMB  : 100
MemtableObjectCountInMillions : 0.5
Heap  : -Xmx5G

I only have 2 CFs in this instance and entries are small so in most cases
I hit MemtableObjectCountInMillions first and total MemtableSizeInMB is
about 60MB-120MB for the 2 CFs combined.

Anyone have any pointers on where to look next?  These are m1.large EC2
instances (I want to move to xlarge to get more memory, but haven't yet
gotten clarification on the best process for node replacement, per my
other thread).

Thanks,

-Anthony

-- 

Anthony Molinaro