Re: [VOTE] Release Apache Cassandra 1.1

2012-04-24 Thread Sylvain Lebresne 
I'm counting 5 binding +1's and no -1's, the vote passes. I'll get the
artifacts published right away.

--
Sylvain

On Sat, Apr 21, 2012 at 12:12 AM, Gary Dusbabek  wrote:
> +1
>
> On Fri, Apr 20, 2012 at 12:38, Sylvain Lebresne  wrote:
>> The RC1 went well and we basically don't have any issue open left, so I
>> think it's time to release the final Cassandra 1.1. I thus propose the
>> following artifacts for release as 1.1.0.
>>
>> sha1: c671532825b9e05bd2b50e3aa2d1c5f5156d1c9f
>> Git: 
>> http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a=shortlog;h=refs/tags/1.1.0-tentative
>> Artifacts: 
>> https://repository.apache.org/content/repositories/orgapachecassandra-077/org/apache/cassandra/apache-cassandra/1.1.0/
>> Staging repository:
>> https://repository.apache.org/content/repositories/orgapachecassandra-077/
>>
>> The artifacts as well as the debian package are also available here:
>> http://people.apache.org/~slebresne/
>>
>> The vote will be open for 72 hours (longer if needed).
>>
>> [1]: http://goo.gl/KOOnk (CHANGES.txt)
>> [2]: http://goo.gl/o1la0 (NEWS.txt)

Build failed in Jenkins: Cassandra-Coverage #198

2012-04-24 Thread Apache Jenkins Server 
See 

--
Started by user olamy
Building remotely on ubuntu4 in workspace 

Checkout:Cassandra-Coverage / 
 - 
hudson.remoting.Channel@45926c61:ubuntu4
Using strategy: Default
Checkout:Cassandra-Coverage / 
 - 
hudson.remoting.LocalChannel@fb1a64c
Cloning the remote Git repository
Cloning repository origin
Fetching upstream changes from 
http://git-wip-us.apache.org/repos/asf/cassandra.git
Commencing build of Revision 04874186892c86a20181a2f64c5dc24285021b2c 
(origin/trunk)
Checking out Revision 04874186892c86a20181a2f64c5dc24285021b2c (origin/trunk)
FATAL: Could not apply tag jenkins-Cassandra-Coverage-198
hudson.plugins.git.GitException: Could not apply tag 
jenkins-Cassandra-Coverage-198
at hudson.plugins.git.GitAPI.tag(GitAPI.java:730)
at hudson.plugins.git.GitSCM$4.invoke(GitSCM.java:1272)
at hudson.plugins.git.GitSCM$4.invoke(GitSCM.java:1220)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2154)
at hudson.remoting.UserRequest.perform(UserRequest.java:118)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:287)
at 
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
Caused by: hudson.plugins.git.GitException: Error performing command: git tag 
-a -f -m Jenkins Build #198 jenkins-Cassandra-Coverage-198
Command "git tag -a -f -m Jenkins Build #198 jenkins-Cassandra-Coverage-198" 
returned status code 128: 
*** Please tell me who you are.

Run

  git config --global user.email "y...@example.com"
  git config --global user.name "Your Name"

to set your account's default identity.
Omit --global to set the identity only in this repository.

fatal: empty ident   not allowed

at hudson.plugins.git.GitAPI.launchCommandIn(GitAPI.java:776)
at hudson.plugins.git.GitAPI.launchCommand(GitAPI.java:741)
at hudson.plugins.git.GitAPI.launchCommand(GitAPI.java:751)
at hudson.plugins.git.GitAPI.tag(GitAPI.java:728)
... 12 more
Caused by: hudson.plugins.git.GitException: Command "git tag -a -f -m Jenkins 
Build #198 jenkins-Cassandra-Coverage-198" returned status code 128: 
*** Please tell me who you are.

Run

  git config --global user.email "y...@example.com"
  git config --global user.name "Your Name"

to set your account's default identity.
Omit --global to set the identity only in this repository.

fatal: empty ident   not allowed

at hudson.plugins.git.GitAPI.launchCommandIn(GitAPI.java:771)
... 15 more

Build failed in Jenkins: Cassandra-quick #200

2012-04-24 Thread Apache Jenkins Server 
See 

--
[...truncated 456 lines...]
[junit] Testsuite: org.apache.cassandra.io.BloomFilterTrackerTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 4.803 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.CompactSerializerTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 5.545 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.LazilyCompactedRowTest
[junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 5.862 sec
[junit] 
[junit] Testsuite: 
org.apache.cassandra.io.compress.CompressedRandomAccessReaderTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.729 sec
[junit] 
[junit] - Standard Error -
[junit]  WARN 13:42:25,312 open(null, O_RDONLY) failed, errno (14).
[junit] -  ---
[junit] Testsuite: org.apache.cassandra.io.sstable.DescriptorTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.044 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.IndexHelperTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.047 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.LegacySSTableTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.46 sec
[junit] 
[junit] Testsuite: 
org.apache.cassandra.io.sstable.SSTableMetadataSerializerTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.1 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.SSTableReaderTest
[junit] Tests run: 7, Failures: 0, Errors: 1, Time elapsed: 5.269 sec
[junit] 
[junit] Testcase: 
testPersistentStatisticsFromOlderIndexedSSTable(org.apache.cassandra.io.sstable.SSTableReaderTest):
   Caused an ERROR
[junit] java.io.IOException: rename failed of 
build/test/cassandra/data/Keyspace1/Indexed1/Keyspace1-Indexed1.626972746864617465-ib-4-Data.db
[junit] java.io.IOError: java.io.IOException: rename failed of 
build/test/cassandra/data/Keyspace1/Indexed1/Keyspace1-Indexed1.626972746864617465-ib-4-Data.db
[junit] at 
org.apache.cassandra.io.sstable.SSTableWriter.rename(SSTableWriter.java:359)
[junit] at 
org.apache.cassandra.db.ColumnFamilyStore.loadNewSSTables(ColumnFamilyStore.java:476)
[junit] at 
org.apache.cassandra.io.sstable.SSTableReaderTest.clearAndLoad(SSTableReaderTest.java:166)
[junit] at 
org.apache.cassandra.io.sstable.SSTableReaderTest.assertIndexQueryWorks(SSTableReaderTest.java:293)
[junit] at 
org.apache.cassandra.io.sstable.SSTableReaderTest.testPersistentStatisticsFromOlderIndexedSSTable(SSTableReaderTest.java:244)
[junit] Caused by: java.io.IOException: rename failed of 
build/test/cassandra/data/Keyspace1/Indexed1/Keyspace1-Indexed1.626972746864617465-ib-4-Data.db
[junit] at 
org.apache.cassandra.utils.FBUtilities.renameWithConfirm(FBUtilities.java:235)
[junit] at 
org.apache.cassandra.io.sstable.SSTableWriter.rename(SSTableWriter.java:355)
[junit] 
[junit] 
[junit] Test org.apache.cassandra.io.sstable.SSTableReaderTest FAILED
[junit] Testsuite: org.apache.cassandra.io.sstable.SSTableSimpleWriterTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 4.897 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.SSTableTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 5.069 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.util.BufferedRandomAccessFileTest
[junit] Tests run: 18, Failures: 0, Errors: 0, Time elapsed: 0.629 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.locator.DynamicEndpointSnitchTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.681 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.locator.EC2SnitchTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.451 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.locator.NetworkTopologyStrategyTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.465 sec
[junit] 
[junit] Testsuite: 
org.apache.cassandra.locator.OldNetworkTopologyStrategyTest
[junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 4.895 sec
[junit] 
[junit] - Standard Output ---
[junit] toStream : [(158873535527910577765226390751398592512,0], 
(0,34028236692093846346337460743176821145]]
[junit] toFetch : 
[(127605887595351923798765477786913079296,148873535527910577765226390751398592512]]
[junit] toStreamExpected : [(158873535527910577765226390751398592512,0], 
(0,34028236692093846346337460743176821145]]
[junit] toFetchExpected : 
[(127605887595351923798765477786913079296,148873535527910577765226390751398592512]]
[junit] -  ---
[junit] Tests

Build failed in Jenkins: Cassandra #1272

2012-04-24 Thread Apache Jenkins Server 
See 

--
[...truncated 1151 lines...]
[junit] 
[junit] Testsuite: org.apache.cassandra.dht.RandomPartitionerTest
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.799 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.dht.RangeTest
[junit] Tests run: 22, Failures: 0, Errors: 0, Time elapsed: 0.479 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.gms.ArrivalWindowTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.451 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.gms.GossipDigestTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.043 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.gms.SerializationsTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 4.946 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.hadoop.ColumnFamilyInputFormatTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.158 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.BloomFilterTrackerTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 5.014 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.CompactSerializerTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 5.681 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.LazilyCompactedRowTest
[junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 6.19 sec
[junit] 
[junit] Testsuite: 
org.apache.cassandra.io.compress.CompressedRandomAccessReaderTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.74 sec
[junit] 
[junit] - Standard Error -
[junit]  WARN 13:57:52,548 open(null, O_RDONLY) failed, errno (14).
[junit] -  ---
[junit] Testsuite: org.apache.cassandra.io.sstable.DescriptorTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.044 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.IndexHelperTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.047 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.LegacySSTableTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.806 sec
[junit] 
[junit] Testsuite: 
org.apache.cassandra.io.sstable.SSTableMetadataSerializerTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.1 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.SSTableReaderTest
[junit] Tests run: 7, Failures: 0, Errors: 1, Time elapsed: 5.556 sec
[junit] 
[junit] Testcase: 
testPersistentStatisticsFromOlderIndexedSSTable(org.apache.cassandra.io.sstable.SSTableReaderTest):
   Caused an ERROR
[junit] java.io.IOException: rename failed of 
build/test/cassandra/data/Keyspace1/Indexed1/Keyspace1-Indexed1.626972746864617465-ib-4-Data.db
[junit] java.io.IOError: java.io.IOException: rename failed of 
build/test/cassandra/data/Keyspace1/Indexed1/Keyspace1-Indexed1.626972746864617465-ib-4-Data.db
[junit] at 
org.apache.cassandra.io.sstable.SSTableWriter.rename(SSTableWriter.java:359)
[junit] at 
org.apache.cassandra.db.ColumnFamilyStore.loadNewSSTables(ColumnFamilyStore.java:476)
[junit] at 
org.apache.cassandra.io.sstable.SSTableReaderTest.clearAndLoad(SSTableReaderTest.java:166)
[junit] at 
org.apache.cassandra.io.sstable.SSTableReaderTest.assertIndexQueryWorks(SSTableReaderTest.java:293)
[junit] at 
org.apache.cassandra.io.sstable.SSTableReaderTest.testPersistentStatisticsFromOlderIndexedSSTable(SSTableReaderTest.java:244)
[junit] Caused by: java.io.IOException: rename failed of 
build/test/cassandra/data/Keyspace1/Indexed1/Keyspace1-Indexed1.626972746864617465-ib-4-Data.db
[junit] at 
org.apache.cassandra.utils.FBUtilities.renameWithConfirm(FBUtilities.java:235)
[junit] at 
org.apache.cassandra.io.sstable.SSTableWriter.rename(SSTableWriter.java:355)
[junit] 
[junit] 
[junit] Test org.apache.cassandra.io.sstable.SSTableReaderTest FAILED
[junit] Testsuite: org.apache.cassandra.io.sstable.SSTableSimpleWriterTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 4.992 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.SSTableTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 5.309 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.util.BufferedRandomAccessFileTest
[junit] Tests run: 18, Failures: 0, Errors: 0, Time elapsed: 0.621 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.locator.DynamicEndpointSnitchTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.864 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.locator.EC2SnitchTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.461 sec
[ju

Re: Consistency with Sequential Mutation/Access?

2012-04-24 Thread Niklas Ekström 
On tis, 2012-04-24 at 20:08 +0530, Praveen Baratam wrote:
> I will start with a hypothetical scenario to make my question easy to
> comprehend.
> 
> Time 1: Client A updates Row 1 in CF C. N=3, W=1
> 
> Time 2: Client A reads Row1 in CF C. N=3, R=1
> 
> Can we expect the update to be seen by all replicas and reply consistently
> in T2?
> 
> I presume Cassandra queues job messages on each node for execution. And
> because the coordinator node sends write messages to all replicas
> irrespective of how many replicas it  waits for ACK,

But there is no guarantee that all replicas receives the write messages
just because the messages were sent. Perhaps at T1 there was a (long
lasting) network partition and only the replica that responded with an
ACK actually got the message. Then at T2 the network partition may have
healed and the replica that ACK'ed the write may have crashed.

> the READ Job will be
> executed on each replica after the WRITE job, essentially delivering
> consistent data on sequential access.
> 
> Is this the way or there is no order in which messages are received and
> processed?

Niklas

Re: Consistency with Sequential Mutation/Access?

2012-04-24 Thread Russell Haering 
On Tue, Apr 24, 2012 at 7:38 AM, Praveen Baratam
 wrote:
> I will start with a hypothetical scenario to make my question easy to
> comprehend.
>
> Time 1: Client A updates Row 1 in CF C. N=3, W=1
>
> Time 2: Client A reads Row1 in CF C. N=3, R=1
>
> Can we expect the update to be seen by all replicas and reply consistently
> in T2?

To get the behavior you want you need W+R > N (and Client A needs to
have received confirmation of the successful write before performing
the read).

With W = 1, two replicas could be unavailable to the coordinator node
and not receive the update. They should *eventually* receive the
update, but if you read with R = 1 before they do so, it is possible
that the value you are reading is a stale value from a previously
unavailable node.

If you used W = 2 then by the time the write successfully completes
the updated value must be on 2 of the 3 replicas. A read with R = 2
then cannot complete without finding and returning the new value.

Build failed in Jenkins: Cassandra-quick #201

2012-04-24 Thread Apache Jenkins Server 
See 

Changes:

[xedin] Add way to force the cassandra-cli to refresh it's schema

[xedin] fix for situation when assumtions are read for CF that does not exist 
(CASSANDRA-4052)

[jbellis] fix type in CQL3 ALTER TABLE

[jbellis] Remove other obsolete NEW entry

[jbellis] Throw invalid exception in CQL3 on obsolete options

[jbellis] Update versions and licence in preparation for 1.1.0 release

[jbellis] add concurrent schema, cql3, and CFRR wide rows to NEWS.  clarify 
that KeyRange.filter allows Hadoop to take advantage of C* indexes

[jbellis] fix CHANGES

[jbellis] elaborate on why cache changes matter from end-user perspective

[jbellis] move cql changes to own section of changelog

[jbellis] Pig wide row support.

[jbellis] Update NEWS for 3909

[jbellis] avoid generating redundant compaction tasks during streaming

[jbellis] add JdbcDecimalTest

[brandonwilliams] Remove obsolete line from the NEWS file

[brandonwilliams] Remove other obsolete NEW entry

[brandonwilliams] add concurrent schema, cql3, and CFRR wide rows to NEWS.  
clarify that KeyRange.filter allows Hadoop to take advantage of C* indexes

[brandonwilliams] Fix wide row counter deserialization.

--
[...truncated 458 lines...]
[junit] 
[junit] Testsuite: org.apache.cassandra.io.BloomFilterTrackerTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 5.38 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.CompactSerializerTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 6.197 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.LazilyCompactedRowTest
[junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 6.507 sec
[junit] 
[junit] Testsuite: 
org.apache.cassandra.io.compress.CompressedRandomAccessReaderTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.919 sec
[junit] 
[junit] - Standard Error -
[junit]  WARN 18:36:44,970 open(null, O_RDONLY) failed, errno (14).
[junit] -  ---
[junit] Testsuite: org.apache.cassandra.io.sstable.DescriptorTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.06 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.IndexHelperTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.066 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.LegacySSTableTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 6.241 sec
[junit] 
[junit] Testsuite: 
org.apache.cassandra.io.sstable.SSTableMetadataSerializerTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.137 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.SSTableReaderTest
[junit] Tests run: 7, Failures: 0, Errors: 1, Time elapsed: 5.666 sec
[junit] 
[junit] Testcase: 
testPersistentStatisticsFromOlderIndexedSSTable(org.apache.cassandra.io.sstable.SSTableReaderTest):
   Caused an ERROR
[junit] java.io.IOException: rename failed of 
build/test/cassandra/data/Keyspace1/Indexed1/Keyspace1-Indexed1.626972746864617465-ib-4-Data.db
[junit] java.io.IOError: java.io.IOException: rename failed of 
build/test/cassandra/data/Keyspace1/Indexed1/Keyspace1-Indexed1.626972746864617465-ib-4-Data.db
[junit] at 
org.apache.cassandra.io.sstable.SSTableWriter.rename(SSTableWriter.java:359)
[junit] at 
org.apache.cassandra.db.ColumnFamilyStore.loadNewSSTables(ColumnFamilyStore.java:476)
[junit] at 
org.apache.cassandra.io.sstable.SSTableReaderTest.clearAndLoad(SSTableReaderTest.java:166)
[junit] at 
org.apache.cassandra.io.sstable.SSTableReaderTest.assertIndexQueryWorks(SSTableReaderTest.java:293)
[junit] at 
org.apache.cassandra.io.sstable.SSTableReaderTest.testPersistentStatisticsFromOlderIndexedSSTable(SSTableReaderTest.java:244)
[junit] Caused by: java.io.IOException: rename failed of 
build/test/cassandra/data/Keyspace1/Indexed1/Keyspace1-Indexed1.626972746864617465-ib-4-Data.db
[junit] at 
org.apache.cassandra.utils.FBUtilities.renameWithConfirm(FBUtilities.java:235)
[junit] at 
org.apache.cassandra.io.sstable.SSTableWriter.rename(SSTableWriter.java:355)
[junit] 
[junit] 
[junit] Test org.apache.cassandra.io.sstable.SSTableReaderTest FAILED
[junit] Testsuite: org.apache.cassandra.io.sstable.SSTableSimpleWriterTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.478 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.SSTableTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 5.587 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.util.BufferedRandomAccessFileTest
[junit] Tests run: 18, Failures: 0, Errors: 0, Time elapsed: 0.771 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.loca

Build failed in Jenkins: Cassandra #1273

2012-04-24 Thread Apache Jenkins Server 
See 

Changes:

[xedin] Add way to force the cassandra-cli to refresh it's schema

[xedin] fix for situation when assumtions are read for CF that does not exist 
(CASSANDRA-4052)

[jbellis] fix type in CQL3 ALTER TABLE

[jbellis] Remove other obsolete NEW entry

[jbellis] Throw invalid exception in CQL3 on obsolete options

[jbellis] Update versions and licence in preparation for 1.1.0 release

[jbellis] add concurrent schema, cql3, and CFRR wide rows to NEWS.  clarify 
that KeyRange.filter allows Hadoop to take advantage of C* indexes

[jbellis] fix CHANGES

[jbellis] elaborate on why cache changes matter from end-user perspective

[jbellis] move cql changes to own section of changelog

[jbellis] Pig wide row support.

[jbellis] Update NEWS for 3909

[jbellis] avoid generating redundant compaction tasks during streaming

[jbellis] add JdbcDecimalTest

[brandonwilliams] Remove obsolete line from the NEWS file

[brandonwilliams] Remove other obsolete NEW entry

[brandonwilliams] add concurrent schema, cql3, and CFRR wide rows to NEWS.  
clarify that KeyRange.filter allows Hadoop to take advantage of C* indexes

[brandonwilliams] Fix wide row counter deserialization.

--
[...truncated 1197 lines...]
[junit] Testsuite: 
org.apache.cassandra.io.compress.CompressedRandomAccessReaderTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.401 sec
[junit] 
[junit] - Standard Error -
[junit]  WARN 19:35:33,426 open(null, O_RDONLY) failed, errno (14).
[junit] -  ---
[junit] Testsuite: org.apache.cassandra.io.sstable.DescriptorTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.061 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.IndexHelperTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.065 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.LegacySSTableTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 13.76 sec
[junit] 
[junit] Testsuite: 
org.apache.cassandra.io.sstable.SSTableMetadataSerializerTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.136 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.SSTableReaderTest
[junit] Tests run: 7, Failures: 0, Errors: 1, Time elapsed: 16.538 sec
[junit] 
[junit] Testcase: 
testPersistentStatisticsFromOlderIndexedSSTable(org.apache.cassandra.io.sstable.SSTableReaderTest):
   Caused an ERROR
[junit] java.io.IOException: rename failed of 
build/test/cassandra/data/Keyspace1/Indexed1/Keyspace1-Indexed1.626972746864617465-ib-4-Data.db
[junit] java.io.IOError: java.io.IOException: rename failed of 
build/test/cassandra/data/Keyspace1/Indexed1/Keyspace1-Indexed1.626972746864617465-ib-4-Data.db
[junit] at 
org.apache.cassandra.io.sstable.SSTableWriter.rename(SSTableWriter.java:359)
[junit] at 
org.apache.cassandra.db.ColumnFamilyStore.loadNewSSTables(ColumnFamilyStore.java:476)
[junit] at 
org.apache.cassandra.io.sstable.SSTableReaderTest.clearAndLoad(SSTableReaderTest.java:166)
[junit] at 
org.apache.cassandra.io.sstable.SSTableReaderTest.assertIndexQueryWorks(SSTableReaderTest.java:293)
[junit] at 
org.apache.cassandra.io.sstable.SSTableReaderTest.testPersistentStatisticsFromOlderIndexedSSTable(SSTableReaderTest.java:244)
[junit] Caused by: java.io.IOException: rename failed of 
build/test/cassandra/data/Keyspace1/Indexed1/Keyspace1-Indexed1.626972746864617465-ib-4-Data.db
[junit] at 
org.apache.cassandra.utils.FBUtilities.renameWithConfirm(FBUtilities.java:235)
[junit] at 
org.apache.cassandra.io.sstable.SSTableWriter.rename(SSTableWriter.java:355)
[junit] 
[junit] 
[junit] Test org.apache.cassandra.io.sstable.SSTableReaderTest FAILED
[junit] Testsuite: org.apache.cassandra.io.sstable.SSTableSimpleWriterTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 12.586 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.SSTableTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 12.588 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.util.BufferedRandomAccessFileTest
[junit] Tests run: 18, Failures: 0, Errors: 0, Time elapsed: 2.274 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.locator.DynamicEndpointSnitchTest
[junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 1.321 sec
[junit] 
[junit] Testcase: 
testSnitch(org.apache.cassandra.locator.DynamicEndpointSnitchTest):   FAILED
[junit] null
[junit] junit.framework.AssertionFailedError
[junit] at 
org.apache.cassandra.locator.DynamicEndpointSnitchTest.testSnitch(DynamicEndpointSnitchTest.java:61)
[junit] 
[junit] 
[junit] Test org.apache.cassandra.locator.Dy

RE: 6 months a more realistic release cycle?

2012-04-24 Thread Pierre Chalamet 
Hi,

Well, it would be interesting for us, mere users, to have something good out
of the box than something average or unstable.

Speaking of the release of 1.0, it was clearly an alpha release - it took
obviously quite some time to get issues fixed. 
It seems 1.1 is getting the same way, unfortunately.

I'm really worried about release quality and not about months between
releases. Getting the things out in time by any mean is a non-sense - it
would be better to postpone a release if quality is not met.

All in all, I do not care about 4,  6 or 9 months release cycle as soon as
the release is rock solid.

- Pierre


-Original Message-
From: Eric Evans [mailto:eev...@acunu.com] 
Sent: samedi 21 avril 2012 22:01
To: dev@cassandra.apache.org
Subject: Re: 6 months a more realistic release cycle?

On Sat, Apr 21, 2012 at 2:31 PM, Sylvain Lebresne 
wrote:
> On Sat, Apr 21, 2012 at 7:59 PM, Eric Evans  wrote:
>> I'm not opposed, but I'd rather see us try a longer release cycle 
>> before introducing too much rigor here.
>
> I had hoped that my suggestion above would not be felt as being 
> rigorous :(. At least that was not the intention.

Sorry, I don't have any problems with those dates per say, what I meant was
that with a longer release cycle, maybe we won't have to be any more strict
about the deadline(s).

> But to be clear, I don't want us to get too rigorous either. However, 
> and as much as I'm all for "let's all be smart", the project is 
> growing, we have more committers and we may get hopefully even more in 
> the future, and I think it's unrealistic to expect everyone to be on 
> the same page through some kind of magical mental communication.
> Basically I don't want to impose rigor, I want to add some form of 
> schedule (on which we can all agree on) so that the project does goes 
> into the direction we all want to. Basically I think it's more easy 
> (and more sane) to agree a priori at least on the big picture, than to 
> have to react when you're not happy with how this go. It's more open 
> too.

Yeah, that was sort of where I was going with the roadmap idea.  Set the
expectations up front so that people know what they're individually
obligated to do in order to land a feature, as opposed to just setting a
freeze date(s) (which seems to result in hurried 11th hour changes).

There are all sorts of problems with the idea of a roadmap.  For starters,
we'd have to agree on the roadmap. :)  6 months is also a plenty of time for
things to change, and make the roadmap irrelevant.
I was just throwing it out there as one possible idea for avoiding scope
creep.

> But anyway, all I really want is for us developer to have 2 dates in
> mind: "hum, I have to do that big issue before X if I want it in 
> version Y" and then "hum, I have to fix that small problem without 
> waiting to be 2 days before the release date because we need it in".
> And I think it's just easier if those dates are fixed in advance.
>
> We could get even more fancy and write feature roadmap and whatnot, 
> but that was not even part of my suggestion and I think it would be 
> harder to do.

Definitely harder, yes.

--
Eric Evans
Acunu | http://www.acunu.com | @acunu

Build failed in Jenkins: Cassandra-quick #202

2012-04-24 Thread Apache Jenkins Server 
See 

--
[...truncated 436 lines...]
[junit] Testsuite: org.apache.cassandra.dht.OrderPreservingPartitionerTest
[junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 1.402 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.dht.RandomPartitionerTest
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.957 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.dht.RangeTest
[junit] Tests run: 22, Failures: 0, Errors: 0, Time elapsed: 0.63 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.gms.ArrivalWindowTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.601 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.gms.GossipDigestTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.059 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.gms.SerializationsTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 14.044 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.hadoop.ColumnFamilyInputFormatTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.254 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.BloomFilterTrackerTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 14.957 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.CompactSerializerTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 17.816 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.LazilyCompactedRowTest
[junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 30.046 sec
[junit] 
[junit] Testsuite: 
org.apache.cassandra.io.compress.CompressedRandomAccessReaderTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.607 sec
[junit] 
[junit] - Standard Error -
[junit]  WARN 22:47:06,911 open(null, O_RDONLY) failed, errno (14).
[junit] -  ---
[junit] Testsuite: org.apache.cassandra.io.sstable.DescriptorTest
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.062 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.IndexHelperTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.065 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.LegacySSTableTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 15.555 sec
[junit] 
[junit] Testsuite: 
org.apache.cassandra.io.sstable.SSTableMetadataSerializerTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.136 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.SSTableReaderTest
[junit] Tests run: 7, Failures: 0, Errors: 1, Time elapsed: 20.642 sec
[junit] 
[junit] Testcase: 
testPersistentStatisticsFromOlderIndexedSSTable(org.apache.cassandra.io.sstable.SSTableReaderTest):
   Caused an ERROR
[junit] java.io.IOException: rename failed of 
build/test/cassandra/data/Keyspace1/Indexed1/Keyspace1-Indexed1.626972746864617465-ib-4-Data.db
[junit] java.io.IOError: java.io.IOException: rename failed of 
build/test/cassandra/data/Keyspace1/Indexed1/Keyspace1-Indexed1.626972746864617465-ib-4-Data.db
[junit] at 
org.apache.cassandra.io.sstable.SSTableWriter.rename(SSTableWriter.java:359)
[junit] at 
org.apache.cassandra.db.ColumnFamilyStore.loadNewSSTables(ColumnFamilyStore.java:476)
[junit] at 
org.apache.cassandra.io.sstable.SSTableReaderTest.clearAndLoad(SSTableReaderTest.java:166)
[junit] at 
org.apache.cassandra.io.sstable.SSTableReaderTest.assertIndexQueryWorks(SSTableReaderTest.java:293)
[junit] at 
org.apache.cassandra.io.sstable.SSTableReaderTest.testPersistentStatisticsFromOlderIndexedSSTable(SSTableReaderTest.java:244)
[junit] Caused by: java.io.IOException: rename failed of 
build/test/cassandra/data/Keyspace1/Indexed1/Keyspace1-Indexed1.626972746864617465-ib-4-Data.db
[junit] at 
org.apache.cassandra.utils.FBUtilities.renameWithConfirm(FBUtilities.java:235)
[junit] at 
org.apache.cassandra.io.sstable.SSTableWriter.rename(SSTableWriter.java:355)
[junit] 
[junit] 
[junit] Test org.apache.cassandra.io.sstable.SSTableReaderTest FAILED
[junit] Testsuite: org.apache.cassandra.io.sstable.SSTableSimpleWriterTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 16.304 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.sstable.SSTableTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 14.845 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.io.util.BufferedRandomAccessFileTest
[junit] Tests run: 18, Failures: 0, Errors: 0, Time elapsed: 3.326 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.locator.DynamicEndpointSnitchTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.

Re: Server Side Logic/Script - Triggers / StoreProc

2012-04-24 Thread aaron morton 
Out of interest some questions…

When writing through triggers how do you handle the CL guarantee ? Is the CL 
level checked once at the start or checked for each embedded code invocation ? 

Do you still guarantee the (non counter) writes as idempotent ?  i.e. do the 
triggers need to be deterministic ? Can clients retry operations that timed out 
?

Cheers

-
Aaron Morton
Freelance Developer
@aaronmorton
http://www.thelastpickle.com

On 23/04/2012, at 5:13 AM, Colin Clark wrote:

> In my opinion, triggers/stored procedures are an absolute requirement for any 
> distributed database.
> 
> We've been using stored procedures in Cassandra now for a while, we've made 
> modifications such that we don't really write directly anymore but pass 
> everything through either a default stored procedures (which is just what was 
> there before) or a dynamically loaded piece of java.
> 
> These stored procedures can call other dynamically loaded pieces of java as 
> well - we don't have any plans to implement any scripting capabilities.  We 
> can also 'select' from procedures.
> 
> The idea of downloading data from a distributed data base for processing 
> flies in the face of what nosql and bigdata is all about - you've got to do 
> it in the db.
> 
> On Apr 22, 2012, at 11:35 AM, Brian O'Neill wrote:
> 
>> Praveen,
>> 
>> We are certainly interested. To get things moving we implemented an add-on 
>> for Cassandra to demonstrate the viability (using AOP):
>> https://github.com/hmsonline/cassandra-triggers
>> 
>> Right now the implementation executes triggers asynchronously, allowing you 
>> to implement a java interface and plugin your own java class that will get 
>> called for every insert.
>> 
>> Per the discussion on 1311, we intend to extend our proof of concept to be 
>> able to invoke scripts as well.  (minimally we'll enable javascript, but 
>> we'll probably allow for ruby and groovy as well)
>> 
>> -brian
>> 
>> On Apr 22, 2012, at 12:23 PM, Praveen Baratam wrote:
>> 
>>> I found that Triggers are coming in Cassandra 1.2 
>>> (https://issues.apache.org/jira/browse/CASSANDRA-1311) but no mention of 
>>> any StoreProc like pattern.
>>> 
>>> I know this has been discussed so many times but never met with any 
>>> initiative. Even Groovy was staged out of the trunk.
>>> 
>>> Cassandra is great for logging and as such will be infinitely more useful 
>>> if some logic can be pushed into the Cassandra cluster nearer to the 
>>> location of Data to generate a materialized view useful for applications.
>>> 
>>> Server Side Scripts/Routines in Distributed Databases could soon prove to 
>>> be the differentiating factor.
>>> 
>>> Let me reiterate things with a use case.
>>> 
>>> In our application we store time series data in wide rows with TTL set on 
>>> each point to prevent data from growing beyond acceptable limits. Still the 
>>> data size can be a limiting factor to move all of it from the cluster node 
>>> to the querying node and then to the application via thrift for processing 
>>> and presentation.
>>> 
>>> Ideally we should process the data on the residing node and pass only the 
>>> materialized view of the data upstream. This should be trivial if Cassandra 
>>> implements some sort of server side scripting and CQL semantics to call it.
>>> 
>>> Is anybody else interested in a similar feature? Is it being worked on? Are 
>>> there any alternative strategies to this problem?
>>> 
>>> Praveen
>>> 
>>> 
>> 
>> -- 
>> Brian ONeill
>> Lead Architect, Health Market Science (http://healthmarketscience.com)
>> mobile:215.588.6024
>> blog: http://weblogs.java.net/blog/boneill42/
>> blog: http://brianoneill.blogspot.com/
>> 
>

Build failed in Jenkins: Cassandra-Coverage #199

2012-04-24 Thread Apache Jenkins Server 
See 

--
Started by an SCM change
Building remotely on ubuntu5 in workspace 

Checkout:Cassandra-Coverage / 
 - 
hudson.remoting.Channel@5e83a52:ubuntu5
Using strategy: Default
Checkout:Cassandra-Coverage / 
 - 
hudson.remoting.LocalChannel@63eed34e
Cloning the remote Git repository
Cloning repository origin
Fetching upstream changes from 
http://git-wip-us.apache.org/repos/asf/cassandra.git
Commencing build of Revision edf9e0e1695b89b085453ef1de9bef3a69e23b56 
(origin/trunk)
Checking out Revision edf9e0e1695b89b085453ef1de9bef3a69e23b56 (origin/trunk)
FATAL: Could not apply tag jenkins-Cassandra-Coverage-199
hudson.plugins.git.GitException: Could not apply tag 
jenkins-Cassandra-Coverage-199
at hudson.plugins.git.GitAPI.tag(GitAPI.java:730)
at hudson.plugins.git.GitSCM$4.invoke(GitSCM.java:1272)
at hudson.plugins.git.GitSCM$4.invoke(GitSCM.java:1220)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2154)
at hudson.remoting.UserRequest.perform(UserRequest.java:118)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:287)
at 
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
Caused by: hudson.plugins.git.GitException: Error performing command: git tag 
-a -f -m Jenkins Build #199 jenkins-Cassandra-Coverage-199
Command "git tag -a -f -m Jenkins Build #199 jenkins-Cassandra-Coverage-199" 
returned status code 128: 
*** Please tell me who you are.

Run

  git config --global user.email "y...@example.com"
  git config --global user.name "Your Name"

to set your account's default identity.
Omit --global to set the identity only in this repository.

fatal: empty ident   not allowed

at hudson.plugins.git.GitAPI.launchCommandIn(GitAPI.java:776)
at hudson.plugins.git.GitAPI.launchCommand(GitAPI.java:741)
at hudson.plugins.git.GitAPI.launchCommand(GitAPI.java:751)
at hudson.plugins.git.GitAPI.tag(GitAPI.java:728)
... 12 more
Caused by: hudson.plugins.git.GitException: Command "git tag -a -f -m Jenkins 
Build #199 jenkins-Cassandra-Coverage-199" returned status code 128: 
*** Please tell me who you are.

Run

  git config --global user.email "y...@example.com"
  git config --global user.name "Your Name"

to set your account's default identity.
Omit --global to set the identity only in this repository.

fatal: empty ident   not allowed

at hudson.plugins.git.GitAPI.launchCommandIn(GitAPI.java:771)
... 15 more