Re: [DISCUSS] Storage-class memory ecosystem program

2017-10-25 Thread Michael Stolz 
I'd like to participate in this as well.

--
Mike Stolz
Principal Engineer - Gemfire Product Manager
Mobile: 631-835-4771

On Oct 24, 2017 2:59 PM, "Swapnil Bawaskar"  wrote:

> Thanks Roman!
>
> I have volunteered to be on that group, if anyone else is interested,
> please chime in on that email thread.
>
> On Tue, Oct 24, 2017 at 10:57 PM Roman Shaposhnik 
> wrote:
>
> > FYI
> >
> >
> > -- Forwarded message --
> > From: Gang(Gary) Wang 
> > Date: Tue, Oct 24, 2017 at 10:10 AM
> > Subject: Re: [DISCUSS] Storage-class memory ecosystem program
> > To: gene...@incubator.apache.org
> > Cc: d...@mnemonic.incubator.apache.org
> >
> >
> > Add *Hive/LLAP and RocketMQ*
> >
> >- *Ignite* represented by Denis Magda
> >- *Arrow *represented by Wes McKinney
> >- *Hbase *represented by Anoop John
> >- *Crail* represented by *Patrick Stuedi*
> >- *Hive/LLAP *represented by *Gopal Vijayaraghavan*
> >- *RocketMQ  *represented by *Von Gosling*
> >- *ORC *represented by* Owen O'Malley*
> >- *Mnemonic *represented by* Gary*
> >
> > With above projects, we could cover Storage-class memory oriented
> > *Distributed
> > Database, KV Store, Columnar Structured Dataset, Distributed Data Store,
> > Columnar Storage, **Live Long And Process, Distributed Messaging and
> > Streaming, **Durable Object Model, Durable Computing Model* for new
> > generation high-performance applications, e.g. data querying, processing,
> > and analytics.
> >
> > On Mon, Oct 23, 2017 at 9:32 PM, Von Gosling 
> > wrote:
> >
> > > I'm happy to represent Apache RocketMQ on this  storage collaboration
> > > effort. This is a very key in low latency messaging.
> > >
> > > Best Regards,
> > > Von Gosling
> > >
> > >
> > >
> > > > 在 2017年10月20日，02:55，Gang(Gary) Wang  写道：
> > > >
> > > > Hi all,
> > > >
> > > > We can expect more and more projects will take the huge potential
> > > > advantages of storage-class memory for data processing and analytics
> > > > because silicon companies are able to produce high capacity
> > non-volatile
> > > > memory on a large scale, this hardware technology will fundamentally
> > > change
> > > > the way to construct high performance applications similar to what
> > > happened
> > > > when replacing tape with disk technology since the 1980s. so if
> > > possible, I
> > > > advocate establishing an Apache working group to enhance the
> > > collaboration
> > > > and synergies mentioned by Patrick Stuedi for storage-class memory
> > > > technology-oriented projects.
> > > >
> > > > Best.
> > > > Gary.
> > >
> > >
> >
>

Build failed in Jenkins: Geode-nightly #995

2017-10-25 Thread Apache Jenkins Server 
See 


Changes:

[github] GEODE-1897: Initial refactor of CreateRegionCommand (#956)

[github] GEODE-3801: Use hardlinks for backup oplog files (#963)

[github] GEODE-3815: Changed to remove the conflation index only if its for the

[kohlmu-pivotal] GEODE-3705: Refactor code to process authentication message as 
per

[github] Feature/geode 3897 (#968)

[jdeppe] GEODE-3880: Fix typo in Javadoc (#960)

[kohlmu-pivotal] GEODE-3705: Reverting changes made to AcceptorImpl.java

--
[...truncated 197.26 KB...]
:geode-old-versions:distributedTest NO-SOURCE
:geode-old-versions:integrationTest NO-SOURCE
:geode-protobuf:assemble
:geode-protobuf:extractIncludeTestProto
Download 
https://repo1.maven.org/maven2/org/powermock/powermock-api-mockito/1.7.1/powermock-api-mockito-1.7.1.pom
Download 
https://repo1.maven.org/maven2/org/powermock/powermock-api-mockito/1.7.1/powermock-api-mockito-1.7.1.jar
:geode-protobuf:extractTestProto
:geode-protobuf:generateTestProto NO-SOURCE
:geode-protobuf:compileTestJavaNote: Some input files use or override a 
deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

:geode-protobuf:processTestResources
:geode-protobuf:testClasses
:geode-protobuf:checkMissedTests
:geode-protobuf:spotlessJavaCheck
:geode-protobuf:spotlessCheck
:geode-protobuf:test
:geode-protobuf:check
:geode-protobuf:build
:geode-protobuf:distributedTest
:geode-protobuf:integrationTest
:geode-pulse:assemble
:geode-pulse:compileTestJava
Download 
https://repo1.maven.org/maven2/com/codeborne/phantomjsdriver/1.3.0/phantomjsdriver-1.3.0.pom
Download 
https://repo1.maven.org/maven2/com/codeborne/phantomjsdriver/1.3.0/phantomjsdriver-1.3.0.jar
Download 
https://repo1.maven.org/maven2/org/seleniumhq/selenium/selenium-api/3.0.1/selenium-api-3.0.1.jar
Download 
https://repo1.maven.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/3.0.1/selenium-remote-driver-3.0.1.jar
Download 
https://repo1.maven.org/maven2/org/seleniumhq/selenium/selenium-support/3.0.1/selenium-support-3.0.1.jar
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: 

 uses unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
:geode-pulse:processTestResources
:geode-pulse:testClasses
:geode-pulse:checkMissedTests
:geode-pulse:spotlessJavaCheck
:geode-pulse:spotlessCheck
:geode-pulse:test
:geode-pulse:check
:geode-pulse:build
:geode-pulse:distributedTest
:geode-pulse:integrationTest
:geode-rebalancer:assemble
:geode-rebalancer:compileTestJava
:geode-rebalancer:processTestResources NO-SOURCE
:geode-rebalancer:testClasses
:geode-rebalancer:checkMissedTests
:geode-rebalancer:spotlessJavaCheck
:geode-rebalancer:spotlessCheck
:geode-rebalancer:test
:geode-rebalancer:check
:geode-rebalancer:build
:geode-rebalancer:distributedTest
:geode-rebalancer:integrationTest
:geode-wan:assemble
:geode-wan:compileTestJavaNote: Some input files use or override a deprecated 
API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

:geode-wan:processTestResources
:geode-wan:testClasses
:geode-wan:checkMissedTests
:geode-wan:spotlessJavaCheck
:geode-wan:spotlessCheck
:geode-wan:test
:geode-wan:check
:geode-wan:build
:geode-wan:distributedTest

org.apache.geode.internal.cache.wan.misc.NewWanAuthenticationDUnitTest > 
testWanAuthValidCredentials FAILED
org.apache.geode.test.dunit.RMIException: While invoking 
org.apache.geode.internal.cache.wan.misc.NewWanAuthenticationDUnitTest$$Lambda$73/735044920.run
 in VM 2 running on Host 7c4d06bbbc13 with 8 VMs
at org.apache.geode.test.dunit.VM.invoke(VM.java:393)
at org.apache.geode.test.dunit.VM.invoke(VM.java:363)
at org.apache.geode.test.dunit.VM.invoke(VM.java:308)
at 
org.apache.geode.internal.cache.wan.misc.NewWanAuthenticationDUnitTest.testWanAuthValidCredentials(NewWanAuthenticationDUnitTest.java:113)

Caused by:
org.apache.geode.internal.cache.wan.GatewaySenderException: Could not 
start a gateway sender ln because of exception 
org.apache.geode.security.AuthenticationFailedException: DummyAuthenticator: 
Invalid user name [invalid1], password supplied., caused by 
org.apache.geode.security.AuthenticationFailedException: DummyAuthenticator: 
Invalid user name [invalid1], password supplied.
at 
org.apache.geode.internal.cache.wan.AbstractGatewaySender.waitForRunningStatus(AbstractGatewaySender.java:752)
at 
org.apache.geode.internal.cache.wan.serial.SerialGatewaySenderImpl.sta

Jenkins build is back to normal : Geode-nightly-flaky #159

2017-10-25 Thread Apache Jenkins Server 
See

Re: what is the command to read cacheserver.gfs file??

2017-10-25 Thread Barry Oglesby 
I wrote a script to dump some interesting stats using SystemAdmin posted
here:

https://drive.google.com/open?id=0ByTR2ZH0oYBpVDUwemtuRXI3TFk

It dumps output like:

./dumpstats.sh cacheserver.gfs
Maximum Memory (GB): 74.517
Average Free Memory (GB): 43.015
Average Used Memory (GB): 31.501
Average Open File Descriptors: 285.17
Maximum Open File Descriptors: 328
Maximum GC Time (ms): 6.419
Load Average (15): 0.18
Maximum CPU (%): 2.54
Reply Timeouts: 1
Mimumum Nodes: 24
Maximum Nodes: 24
Average Current Clients: 20.96
Average Current Client Connections: 21.05
Maximum Client Thread Queue Size: 0
Average Client Thread Queue Size: 0
Maximum Client Accepts In Progress: 3
Average Client Accepts In Progress: 0.06
Client Failed Connection Attempts: 0
Partitioned Region Statistics:
/MyDataRegion
name=/MyDataRegion
bucketCount max=14
putsCompleted max=0
putTime max=0
primaryBucketCount max=7
...


Thanks,
Barry Oglesby


On Tue, Oct 24, 2017 at 9:52 AM, Jens Deppe  wrote:

> Hi Dinesh,
>
> Yes, that's pretty much it. That command will give you a list of all the
> possible stats. If you want an individual stat you can retrieve it like
> this:
>
> java -cp $GEODE_HOME/lib/geode-dependencies.jar
> org.apache.geode.internal.SystemAdmin stats vmStats:VMStats.processCpuTime
> -archive=server1/server1.gfs
>
> Note the 'stat spec' I'm using here - vmStats:VMStats.processCpuTime. You
> can get more details on how to refine the output by using the '-help'
> option.
>
> --Jens
>
> On Tue, Oct 24, 2017 at 6:02 AM, Dinesh Akhand 
> wrote:
>
> > Hi team,
> >
> > I tried below command
> >
> > java -cp "geode-dependencies.jar:$GEODE_HOME/lib/*"
> > org.apache.geode.internal.SystemAdmin stats-archive=cacheserver.gfs
> >
> > Is this correct command to read cacheserver.gfs file.
> >
> >
> > Please confirm.
> >
> > Thanks,
> > Dinesh Akhand
> > This message and the information contained herein is proprietary and
> > confidential and subject to the Amdocs policy statement,
> >
> > you may review at https://www.amdocs.com/about/email-disclaimer <
> > https://www.amdocs.com/about/email-disclaimer>
> >
>

Re: [VOTE] Apache Geode release - 1.3.0 RC3

2017-10-25 Thread Anthony Baker 
The following files are missing signatures:

apache-geode-1.3.0-src.tgz
apache-geode-1.3.0-src.zip
apache-geode-1.3.0.tgz
apache-geode-1.3.0.zip

-1 until this is fixed.

Anthony

> On Oct 24, 2017, at 10:16 AM, Swapnil Bawaskar  wrote:
> 
> I noticed that my svn commit had failed. The geode distribution should be
> available now.
> 
> On Tue, Oct 24, 2017 at 7:32 PM Anthony Baker  wrote:
> 
>> The dist location only has the examples.  Where are the geode
>> distributions?
>> 
>> Anthony
>> 
>>> On Oct 20, 2017, at 2:11 PM, Swapnil Bawaskar 
>> wrote:
>>> 
>>> The commit sha in the vote request should be:
>> 59f2a73d108101744ed7b2d88e8d1c
>>> 948d19781c
>>> Sorry I forgot to update it for the latest release candidate.
>>> 
>>> Also, I ended up dropping and then re-adding all distributions
>>> https://dist.apache.org/repos/dist/dev/geode/1.3.0.RC3
>>> Can you please give this another try?
>>> 
>>> Thanks!
>>> 
>>> On Fri, Oct 20, 2017 at 9:30 PM Anthony Baker  wrote:
>>> 
 I’m confused about which source tag we are voting on.
 
 ~/code/incubator-geode ((rel/v1.3.0.RC3))$ git tag -v rel/v1.3.0.RC3
 object 59f2a73d108101744ed7b2d88e8d1c948d19781c
 type commit
 tag rel/v1.3.0.RC3
 tagger Swapnil Bawaskar  1508355792 +0530
 
 Release candidate 3 for 1.3.0
 gpg: Signature made Wed Oct 18 12:43:21 2017 PDT
 gpg:using RSA key 8F8F2BCC18F902DB
 gpg: Good signature from "Swapnil Bawaskar "
>> [full]
 
 This is different than the commit sha in the vote request.  Also, the
 source and binary distributions appear to have been generated from
 different sha’s?
 
 ~/working$ ./apache-geode-1.3.0/bin/gfsh version --full | grep Revision
 Source-Revision: 9e076738fc2ae40f95bd179b5c1624e664a28d61
 
 ~/working$
 
>> ./apache-geode-1.3.0-src/geode-assembly/build/install/apache-geode/bin/gfsh
 version --full | grep Revision
 Source-Revision: 59f2a73d108101744ed7b2d88e8d1c948d19781c
 
 Voting -1 based on this discrepancy.
 
 
 Other notes:
 - builds from source
 - binary distribution works
 - geode-examples builds from source
 - no binaries in source distribution
 - we should update the geode-examples distribution filename to ‘tgz’ to
 match the geode distribution in the next release
 
 Anthony
 
> On Oct 18, 2017, at 1:51 PM, Swapnil Bawaskar 
 wrote:
> 
> This is the third release candidate for Apache Geode, version 1.3.0.
> Thanks to all the community members for their contributions to this
> release!
> 
> *** Please download, test and vote by Monday, October 23, 0800 hrs
> US Pacific. ***
> 
> It fixes 376 issues. release notes can be found at:
> 
 
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12318420&version=12340669
> 
> Note that we are voting upon the source tags:  rel/v1.3.0.RC3
> https://github.com/apache/geode/tree/rel/v1.3.0.RC3
> https://github.com/apache/geode-examples/tree/rel/v1.3.0.RC3
> 
> Commit ID:
> 9e076738fc2ae40f95bd179b5c1624e664a28d61 (geode)
> 4ff8f8eafd0927888e711ee45d283ab07d345000   (geode-examples)
> 
> Source and binary files:
> https://dist.apache.org/repos/dist/dev/geode/1.3.0.RC3
> 
> Maven staging repo:
> https://repository.apache.org/content/repositories/orgapachegeode-1034
> 
> 
> Geode's KEYS file containing PGP keys we use to sign the release:
> https://github.com/apache/geode/blob/develop/KEYS
> 
> Release Signed with Key: pub 4096R/18F902DB 2016-04-07
> Fingerprint: E1B1 ABE3 4753 E7BA 8097 4285 8F8F 2BCC 18F9 02DB
 
 
>> 
>>

Conjode - Clojure client for Apache Geode

2017-10-25 Thread Srikanth Manvi 
Hello Geode Community,

I would like to introduce you to conjode
 - A Clojure Library for Apache
Geode.

As most of you would know, Clojure  is predominantly
a functional programming language, and features a rich set of immutable,
persistent data structures and runs on the JVM.



Conjode  Features :

*-* A minimalist Clojure client for Apache Geode 

- conjode should be used on the client side of the Geode distributed system.

- Since clojure has a REPL
,
conjode can be used for exploratory analysis of data in Apache Geode.

- Broadly speaking conjode supports


- Region operations

- Creating/Deleting client regions.
- Data insertion/removal. Supports clojure data types and Java objects.


- Querying

- Execute query with/without params.

- Function execution

- Execute Apache Geode functions.




Will be adding more features as time goes by.
Feedback and comments are welcome, conjode might be rough around the edges
(as of now) as I am the only one using it.

README is available here -
https://github.com/srikanthmanvi/conjode/blob/master/README.md

Thanks,
Srikanth Manvi

[Spring CI] Spring Data GemFire > Nightly-ApacheGeode > #720 was SUCCESSFUL (with 2187 tests)

2017-10-25 Thread Spring CI 

---
Spring Data GemFire > Nightly-ApacheGeode > #720 was successful.
---
Scheduled
2189 tests in total.

https://build.spring.io/browse/SGF-NAG-720/





--
This message is automatically generated by Atlassian Bamboo

Re: [VOTE] Apache Geode release - 1.3.0 RC3

2017-10-25 Thread Dan Smith 
Looks like this RC is still a no go due to the missing signatures Anthony
pointed out. Swap, when you fix that can you create a new release candidate
or at least send out a new VOTE email? It's a bit confusing what the state
of this VOTE is and what the deadline is.

-Dan

On Wed, Oct 25, 2017 at 1:57 PM, Anthony Baker  wrote:

> The following files are missing signatures:
>
> apache-geode-1.3.0-src.tgz
> apache-geode-1.3.0-src.zip
> apache-geode-1.3.0.tgz
> apache-geode-1.3.0.zip
>
> -1 until this is fixed.
>
> Anthony
>
> > On Oct 24, 2017, at 10:16 AM, Swapnil Bawaskar 
> wrote:
> >
> > I noticed that my svn commit had failed. The geode distribution should be
> > available now.
> >
> > On Tue, Oct 24, 2017 at 7:32 PM Anthony Baker  wrote:
> >
> >> The dist location only has the examples.  Where are the geode
> >> distributions?
> >>
> >> Anthony
> >>
> >>> On Oct 20, 2017, at 2:11 PM, Swapnil Bawaskar 
> >> wrote:
> >>>
> >>> The commit sha in the vote request should be:
> >> 59f2a73d108101744ed7b2d88e8d1c
> >>> 948d19781c
> >>> Sorry I forgot to update it for the latest release candidate.
> >>>
> >>> Also, I ended up dropping and then re-adding all distributions
> >>> https://dist.apache.org/repos/dist/dev/geode/1.3.0.RC3
> >>> Can you please give this another try?
> >>>
> >>> Thanks!
> >>>
> >>> On Fri, Oct 20, 2017 at 9:30 PM Anthony Baker 
> wrote:
> >>>
>  I’m confused about which source tag we are voting on.
> 
>  ~/code/incubator-geode ((rel/v1.3.0.RC3))$ git tag -v rel/v1.3.0.RC3
>  object 59f2a73d108101744ed7b2d88e8d1c948d19781c
>  type commit
>  tag rel/v1.3.0.RC3
>  tagger Swapnil Bawaskar  1508355792 +0530
> 
>  Release candidate 3 for 1.3.0
>  gpg: Signature made Wed Oct 18 12:43:21 2017 PDT
>  gpg:using RSA key 8F8F2BCC18F902DB
>  gpg: Good signature from "Swapnil Bawaskar "
> >> [full]
> 
>  This is different than the commit sha in the vote request.  Also, the
>  source and binary distributions appear to have been generated from
>  different sha’s?
> 
>  ~/working$ ./apache-geode-1.3.0/bin/gfsh version --full | grep
> Revision
>  Source-Revision: 9e076738fc2ae40f95bd179b5c1624e664a28d61
> 
>  ~/working$
> 
> >> ./apache-geode-1.3.0-src/geode-assembly/build/install/
> apache-geode/bin/gfsh
>  version --full | grep Revision
>  Source-Revision: 59f2a73d108101744ed7b2d88e8d1c948d19781c
> 
>  Voting -1 based on this discrepancy.
> 
> 
>  Other notes:
>  - builds from source
>  - binary distribution works
>  - geode-examples builds from source
>  - no binaries in source distribution
>  - we should update the geode-examples distribution filename to ‘tgz’
> to
>  match the geode distribution in the next release
> 
>  Anthony
> 
> > On Oct 18, 2017, at 1:51 PM, Swapnil Bawaskar 
>  wrote:
> >
> > This is the third release candidate for Apache Geode, version 1.3.0.
> > Thanks to all the community members for their contributions to this
> > release!
> >
> > *** Please download, test and vote by Monday, October 23, 0800 hrs
> > US Pacific. ***
> >
> > It fixes 376 issues. release notes can be found at:
> >
> 
> >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?
> projectId=12318420&version=12340669
> >
> > Note that we are voting upon the source tags:  rel/v1.3.0.RC3
> > https://github.com/apache/geode/tree/rel/v1.3.0.RC3
> > https://github.com/apache/geode-examples/tree/rel/v1.3.0.RC3
> >
> > Commit ID:
> > 9e076738fc2ae40f95bd179b5c1624e664a28d61 (geode)
> > 4ff8f8eafd0927888e711ee45d283ab07d345000   (geode-examples)
> >
> > Source and binary files:
> > https://dist.apache.org/repos/dist/dev/geode/1.3.0.RC3
> >
> > Maven staging repo:
> > https://repository.apache.org/content/repositories/
> orgapachegeode-1034
> >
> >
> > Geode's KEYS file containing PGP keys we use to sign the release:
> > https://github.com/apache/geode/blob/develop/KEYS
> >
> > Release Signed with Key: pub 4096R/18F902DB 2016-04-07
> > Fingerprint: E1B1 ABE3 4753 E7BA 8097 4285 8F8F 2BCC 18F9 02DB
> 
> 
> >>
> >>
>
>