Re: Unit tests are hanging?

[Kirk Lund]

Thanks Owen!

On Sat, Aug 10, 2019 at 1:53 PM Owen Nichols  wrote:

> Done (increased from 10 minutes to 20 minutes for PR pipeline, and changed
> from none to 20 minutes for develop pipeline).
>
> -Owen
>
> > On Aug 10, 2019, at 11:01 AM, Kirk Lund  wrote:
> >
> > I just saw the Build job exceed timeout during pmdMain so I think we need
> > to increase its timeout as well.
> > https://concourse.apachegeode-ci.info/builds/85560
> >
> >
> > On Thu, Aug 8, 2019 at 3:53 PM Ryan McMahon 
> wrote:
> >
> >> I have a PR up for this now.
> >> https://github.com/apache/geode/pull/3900
> >>
> >> It bumps the timeout to 20 minutes but also changes the
> CALL_STACK_TIMEOUT
> >> to be 1140 seconds (19 minutes).  The latter configuration parameter
> >> controls when we declare the task "hung" and dump stacks.  We were not
> >> dumping stacks at all before these changes because the value was 1800
> >> seconds which is well above the timeout of 10 minutes.  With my proposed
> >> change we will dump stacks before the task times out so we will have
> >> something to look at in the test artifacts to identify the hang.
> >>
> >> Thanks,
> >> Ryan
> >>
> >> On Thu, Aug 8, 2019 at 11:28 AM Ryan McMahon 
> wrote:
> >>
> >>> Looks like we have a general consensus from the community.  I'll go
> ahead
> >>> and make a PR for the changes.
> >>>
> >>> Thanks,
> >>> Ryan
> >>>
> >>> On Thu, Aug 8, 2019 at 11:03 AM Juan José Ramos 
> >> wrote:
> >>>
>  +1
> 
>  On Thu, Aug 8, 2019 at 6:55 PM Kirk Lund  wrote:
> 
> > +1
> >
> > On Thu, Aug 8, 2019 at 10:14 AM Dan Smith  wrote:
> >
> >>> With all that, I propose we permanently bump the timeouts on
>  UnitTestX
> >> jobs
> >>> across the board (main pipeline, PR pipeline, etc) from 10 to 20
> > minutes
> >> to
> >>> be more tolerant of these types of degradations.
> >>>
> >>
> >> +1
> >>
> >> -Dan
> >>
> >
> 
> 
>  --
>  Juan José Ramos Cassella
>  Senior Technical Support Engineer
>  Email: jra...@pivotal.io
>  Office#: +353 21 4238611
>  Mobile#: +353 87 2074066
>  After Hours Contact#: +1 877 477 2269
>  Office Hours: Mon - Thu 08:30 - 17:00 GMT. Fri 08:30 - 16:00 GMT
>  How to upload artifacts:
>  https://support.pivotal.io/hc/en-us/articles/204369073
>  How to escalate a ticket:
>  https://support.pivotal.io/hc/en-us/articles/203809556
> 
>  [image: support]  [image: twitter]
>   [image: linkedin]
>   [image: facebook]
>   [image: google plus]
>   [image: youtube]
>  <
> >>
> https://www.youtube.com/playlist?list=PLAdzTan_eSPScpj2J50ErtzR9ANSzv3kl
> >
> 
> >>>
> >>
>
>

many tests are misusing DistributedTestUtils.deleteLocatorStateFile()

[Bruce Schuchardt]

*tl;dr**: invoke this method in the VM in which you're going to create 
your locator*


Rolling upgrade tests that want to ensure that old locator state files 
have been deleted are using this method incorrectly.


It's very common to see a rolling upgrade test delete old locator state 
files during setup.  You'll see something like this:


    int locatorPort = AvailablePort.getRandomAvailablePort();

    DistributedTestUtils.deleteLocatorStateFile(locatorPort);

This keeps old files created by previously run tests from infecting this 
test.  However, this use of the method doesn't work.


The problem is that DUnitLauncher runs each VM in its own directory.  
Deleting a file in the current working directory of the VM driving the 
test won't find a file in your locator's working directory.  You've got 
to delete that file in the context of the process you're going to use to 
host the locator.


    VM locatorVM = Host.getHost(0).getVM(oldVersion, 0);

    int port = AvailablePortHelper.getRandomAvailablePort();

*  locatorVM.invoke("delete state file", () -> 
*DistributedTestUtils.deleteLocatorStateFile(locatorPort)*);*

trying to figure out why my PR is only running LGTM checks

[Bruce Schuchardt]

https://github.com/apache/geode/pull/3908

Draft of Apache Geode Quarterly Report (Aug 2019) for your review

[Dave Barnes]

Please review by Noon PDT, Tuesday, Aug 13. Thanks!

## Description:

The mission of Apache Geode is the creation and maintenance of software
related
to a data management platform that provides real-time, consistent access to
data-intensive applications throughout widely distributed cloud
architectures.

## Issues: There are no issues requiring board attention at this time. ##
Membership Data: Apache Geode was founded 2016-11-15 (3 years ago) There
are currently 102 committers and 50 PMC members in this project. The
Committer-to-PMC ratio is roughly 7:4. Community changes, past quarter: -
No new PMC members. Last additions were Juan Ramos and Robert Houghton on
2019-02-20 - Dale Emery was added as committer on 2019-06-19 - Mark Hanson
was added as committer on 2019-06-19 ## Project Activity: Release 1.10 is
in progress. An Apache Geode Summit is scheduled the day before the
SpringOne Platform 2019 conference, on 7 October 2019, in Austin, TX.
Several Geode contributors will present talks and in traffic in the past
quarter (505 emails compared to 443) JIRA tickets show that issues continue
to be identified and resolved. - 289 issues opened in JIRA in the past
quarter - 296 issues closed in JIRA in the past quarter - 454 commits in
the past quarter The community is actively contributing to the Apache Geode
code base: - 62 code contributors in the past quarter - 344 PRs opened on
GitHub in the past quarter - 356 PRs closed on GitHub in the past quarter

Re: Draft of Apache Geode Quarterly Report (Aug 2019) for your review

[Dave Barnes]

Reformatted for more amenable viewing:

## Description:

The mission of Apache Geode is the creation and maintenance of software
related

to a data management platform that provides real-time, consistent access to

data-intensive applications throughout widely distributed cloud
architectures.


## Issues:

There are no issues requiring board attention at this time.


## Membership Data:

Apache Geode was founded 2016-11-15 (3 years ago) There are currently 102

committers and 50 PMC members in this project. The Committer-to-PMC ratio is

roughly 7:4.


Community changes, past quarter:

- No new PMC members. Last additions were Juan Ramos and Robert Houghton on

  2019-02-20

- Dale Emery was added as committer on 2019-06-19

- Mark Hanson was added as committer on 2019-06-19


## Project Activity:

Release 1.10 is in progress.


An Apache Geode Summit is scheduled the day before the SpringOne Platform
2019

conference, on 7 October 2019, in Austin, TX. Several Geode contributors
will

present talks and sessions aimed at a variety of levels.


## Community Health:

Mailing lists remain active and productive.

  - dev@geode.apache.org had a 13% increase in traffic in the past quarter

  (505 emails compared to 443)


JIRA tickets show that issues continue to be identified and resolved.

  - 289 issues opened in JIRA in the past quarter

  - 296 issues closed in   JIRA in the past quarter

  - 454 commits in the past quarter


The community is actively contributing to the Apache Geode code base:

  - 62 code contributors in the past quarter

  - 344 PRs opened on GitHub in the past quarter

  - 356 PRs closed on GitHub in the past quarter

On Mon, Aug 12, 2019 at 2:10 PM Dave Barnes  wrote:

> Please review by Noon PDT, Tuesday, Aug 13. Thanks!
>
> ## Description:
>
> The mission of Apache Geode is the creation and maintenance of software
> related
> to a data management platform that provides real-time, consistent access
> to
> data-intensive applications throughout widely distributed cloud
> architectures.
>
> ## Issues: There are no issues requiring board attention at this time. ##
> Membership Data: Apache Geode was founded 2016-11-15 (3 years ago) There
> are currently 102 committers and 50 PMC members in this project. The
> Committer-to-PMC ratio is roughly 7:4. Community changes, past quarter: -
> No new PMC members. Last additions were Juan Ramos and Robert Houghton on
> 2019-02-20 - Dale Emery was added as committer on 2019-06-19 - Mark Hanson
> was added as committer on 2019-06-19 ## Project Activity: Release 1.10 is
> in progress. An Apache Geode Summit is scheduled the day before the
> SpringOne Platform 2019 conference, on 7 October 2019, in Austin, TX.
> Several Geode contributors will present talks and in traffic in the past
> quarter (505 emails compared to 443) JIRA tickets show that issues continue
> to be identified and resolved. - 289 issues opened in JIRA in the past
> quarter - 296 issues closed in JIRA in the past quarter - 454 commits in
> the past quarter The community is actively contributing to the Apache
> Geode code base: - 62 code contributors in the past quarter - 344 PRs
> opened on GitHub in the past quarter - 356 PRs closed on GitHub in the past
> quarter
>

Re: Draft of Apache Geode Quarterly Report (Aug 2019) for your review

[Aaron Lindsey]

Kind of a small thing, but the Committer-to-PMC ratio seems more like 2:1 based 
on the numbers of committers and PMC members below.

- Aaron

> On Aug 12, 2019, at 2:22 PM, Dave Barnes  wrote:
> 
> Reformatted for more amenable viewing:
> 
> ## Description:
> 
> The mission of Apache Geode is the creation and maintenance of software
> related
> 
> to a data management platform that provides real-time, consistent access to
> 
> data-intensive applications throughout widely distributed cloud
> architectures.
> 
> 
> ## Issues:
> 
> There are no issues requiring board attention at this time.
> 
> 
> ## Membership Data:
> 
> Apache Geode was founded 2016-11-15 (3 years ago) There are currently 102
> 
> committers and 50 PMC members in this project. The Committer-to-PMC ratio is
> 
> roughly 7:4.
> 
> 
> Community changes, past quarter:
> 
> - No new PMC members. Last additions were Juan Ramos and Robert Houghton on
> 
>  2019-02-20
> 
> - Dale Emery was added as committer on 2019-06-19
> 
> - Mark Hanson was added as committer on 2019-06-19
> 
> 
> ## Project Activity:
> 
> Release 1.10 is in progress.
> 
> 
> An Apache Geode Summit is scheduled the day before the SpringOne Platform
> 2019
> 
> conference, on 7 October 2019, in Austin, TX. Several Geode contributors
> will
> 
> present talks and sessions aimed at a variety of levels.
> 
> 
> ## Community Health:
> 
> Mailing lists remain active and productive.
> 
>  - dev@geode.apache.org had a 13% increase in traffic in the past quarter
> 
>  (505 emails compared to 443)
> 
> 
> JIRA tickets show that issues continue to be identified and resolved.
> 
>  - 289 issues opened in JIRA in the past quarter
> 
>  - 296 issues closed in   JIRA in the past quarter
> 
>  - 454 commits in the past quarter
> 
> 
> The community is actively contributing to the Apache Geode code base:
> 
>  - 62 code contributors in the past quarter
> 
>  - 344 PRs opened on GitHub in the past quarter
> 
>  - 356 PRs closed on GitHub in the past quarter
> 
> On Mon, Aug 12, 2019 at 2:10 PM Dave Barnes  wrote:
> 
>> Please review by Noon PDT, Tuesday, Aug 13. Thanks!
>> 
>> ## Description:
>> 
>> The mission of Apache Geode is the creation and maintenance of software
>> related
>> to a data management platform that provides real-time, consistent access
>> to
>> data-intensive applications throughout widely distributed cloud
>> architectures.
>> 
>> ## Issues: There are no issues requiring board attention at this time. ##
>> Membership Data: Apache Geode was founded 2016-11-15 (3 years ago) There
>> are currently 102 committers and 50 PMC members in this project. The
>> Committer-to-PMC ratio is roughly 7:4. Community changes, past quarter: -
>> No new PMC members. Last additions were Juan Ramos and Robert Houghton on
>> 2019-02-20 - Dale Emery was added as committer on 2019-06-19 - Mark Hanson
>> was added as committer on 2019-06-19 ## Project Activity: Release 1.10 is
>> in progress. An Apache Geode Summit is scheduled the day before the
>> SpringOne Platform 2019 conference, on 7 October 2019, in Austin, TX.
>> Several Geode contributors will present talks and in traffic in the past
>> quarter (505 emails compared to 443) JIRA tickets show that issues continue
>> to be identified and resolved. - 289 issues opened in JIRA in the past
>> quarter - 296 issues closed in JIRA in the past quarter - 454 commits in
>> the past quarter The community is actively contributing to the Apache
>> Geode code base: - 62 code contributors in the past quarter - 344 PRs
>> opened on GitHub in the past quarter - 356 PRs closed on GitHub in the past
>> quarter
>> 

Re: Draft of Apache Geode Quarterly Report (Aug 2019) for your review

[Dave Barnes]

Thanks, Aaron - good catch.

On Mon, Aug 12, 2019 at 4:09 PM Aaron Lindsey  wrote:

> Kind of a small thing, but the Committer-to-PMC ratio seems more like 2:1
> based on the numbers of committers and PMC members below.
>
> - Aaron
>
> > On Aug 12, 2019, at 2:22 PM, Dave Barnes  wrote:
> >
> > Reformatted for more amenable viewing:
> >
> > ## Description:
> >
> > The mission of Apache Geode is the creation and maintenance of software
> > related
> >
> > to a data management platform that provides real-time, consistent access
> to
> >
> > data-intensive applications throughout widely distributed cloud
> > architectures.
> >
> >
> > ## Issues:
> >
> > There are no issues requiring board attention at this time.
> >
> >
> > ## Membership Data:
> >
> > Apache Geode was founded 2016-11-15 (3 years ago) There are currently 102
> >
> > committers and 50 PMC members in this project. The Committer-to-PMC
> ratio is
> >
> > roughly 7:4.
> >
> >
> > Community changes, past quarter:
> >
> > - No new PMC members. Last additions were Juan Ramos and Robert Houghton
> on
> >
> >  2019-02-20
> >
> > - Dale Emery was added as committer on 2019-06-19
> >
> > - Mark Hanson was added as committer on 2019-06-19
> >
> >
> > ## Project Activity:
> >
> > Release 1.10 is in progress.
> >
> >
> > An Apache Geode Summit is scheduled the day before the SpringOne Platform
> > 2019
> >
> > conference, on 7 October 2019, in Austin, TX. Several Geode contributors
> > will
> >
> > present talks and sessions aimed at a variety of levels.
> >
> >
> > ## Community Health:
> >
> > Mailing lists remain active and productive.
> >
> >  - dev@geode.apache.org had a 13% increase in traffic in the past
> quarter
> >
> >  (505 emails compared to 443)
> >
> >
> > JIRA tickets show that issues continue to be identified and resolved.
> >
> >  - 289 issues opened in JIRA in the past quarter
> >
> >  - 296 issues closed in   JIRA in the past quarter
> >
> >  - 454 commits in the past quarter
> >
> >
> > The community is actively contributing to the Apache Geode code base:
> >
> >  - 62 code contributors in the past quarter
> >
> >  - 344 PRs opened on GitHub in the past quarter
> >
> >  - 356 PRs closed on GitHub in the past quarter
> >
> > On Mon, Aug 12, 2019 at 2:10 PM Dave Barnes  wrote:
> >
> >> Please review by Noon PDT, Tuesday, Aug 13. Thanks!
> >>
> >> ## Description:
> >>
> >> The mission of Apache Geode is the creation and maintenance of software
> >> related
> >> to a data management platform that provides real-time, consistent access
> >> to
> >> data-intensive applications throughout widely distributed cloud
> >> architectures.
> >>
> >> ## Issues: There are no issues requiring board attention at this time.
> ##
> >> Membership Data: Apache Geode was founded 2016-11-15 (3 years ago) There
> >> are currently 102 committers and 50 PMC members in this project. The
> >> Committer-to-PMC ratio is roughly 7:4. Community changes, past quarter:
> -
> >> No new PMC members. Last additions were Juan Ramos and Robert Houghton
> on
> >> 2019-02-20 - Dale Emery was added as committer on 2019-06-19 - Mark
> Hanson
> >> was added as committer on 2019-06-19 ## Project Activity: Release 1.10
> is
> >> in progress. An Apache Geode Summit is scheduled the day before the
> >> SpringOne Platform 2019 conference, on 7 October 2019, in Austin, TX.
> >> Several Geode contributors will present talks and in traffic in the past
> >> quarter (505 emails compared to 443) JIRA tickets show that issues
> continue
> >> to be identified and resolved. - 289 issues opened in JIRA in the past
> >> quarter - 296 issues closed in JIRA in the past quarter - 454 commits in
> >> the past quarter The community is actively contributing to the Apache
> >> Geode code base: - 62 code contributors in the past quarter - 344 PRs
> >> opened on GitHub in the past quarter - 356 PRs closed on GitHub in the
> past
> >> quarter
> >>
>
>