Re: rewrite CI pipeline
Hey Sai, Quick update on this. On my Mac, I'm able to build and run all unit tests without any failures using the very latest Oracle Java 8 JDK. I'll try OpenJDK and Azul next. I do have a number of IntegrationTest failures. Most are BindException failures because some process is already bound to a port. One or two failures appear to be DNS related which may require either editing /etc/hosts or changing the test. Will update again after debugging these more. Cheers, Kirk On Fri, Dec 2, 2022 at 12:58 PM Kirk Lund wrote: > Sai, I'll be able to spend some time this weekend on these failing tests. > Hope to have some more news to share soon! > > -Kirk > > On Mon, Nov 21, 2022 at 4:35 PM Sai Boorlagadda > wrote: > >> I was thinking it has to do with either JDK or ubuntu. I also tried >> 'temurin' >> and there were different sets of errors. So to see if the devs can shed >> some light on JDK dependency or any prior knowledge on choosing >> bellsoft distribution. >> >> Sai >> >> On Mon, 21 Nov 2022 at 16:25, Kirk Lund wrote: >> >> > It's also possible that these issues are specific to using OpenJDK 8 or >> > Ubuntu. I thought we were building and testing with CentOS before. >> > >> > On Mon, Nov 21, 2022 at 4:20 PM Kirk Lund wrote: >> > >> > > Looks like membership errors. Membership went through extensive >> changes >> > to >> > > be modularized as geode-membership, and VMware was still fixing some >> bugs >> > > in it when I left. These could be really difficult to solve for those >> of >> > us >> > > who have no experience with the new membership. >> > > >> > > I wonder if we could engage VMware for a little more help on these >> > > failures before they depart entirely? >> > > >> > > Last I heard there were also problems with using OpenJDK 8 but I don't >> > > know the details. VMware was using Liberica JDK 8 from Bellsoft. We >> may >> > > also need VMware to explain what the issue was with OpenJDK 8 so we >> can >> > > figure out what to do about it. >> > > >> > > On Mon, Nov 21, 2022 at 3:29 PM Sai Boorlagadda < >> > sai.boorlaga...@gmail.com> >> > > wrote: >> > > >> > >> Hello devs, >> > >> >> > >> I started a parallel activity to tease out CI work on using ASF >> jenkins >> > >> and >> > >> also Github actions (though GHA has several issues). I wanted to >> provide >> > >> some updates on these efforts and seek if others are interested to >> > >> collaborate. >> > >> >> > >> Jenkins - Was waiting for INFRA to create a high level folder[1] to >> host >> > >> all Geode jobs and have a basic unit test pipeline[2] that runs >> tests on >> > >> Ubuntu using Oracle JDK 8. While there are failing tests[3] that need >> > some >> > >> help, I am still exploring ways to write pipelines and include >> multiple >> > >> JDKs into a single JOB, so we can build using 8 while we test using >> 11. >> > >> >> > >> GHA - While it is super quick and easy to start writing a pipeline[4] >> > >> using >> > >> "matrix and strategy", There are few tests[5] failing consistently >> using >> > >> Adopt JDK 8 on Ubuntu. >> > >> >> > >> [1] https://ci-builds.apache.org/job/Geode/ >> > >> [2] >> > >> >> > >> >> > >> https://github.com/apache/geode/blob/4abcdc06af536e1188e0f8c432e9b768c175d8c0/.jenkins/Jenkinsfile >> > >> [3] >> https://ci-builds.apache.org/job/Geode/job/geode-develop/11/console >> > >> [4] https://github.com/apache/geode/pull/7870/files >> > >> [5] https://github.com/apache/geode/actions/runs/3515795079 >> > >> >> > > >> > >> >
Re: Backport plan for reported CVEs on 1.13.x branch
Hi Ankush, We are in need of more contributors if you're interested in helping! At this point, we're trying to get a new CI up and running. Then we hope to maintain the latest version 1.15.x and eventually discuss the feasibility of new minor or major releases. Regards, Kirk On Tue, Dec 6, 2022 at 5:58 AM Ankush Mittal wrote: > Hi All, > > Some of the vulnerabilities reported under [0] seems to be fix in latest > version of Geode i.e. 1.15.x but fix version doesn’t include 1.13.x, while > 1.13.x is also impacted. [1] > Can someone please confirm if the vulnerabilities fix will make it to > 1.13.9 and what will be the tentative release schedule of the same. > [2] doesn’t include the release schedule. > > Any inputs will be helpful in this regard! > > -Thanks & Regards > Ankush Mittal > > [0] https://issues.apache.org/jira/browse/GEODE-10415 > [1] https://issues.apache.org/jira/browse/GEODE-10406 > [2] https://cwiki.apache.org/confluence/display/GEODE/Release+Schedule >
Re: rewrite CI pipeline
Kirk, I updated the github pipeline[1] to run unit tests across multiple JDK implementations on the different OS to figure out if there are any JDK/OS differences and seems like there are common tests that fail on GithubActions. Sai [1] https://github.com/apache/geode/actions/runs/3519795068/jobs/5900102040 On Thu, 8 Dec 2022 at 12:18, Kirk Lund wrote: > Hey Sai, > > Quick update on this. On my Mac, I'm able to build and run all unit tests > without any failures using the very latest Oracle Java 8 JDK. I'll try > OpenJDK and Azul next. > > I do have a number of IntegrationTest failures. Most are BindException > failures because some process is already bound to a port. One or two > failures appear to be DNS related which may require either editing > /etc/hosts or changing the test. Will update again after debugging these > more. > > Cheers, > Kirk > > On Fri, Dec 2, 2022 at 12:58 PM Kirk Lund wrote: > >> Sai, I'll be able to spend some time this weekend on these failing tests. >> Hope to have some more news to share soon! >> >> -Kirk >> >> On Mon, Nov 21, 2022 at 4:35 PM Sai Boorlagadda < >> sai.boorlaga...@gmail.com> wrote: >> >>> I was thinking it has to do with either JDK or ubuntu. I also tried >>> 'temurin' >>> and there were different sets of errors. So to see if the devs can shed >>> some light on JDK dependency or any prior knowledge on choosing >>> bellsoft distribution. >>> >>> Sai >>> >>> On Mon, 21 Nov 2022 at 16:25, Kirk Lund wrote: >>> >>> > It's also possible that these issues are specific to using OpenJDK 8 or >>> > Ubuntu. I thought we were building and testing with CentOS before. >>> > >>> > On Mon, Nov 21, 2022 at 4:20 PM Kirk Lund wrote: >>> > >>> > > Looks like membership errors. Membership went through extensive >>> changes >>> > to >>> > > be modularized as geode-membership, and VMware was still fixing some >>> bugs >>> > > in it when I left. These could be really difficult to solve for >>> those of >>> > us >>> > > who have no experience with the new membership. >>> > > >>> > > I wonder if we could engage VMware for a little more help on these >>> > > failures before they depart entirely? >>> > > >>> > > Last I heard there were also problems with using OpenJDK 8 but I >>> don't >>> > > know the details. VMware was using Liberica JDK 8 from Bellsoft. We >>> may >>> > > also need VMware to explain what the issue was with OpenJDK 8 so we >>> can >>> > > figure out what to do about it. >>> > > >>> > > On Mon, Nov 21, 2022 at 3:29 PM Sai Boorlagadda < >>> > sai.boorlaga...@gmail.com> >>> > > wrote: >>> > > >>> > >> Hello devs, >>> > >> >>> > >> I started a parallel activity to tease out CI work on using ASF >>> jenkins >>> > >> and >>> > >> also Github actions (though GHA has several issues). I wanted to >>> provide >>> > >> some updates on these efforts and seek if others are interested to >>> > >> collaborate. >>> > >> >>> > >> Jenkins - Was waiting for INFRA to create a high level folder[1] to >>> host >>> > >> all Geode jobs and have a basic unit test pipeline[2] that runs >>> tests on >>> > >> Ubuntu using Oracle JDK 8. While there are failing tests[3] that >>> need >>> > some >>> > >> help, I am still exploring ways to write pipelines and include >>> multiple >>> > >> JDKs into a single JOB, so we can build using 8 while we test using >>> 11. >>> > >> >>> > >> GHA - While it is super quick and easy to start writing a >>> pipeline[4] >>> > >> using >>> > >> "matrix and strategy", There are few tests[5] failing consistently >>> using >>> > >> Adopt JDK 8 on Ubuntu. >>> > >> >>> > >> [1] https://ci-builds.apache.org/job/Geode/ >>> > >> [2] >>> > >> >>> > >> >>> > >>> https://github.com/apache/geode/blob/4abcdc06af536e1188e0f8c432e9b768c175d8c0/.jenkins/Jenkinsfile >>> > >> [3] >>> https://ci-builds.apache.org/job/Geode/job/geode-develop/11/console >>> > >> [4] https://github.com/apache/geode/pull/7870/files >>> > >> [5] https://github.com/apache/geode/actions/runs/3515795079 >>> > >> >>> > > >>> > >>> >>
Re: rewrite CI pipeline
Seems like there are some environmental-related differences. On Thu, 8 Dec 2022 at 18:56, Sai Boorlagadda wrote: > Kirk, > > I updated the github pipeline[1] to run unit tests across multiple JDK > implementations on the different OS to figure out if there are any JDK/OS > differences and seems like there are common tests that fail on > GithubActions. > > Sai > [1] > https://github.com/apache/geode/actions/runs/3519795068/jobs/5900102040 > > On Thu, 8 Dec 2022 at 12:18, Kirk Lund wrote: > >> Hey Sai, >> >> Quick update on this. On my Mac, I'm able to build and run all unit tests >> without any failures using the very latest Oracle Java 8 JDK. I'll try >> OpenJDK and Azul next. >> >> I do have a number of IntegrationTest failures. Most are BindException >> failures because some process is already bound to a port. One or two >> failures appear to be DNS related which may require either editing >> /etc/hosts or changing the test. Will update again after debugging these >> more. >> >> Cheers, >> Kirk >> >> On Fri, Dec 2, 2022 at 12:58 PM Kirk Lund wrote: >> >>> Sai, I'll be able to spend some time this weekend on these failing >>> tests. Hope to have some more news to share soon! >>> >>> -Kirk >>> >>> On Mon, Nov 21, 2022 at 4:35 PM Sai Boorlagadda < >>> sai.boorlaga...@gmail.com> wrote: >>> I was thinking it has to do with either JDK or ubuntu. I also tried 'temurin' and there were different sets of errors. So to see if the devs can shed some light on JDK dependency or any prior knowledge on choosing bellsoft distribution. Sai On Mon, 21 Nov 2022 at 16:25, Kirk Lund wrote: > It's also possible that these issues are specific to using OpenJDK 8 or > Ubuntu. I thought we were building and testing with CentOS before. > > On Mon, Nov 21, 2022 at 4:20 PM Kirk Lund wrote: > > > Looks like membership errors. Membership went through extensive changes > to > > be modularized as geode-membership, and VMware was still fixing some bugs > > in it when I left. These could be really difficult to solve for those of > us > > who have no experience with the new membership. > > > > I wonder if we could engage VMware for a little more help on these > > failures before they depart entirely? > > > > Last I heard there were also problems with using OpenJDK 8 but I don't > > know the details. VMware was using Liberica JDK 8 from Bellsoft. We may > > also need VMware to explain what the issue was with OpenJDK 8 so we can > > figure out what to do about it. > > > > On Mon, Nov 21, 2022 at 3:29 PM Sai Boorlagadda < > sai.boorlaga...@gmail.com> > > wrote: > > > >> Hello devs, > >> > >> I started a parallel activity to tease out CI work on using ASF jenkins > >> and > >> also Github actions (though GHA has several issues). I wanted to provide > >> some updates on these efforts and seek if others are interested to > >> collaborate. > >> > >> Jenkins - Was waiting for INFRA to create a high level folder[1] to host > >> all Geode jobs and have a basic unit test pipeline[2] that runs tests on > >> Ubuntu using Oracle JDK 8. While there are failing tests[3] that need > some > >> help, I am still exploring ways to write pipelines and include multiple > >> JDKs into a single JOB, so we can build using 8 while we test using 11. > >> > >> GHA - While it is super quick and easy to start writing a pipeline[4] > >> using > >> "matrix and strategy", There are few tests[5] failing consistently using > >> Adopt JDK 8 on Ubuntu. > >> > >> [1] https://ci-builds.apache.org/job/Geode/ > >> [2] > >> > >> > https://github.com/apache/geode/blob/4abcdc06af536e1188e0f8c432e9b768c175d8c0/.jenkins/Jenkinsfile > >> [3] https://ci-builds.apache.org/job/Geode/job/geode-develop/11/console > >> [4] https://github.com/apache/geode/pull/7870/files > >> [5] https://github.com/apache/geode/actions/runs/3515795079 > >> > > > >>>
