Hi Dick, Thanks for holding the release!
The investigation did in fact find the root cause of the delayed registerInterest. Darrel created GEODE-9067<https://issues.apache.org/jira/browse/GEODE-9067> that describes the issue and he already and has a fix for it ?. While this issue should be addressed, it has been in Geode since day 1 and it's not worthwhile to restart the release for it and redo all work. We have great fixes coming in this release that should go to our users quickly. We should however address GEODE-9067 it in all future releases (including 1.13.3). ________________________________ From: Dick Cavender <di...@vmware.com> Sent: Monday, March 22, 2021 15:03 To: dev@geode.apache.org <dev@geode.apache.org> Subject: RE: [VOTE] Apache Geode 1.13.2.RC1 Thanks Donal- Holding 1.13.2 release until there is more information. -----Original Message----- From: Donal Evans <doev...@vmware.com> Sent: Monday, March 22, 2021 2:41 PM To: dev@geode.apache.org Subject: Re: [VOTE] Apache Geode 1.13.2.RC1 I'm okay with waiting until we know what the situation is with this register interest issue before releasing or scrapping this RC. Making a decision before we fully understand the consequences seems unwise. ________________________________ From: Alexander Murmann <amurm...@vmware.com> Sent: Monday, March 22, 2021 1:59 PM To: dev@geode.apache.org <dev@geode.apache.org> Subject: Re: [VOTE] Apache Geode 1.13.2.RC1 Sorry, everyone! We still haven't gotten to the bottom of the very slow registerInterest. More details should be coming in a ticket as we get closer to the root cause. Right now, we are seeing messages about delayed FetchBulkEntries and registerInterest taking over 5 minutes. That's resulting in the HARegionQueue filling up and eventually falling over. I am not sure what's formally the best way forward with this vote. The best solution to me seems to put the release on hold till this issue is resolved. There is still a chance that this will turn out to be a case that has been in Geode for a while now. In that case we could ship this RC after all. If we find that we need to make changes to address this issue, we of course should have a new vote. Do we need a vote to pause the release or can we just informally agree that waiting for this is the best course of action till someone voices concern about the downsides of this delay? ________________________________ From: Dick Cavender <di...@vmware.com> Sent: Thursday, March 18, 2021 13:52 To: dev@geode.apache.org <dev@geode.apache.org> Subject: RE: [VOTE] Apache Geode 1.13.2.RC1 Update: Apache Geode 1.13.2.RC1 voting deadline is now: 3PM PST Monday, March 22, 2021 -----Original Message----- From: Alexander Murmann <amurm...@vmware.com> Sent: Thursday, March 18, 2021 1:23 PM To: dev@geode.apache.org Subject: Re: [VOTE] Apache Geode 1.13.2.RC1 I am sorry, can we get another 24 hours to analyze the long registerInterest calls, please? Thank you! ________________________________ From: Dick Cavender <di...@vmware.com> Sent: Tuesday, March 16, 2021 13:56 To: dev@geode.apache.org <dev@geode.apache.org> Subject: RE: [VOTE] Apache Geode 1.13.2.RC1 Certainly! The new Apache Geode 1.13.2.RC1 voting deadline is now: 3PM PST Thurs, March 18, 2021 -----Original Message----- From: Alexander Murmann <amurm...@vmware.com> Sent: Tuesday, March 16, 2021 1:46 PM To: dev@geode.apache.org Subject: Re: [VOTE] Apache Geode 1.13.2.RC1 Can we please extend the vote for another 48 hours? We are investigating a potential issue in which registerInterest is taking over 5 minutes. It's still unclear what exactly is causing that, but some more time to investigate would be better than potentially shipping a bug like this. ________________________________ From: Dick Cavender <di...@vmware.com> Sent: Thursday, March 11, 2021 13:34 To: dev@geode.apache.org <dev@geode.apache.org> Subject: [VOTE] Apache Geode 1.13.2.RC1 Hello Geode Dev Community, It's been 4 months since the Apache Geode 1.13.1 release and there are a total 48 important fixes on support/1.13 that the community would benefit from. The recently released v1.12.1 has 33 <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fissues%2F%3Fjql%3Dproject%2520%253D%2520GEODE%2520AND%2520fixVersion%2520%253D%25201.12.1%2520and%2520fixVersion%2520%253D%25201.13.2&data=04%7C01%7Camurmann%40vmware.com%7C132372aa80994407689808d8ed7e4b84%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637520473980717192%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=YzquO%2BJY7oJhfk2F6RGNG4%2FybE0YF69lYqyVC87Fr%2Bo%3D&reserved=0> fixes that are not released in 1.13. Based on this I propose release of an Apache Geode 1.13.2 based on the current support/1.13 branch. I'll volunteer to be the release manager for 1.13.2 and what follows is a release candidate for Apache Geode version 1.13.2.RC1. Thanks to all the community members for their contributions to this release! Please do a review and give your feedback, including the checks you performed. Voting deadline: 3PM PST Tues, March 16, 2021 Please note that we are voting upon the source tag: rel/v1.13.2.RC1 Release notes: https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FGEODE%2FRelease%2BNotes%23ReleaseNotes-1.13.2&data=04%7C01%7Camurmann%40vmware.com%7C132372aa80994407689808d8ed7e4b84%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637520473980727188%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=I9TcQFRY6vWVDTHfdPLCH1Nk2kb%2Bqa3btWf6WW9J8CE%3D&reserved=0 Source and binary distributions: https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fgeode%2F1.13.2.RC1%2F&data=04%7C01%7Camurmann%40vmware.com%7C132372aa80994407689808d8ed7e4b84%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637520473980727188%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=eCzWT9IL%2F7U58VKHvCl9%2FHkkIbuMnqNUhS%2Fh9FZzRG8%3D&reserved=0 Maven staging repo: https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachegeode-1079&data=04%7C01%7Camurmann%40vmware.com%7C132372aa80994407689808d8ed7e4b84%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637520473980727188%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=69PFQZRoRVB8%2BqmWQOfijM%2FF%2FqMU53YdeY67yyT1AHw%3D&reserved=0 GitHub: https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fgeode%2Ftree%2Frel%2Fv1.13.2.RC1&data=04%7C01%7Camurmann%40vmware.com%7C132372aa80994407689808d8ed7e4b84%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637520473980727188%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=3GsmOsytJmlPAl%2FQKf6JmUYZ%2FY4jdtBcvtjqFwJC1oU%3D&reserved=0 https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fgeode-examples%2Ftree%2Frel%2Fv1.13.2.RC1&data=04%7C01%7Camurmann%40vmware.com%7C132372aa80994407689808d8ed7e4b84%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637520473980727188%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=OySKXgEnjYXnP%2F4G4MQFe1vjoLrqa1Z%2FXk5AZHLRQhc%3D&reserved=0 https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fgeode-native%2Ftree%2Frel%2Fv1.13.2.RC1&data=04%7C01%7Camurmann%40vmware.com%7C132372aa80994407689808d8ed7e4b84%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637520473980727188%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=HaGkXfmEWl2N74dLHWTSbxbcFA89I7Xo6Y17PzTQCPY%3D&reserved=0 https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fgeode-benchmarks%2Ftree%2Frel%2Fv1.13.2.RC1&data=04%7C01%7Camurmann%40vmware.com%7C132372aa80994407689808d8ed7e4b84%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637520473980737182%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=%2F4R4ennM8uYYiHRrFM7L%2BNJ1vczxaxM8%2BgY3LUhzB0M%3D&reserved=0 Pipelines: https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fconcourse.apachegeode-ci.info%2Fteams%2Fmain%2Fpipelines%2Fapache-support-1-13-main&data=04%7C01%7Camurmann%40vmware.com%7C132372aa80994407689808d8ed7e4b84%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637520473980737182%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=9zuBrpG46oSc6Q7M5XynhuCrqpa9Z881Rn0ZIXtV%2FRA%3D&reserved=0 https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fconcourse.apachegeode-ci.info%2Fteams%2Fmain%2Fpipelines%2Fapache-support-1-13-rc&data=04%7C01%7Camurmann%40vmware.com%7C132372aa80994407689808d8ed7e4b84%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637520473980737182%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=t7EvxtiuhZZ2oNvS8VThd14VH%2FOYe1sFbpkfUDHubrc%3D&reserved=0 Geode's KEYS file containing PGP keys we use to sign the release: https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fgeode%2Fblob%2Fdevelop%2FKEYS&data=04%7C01%7Camurmann%40vmware.com%7C132372aa80994407689808d8ed7e4b84%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637520473980737182%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=yHyJZYaXnxblEoMMiI47ozneNf2oseKevKcfQ9VcgRw%3D&reserved=0 Command to run geode-examples: ./gradlew -PgeodeReleaseUrl=https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fgeode%2F1.13.2.RC1&data=04%7C01%7Camurmann%40vmware.com%7C132372aa80994407689808d8ed7e4b84%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637520473980737182%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=42fSQ2qmzKesd79%2FVBq3oNv9HukeDIKWWhdbCar7VdM%3D&reserved=0 -PgeodeRepositoryUrl=https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachegeode-1079&data=04%7C01%7Camurmann%40vmware.com%7C132372aa80994407689808d8ed7e4b84%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637520473980737182%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=SNx%2F3O6IQ%2BkRFFHlXEir1vQDk%2FVmjUaildEJ4LzFzG0%3D&reserved=0 build runAll Regards Dick Cavender