Re: [INFRA] Docker Repository Request for Apache Cloudberry

[Dianjin Wang]

Hi Ed,

Thanks so much for leading this work!

Ed Espino 于2024年11月5日 周二17:35写道：

> Hi Everyone,
>
> I wanted to keep the dev community informed about our infrastructure
> activities. We've submitted an INFRA JIRA ticket requesting a DockerHub
> repository for Cloudberry.
>
> Key points from the request:
>
>- Repository: docker.io/apache/incubator-cloudberry
>
> Any possibility of setting the repo name to ‘apache/cloudberry’ to avoid
renaming after incubation? Just for your information.

Best,
Dianjin Wang

[ANNOUNCE] Apache Cloudberry Repository Migration Complete and CI Restoration Plan

[Ed Espino]

Dear Apache Cloudberry (incubating) Community,

I hope this message finds you well. I'm writing to provide an update on our
repository migration and continuous integration restoration efforts.

*Repository Migration Complete*

The Apache Infrastructure team has successfully completed the migration of
all Apache Cloudberry (incubating) repositories to the official Apache
Software Foundation GitHub organization (https://github.com/apache). We
thank the Infrastructure team for their support in this effort.

*Continuous Integration Restoration Plan*

We are now initiating a two-phase approach to restore and enhance our CI
services:

Phase 1: GitHub Actions Implementation

   - Establish basic CI pipeline
   - Configure automated builds for Pull Requests and commits to the main
   branch
   - All CI workflows will be based on Rocky Linux 9

Phase 2: Extended Testing Infrastructure

   - Integration with Philips Labs self-hosted runners (
   https://github.com/philips-labs/terraform-aws-github-runner)
   - Migration of all previous testing functionality

*Infrastructure Automation*

As part of this transition, we will be implementing automation for all
infrastructure artifact creation, including:

   - Docker container images
   - Amazon Machine Images (AMI)
   - Other deployment artifacts

*Next Steps*

We will be working closely with the Infrastructure team throughout the CI
restoration process. Regular updates will be provided as we reach
significant milestones in the implementation.

We welcome community feedback and participation in this effort. Please feel
free to respond to this thread with any questions or suggestions.

Best regards,
-=e

-- 
Ed Espino
Apache Cloudberry (incubating) & MADlib

[INFRA] Docker Repository Request for Apache Cloudberry

[Ed Espino]

Hi Everyone,

I wanted to keep the dev community informed about our infrastructure
activities. We've submitted an INFRA JIRA ticket requesting a DockerHub
repository for Cloudberry.

Key points from the request:

   - Repository: docker.io/apache/incubator-cloudberry
   - Purpose: Supporting our Phase 1 CI build processes
   - Publishing will be managed through:
   github.com/apache/cloudberry-devops-release
   - Administrators: Ed Espino (espino) and Dianjin Wang (djwang)

The Docker images will support our build, testing, and release processes
across all our repositories (cloudberry, bootcamp, pxf, gpbackup-related
repos, and go-libs).

You can track the progress of this request at: [INFRA-26253
]

Please feel free to comment on the JIRA ticket if you have any questions or
suggestions.

Best regards,
-=e
-- 
Ed Espino
Apache Cloudberry (incubating) & MADlib

Re: Transfer the GitHub repos to ASF

[Dianjin Wang]

Hello everyone,

As you may know, the related repos have already been transferred to ASF. To
follow up on this, I created pull requests for each repository that include
an `asf.yaml` file and an updated README.md. These PRs will configure the
repository settings and update the project name information.

- https://github.com/apache/cloudberry/pull/694 (Already got approved, but
still need to wait for the CICD checks to work)
- https://github.com/apache/cloudberry-site/pull/168
- https://github.com/apache/cloudberry-bootcamp/pull/38
- https://github.com/apache/cloudberry-devops-release/pull/1
- https://github.com/apache/cloudberry-pxf/pull/2
- https://github.com/apache/cloudberry-go-libs/pull/3
- https://github.com/apache/cloudberry-gpbackup-s3-plugin/pull/3
- https://github.com/apache/cloudberry-gpbackup/pull/10 (Still need to wait
for the CICD checks to work)

Please help review and approve them, thank you so much!

Best,
Dianjin Wang


On Wed, Oct 30, 2024 at 3:05 AM Ed Espino  wrote:

> Thank you Champ!
>
> On Tue, Oct 29, 2024 at 12:00 PM Roman Shaposhnik 
> wrote:
>
> > On Tue, Oct 29, 2024 at 11:50 AM Ed Espino  wrote:
> > >
> > > I do believe we'll be running into GitHub Action resource utilization
> > > constraints. The team has been using AWS EC2 resources (utilizing
> > > philips-labs/terraform-aws-github-runner
> > > ) to
> > support
> > > building and testing CI/CD activities. Sep. 2024's total cost
> > > was $2,282.81. This will undoubtedly grow as we need to introduce
> > > additional testing processes.
> >
> > Then start talking to the ASF INFRA now ;-)
> >
> > Thanks,
> > Roman.
> >
> > >
> > > -=e
> > >
> > > On Tue, Oct 29, 2024 at 11:01 AM Roman Shaposhnik <
> ro...@shaposhnik.org>
> > > wrote:
> > >
> > > > On Tue, Oct 29, 2024 at 1:35 AM Dianjin Wang 
> > > > wrote:
> > > > >
> > > > > Hey all,
> > > > >
> > > > > I just created one Infra issue to request the repos transfer to
> ASF:
> > > > > https://issues.apache.org/jira/browse/INFRA-26238. If any more
> > feedback,
> > > > > please let me know.
> > > > >
> > > > > As Roman mentioned, we need to make the website work under
> > > > > `apache/cloudberry-site`. Also, I would like to bring up the CICD
> > > > workflow,
> > > > > do we need to request the GitHub Actions resources or other
> > resources to
> > > > > make the PR tests run smoothly? cc @Max @Ed, FYI.
> > > >
> > > > IIRC you don't have to request anything upfront -- you get a certain
> > amount
> > > > of free GitHub Actions utilization and if you start bumping into
> > > > limitations
> > > > you need to talk to ASF's INFRA team.
> > > >
> > > > Thanks,
> > > > Roman.
> > > >
> > > > -
> > > > To unsubscribe, e-mail: dev-unsubscr...@cloudberry.apache.org
> > > > For additional commands, e-mail: dev-h...@cloudberry.apache.org
> > > >
> > > >
> > >
> > > --
> > > Ed Espino
> > > Apache Cloudberry & MADlib
> >
> > -
> > To unsubscribe, e-mail: dev-unsubscr...@cloudberry.apache.org
> > For additional commands, e-mail: dev-h...@cloudberry.apache.org
> >
> >
>
> --
> Ed Espino
> Apache Cloudberry & MADlib
>