Re: [Operator] [VOTE] Release the Solr Operator v0.4.0 RC1

2021-09-13 Thread Jason Gerlowski
+1 from me.  Ran the smoketest and created a few deployments manually
in Kubernetes-desktop

On Fri, Sep 10, 2021 at 5:24 PM Mike Drob  wrote:
>
> +1, but there's a bunch of problems that I ran into.
>
> 
> Successfully smoke tested the Solr Operator v0.4.0!
>
> Ran into this error because I had go 1.17 installed instead of 1.16:
>
> ./hack/check_format.sh
> These files did not pass the ‘go fmt’ check, please run ‘go fmt’ on them:
>
> diff -u ./api/v1beta1/zz_generated.deepcopy.go.orig 
> ./api/v1beta1/zz_generated.deepcopy.go
> --- ./api/v1beta1/zz_generated.deepcopy.go.orig 2021-09-10 14:58:31.0 
> -0500
> +++ ./api/v1beta1/zz_generated.deepcopy.go 2021-09-10 14:58:31.0 -0500
> @@ -1,3 +1,4 @@
> +//go:build !ignore_autogenerated
>  // +build !ignore_autogenerated
>  /*
> make: *** [check-format] Error 1
>
> Then I had to remove controller-gen and reinstall it because the version I 
> had was still built with 1.17
>
> Check to make sure the generated code is up to date
>
> diff --recursive api generated-check/api
>
> diff --recursive api/v1beta1/zz_generated.deepcopy.go 
> generated-check/api/v1beta1/zz_generated.deepcopy.go
>
> 0a1
>
> > //go:build !ignore_autogenerated
>
> make: *** [check-generated] Error 1
>
> Then I had a bunch of issues running the tests because what I thought was 
> enough Docker resources apparently wasn't. Would appreciate next time 
> explicitly quantifying what "enough CPU and memory" means.
>
>
>
>
> On Thu, Sep 9, 2021 at 1:43 PM Timothy Potter  wrote:
>>
>> +1 (binding) for the Solr Operator v0.4.0 RC1
>>
>> I ran the smoke tester + tested locally in Docker Desktop + deployed in EKS.
>>
>> Looks great, thanks Houston!
>>
>> On Wed, Sep 8, 2021 at 1:00 PM Timothy Potter  wrote:
>> >
>> > If anyone is interested in testing the Solr operator against the
>> > recently cut Solr 8.10 branch, I just pushed a Docker image (built
>> > locally) to: thelabdude/apache-solr-dev:8.10.0-SNAPSHOT
>> >
>> > SolrCloud CR YAML:
>> >
>> >   solrImage:
>> > repository: thelabdude/apache-solr-dev
>> > tag: 8.10.0-SNAPSHOT
>> >
>> > Cheers,
>> > Tim
>> >
>> > On Tue, Sep 7, 2021 at 9:40 AM Houston Putman  wrote:
>> > >
>> > > Please vote for release candidate 1 for the Solr Operator v0.4.0
>> > >
>> > > The artifacts can be downloaded from:
>> > > https://dist.apache.org/repos/dist/dev/solr/solr-operator/solr-operator-v0.4.0-RC1-revfae48c193d24950fa682a72a00e43579c3b8de04
>> > >
>> > > You can run the full smoke tester, with instructions below.
>> > > However, it is also encouraged to go and use the artifacts yourself in a 
>> > > test Kubernetes cluster.
>> > > The smoke tester does not require you to download or install the RC 
>> > > artifacts before running.
>> > > If you plan on just running the smoke tests, then ignore all other 
>> > > instructions.
>> > >
>> > > The artifacts are layed out in the following way:
>> > >   * solr-operator-v0.4.0.tgz - Contains the source release
>> > >   * crds/ - Contains the CRD files
>> > >   * helm/ - Contains the Helm release packages
>> > >
>> > > The RC Docker image can be found at:
>> > >   apache/solr-operator:v0.4.0-rc1
>> > >
>> > > The RC Helm repo can be added with:
>> > >   helm repo add apache-solr-rc 
>> > > https://dist.apache.org/repos/dist/dev/solr/solr-operator/solr-operator-v0.4.0-RC1-revfae48c193d24950fa682a72a00e43579c3b8de04/helm-charts
>> > >
>> > > You can install the RC Solr Operator and Solr CRDs and an example Solr 
>> > > Cloud with:
>> > >   curl -sL0 "https://dist.apache.org/repos/dist/release/solr/KEYS"; | gpg 
>> > > --import --quiet
>> > >   # This will export your public keys into a format that helm can 
>> > > understand.
>> > >   # Skip verification by removing "--verify" in the helm command below.
>> > >   if ! (gpg --no-default-keyring --keyring=~/.gnupg/pubring.gpg 
>> > > --list-keys "98F3F6EC"); then gpg --export >~/.gnupg/pubring.gpg; fi
>> > >   kubectl create -f 
>> > > https://dist.apache.org/repos/dist/dev/solr/solr-operator/solr-operator-v0.4.0-RC1-revfae48c193d24950fa682a72a00e43579c3b8de04/crds/all-with-dependencies.yaml
>> > >  || \
>> > > kubectl replace -f 
>> > > https://dist.apache.org/repos/dist/dev/solr/solr-operator/solr-operator-v0.4.0-RC1-revfae48c193d24950fa682a72a00e43579c3b8de04/crds/all-with-dependencies.yaml
>> > >   helm install --verify solr-operator apache-solr-rc/solr-operator --set 
>> > > image.tag=v0.4.0-rc1
>> > >   helm install --verify example apache-solr-rc/solr
>> > >
>> > > You can run the full smoke tester directly with this command: (First 
>> > > checkout the release-0.4 branch of the solr-operator)
>> > >
>> > > ./hack/release/smoke_test/smoke_test.sh -v "v0.4.0" -s "fae48c1" -i 
>> > > "apache/solr-operator:v0.4.0-rc1" -g "98F3F6EC" \
>> > > -l 
>> > > 'https://dist.apache.org/repos/dist/dev/solr/solr-operator/solr-operator-v0.4.0-RC1-revfae48c193d24950fa682a72a00e43579c3b8de04'
>> > >
>> > > If you want to run the smoke test

Re: [Operator] [VOTE] Release the Solr Operator v0.4.0 RC1

2021-09-13 Thread Houston Putman
It's been >72h since the vote was initiated and the result is:

+1  4  (4 binding)
 0  0
-1  0

This vote has PASSED

Thanks for the input Mike, we will definitely have the project integrate
build tools better in v0.5.0!

On Mon, Sep 13, 2021 at 7:58 AM Jason Gerlowski 
wrote:

> +1 from me.  Ran the smoketest and created a few deployments manually
> in Kubernetes-desktop
>
> On Fri, Sep 10, 2021 at 5:24 PM Mike Drob  wrote:
> >
> > +1, but there's a bunch of problems that I ran into.
> >
> > 
> > Successfully smoke tested the Solr Operator v0.4.0!
> >
> > Ran into this error because I had go 1.17 installed instead of 1.16:
> >
> > ./hack/check_format.sh
> > These files did not pass the ‘go fmt’ check, please run ‘go fmt’ on them:
> >
> > diff -u ./api/v1beta1/zz_generated.deepcopy.go.orig
> ./api/v1beta1/zz_generated.deepcopy.go
> > --- ./api/v1beta1/zz_generated.deepcopy.go.orig 2021-09-10
> 14:58:31.0 -0500
> > +++ ./api/v1beta1/zz_generated.deepcopy.go 2021-09-10 14:58:31.0
> -0500
> > @@ -1,3 +1,4 @@
> > +//go:build !ignore_autogenerated
> >  // +build !ignore_autogenerated
> >  /*
> > make: *** [check-format] Error 1
> >
> > Then I had to remove controller-gen and reinstall it because the version
> I had was still built with 1.17
> >
> > Check to make sure the generated code is up to date
> >
> > diff --recursive api generated-check/api
> >
> > diff --recursive api/v1beta1/zz_generated.deepcopy.go
> generated-check/api/v1beta1/zz_generated.deepcopy.go
> >
> > 0a1
> >
> > > //go:build !ignore_autogenerated
> >
> > make: *** [check-generated] Error 1
> >
> > Then I had a bunch of issues running the tests because what I thought
> was enough Docker resources apparently wasn't. Would appreciate next time
> explicitly quantifying what "enough CPU and memory" means.
> >
> >
> >
> >
> > On Thu, Sep 9, 2021 at 1:43 PM Timothy Potter 
> wrote:
> >>
> >> +1 (binding) for the Solr Operator v0.4.0 RC1
> >>
> >> I ran the smoke tester + tested locally in Docker Desktop + deployed in
> EKS.
> >>
> >> Looks great, thanks Houston!
> >>
> >> On Wed, Sep 8, 2021 at 1:00 PM Timothy Potter 
> wrote:
> >> >
> >> > If anyone is interested in testing the Solr operator against the
> >> > recently cut Solr 8.10 branch, I just pushed a Docker image (built
> >> > locally) to: thelabdude/apache-solr-dev:8.10.0-SNAPSHOT
> >> >
> >> > SolrCloud CR YAML:
> >> >
> >> >   solrImage:
> >> > repository: thelabdude/apache-solr-dev
> >> > tag: 8.10.0-SNAPSHOT
> >> >
> >> > Cheers,
> >> > Tim
> >> >
> >> > On Tue, Sep 7, 2021 at 9:40 AM Houston Putman 
> wrote:
> >> > >
> >> > > Please vote for release candidate 1 for the Solr Operator v0.4.0
> >> > >
> >> > > The artifacts can be downloaded from:
> >> > >
> https://dist.apache.org/repos/dist/dev/solr/solr-operator/solr-operator-v0.4.0-RC1-revfae48c193d24950fa682a72a00e43579c3b8de04
> >> > >
> >> > > You can run the full smoke tester, with instructions below.
> >> > > However, it is also encouraged to go and use the artifacts yourself
> in a test Kubernetes cluster.
> >> > > The smoke tester does not require you to download or install the RC
> artifacts before running.
> >> > > If you plan on just running the smoke tests, then ignore all other
> instructions.
> >> > >
> >> > > The artifacts are layed out in the following way:
> >> > >   * solr-operator-v0.4.0.tgz - Contains the source release
> >> > >   * crds/ - Contains the CRD files
> >> > >   * helm/ - Contains the Helm release packages
> >> > >
> >> > > The RC Docker image can be found at:
> >> > >   apache/solr-operator:v0.4.0-rc1
> >> > >
> >> > > The RC Helm repo can be added with:
> >> > >   helm repo add apache-solr-rc
> https://dist.apache.org/repos/dist/dev/solr/solr-operator/solr-operator-v0.4.0-RC1-revfae48c193d24950fa682a72a00e43579c3b8de04/helm-charts
> >> > >
> >> > > You can install the RC Solr Operator and Solr CRDs and an example
> Solr Cloud with:
> >> > >   curl -sL0 "https://dist.apache.org/repos/dist/release/solr/KEYS";
> | gpg --import --quiet
> >> > >   # This will export your public keys into a format that helm can
> understand.
> >> > >   # Skip verification by removing "--verify" in the helm command
> below.
> >> > >   if ! (gpg --no-default-keyring --keyring=~/.gnupg/pubring.gpg
> --list-keys "98F3F6EC"); then gpg --export >~/.gnupg/pubring.gpg; fi
> >> > >   kubectl create -f
> https://dist.apache.org/repos/dist/dev/solr/solr-operator/solr-operator-v0.4.0-RC1-revfae48c193d24950fa682a72a00e43579c3b8de04/crds/all-with-dependencies.yaml
> || \
> >> > > kubectl replace -f
> https://dist.apache.org/repos/dist/dev/solr/solr-operator/solr-operator-v0.4.0-RC1-revfae48c193d24950fa682a72a00e43579c3b8de04/crds/all-with-dependencies.yaml
> >> > >   helm install --verify solr-operator apache-solr-rc/solr-operator
> --set image.tag=v0.4.0-rc1
> >> > >   helm install --verify example apache-solr-rc/solr
> >> > >
> >> > > You can run the full smoke tester directly with this co

[Operator] [RESULT] [VOTE] Release the Solr Operator v0.4.0 RC1

2021-09-13 Thread Houston Putman
It's been >72h since the vote was initiated and the result is:

+1  4  (4 binding)
 0  0
-1  0

This vote has PASSED


Re: [Operator] [VOTE] Release the Solr Operator v0.4.0 RC1

2021-09-13 Thread Anshum Gupta
Thanks for taking care of this, Houston :)

I spent some effort trying to test out the RC, but was unable to, so I
wanted to share some information around what I saw while trying to test.

There are some issues bringing up etcd on MacOS 12.0 (Monterey) public
betas, which blocks running the tests/smoke test. This seems to affect both
Public beta 5 and 6 (the latest one), and also Go Lang version 1.16 and
1.17.

If you try to run the tests, you'd not really get any useful information
other than  the following error:

*"error": "timeout waiting for process etcd to start""*


Running etcd directly via the command line, however prints the error with a
detailed thread stack (excluded from the email):

*fatal error: runtime: bsdthread_register error*

*runtime stack:*
*runtime.throw(0x1bed3fa, 0x21)*
* /usr/local/go/src/runtime/panic.go:616 +0x81 fp=0x7ff7bfeff608
sp=0x7ff7bfeff5e8 pc=0x102a871*

Thanks to Houston, for helping out with debugging the issue. I've reported
these issues and will update the mailing list as/when I hear something or
see the tests pass.

-Anshum

On Mon, Sep 13, 2021 at 6:01 AM Houston Putman  wrote:

> It's been >72h since the vote was initiated and the result is:
>
> +1  4  (4 binding)
>  0  0
> -1  0
>
> This vote has PASSED
>
> Thanks for the input Mike, we will definitely have the project integrate
> build tools better in v0.5.0!
>
> On Mon, Sep 13, 2021 at 7:58 AM Jason Gerlowski 
> wrote:
>
>> +1 from me.  Ran the smoketest and created a few deployments manually
>> in Kubernetes-desktop
>>
>> On Fri, Sep 10, 2021 at 5:24 PM Mike Drob  wrote:
>> >
>> > +1, but there's a bunch of problems that I ran into.
>> >
>> > 
>> > Successfully smoke tested the Solr Operator v0.4.0!
>> >
>> > Ran into this error because I had go 1.17 installed instead of 1.16:
>> >
>> > ./hack/check_format.sh
>> > These files did not pass the ‘go fmt’ check, please run ‘go fmt’ on
>> them:
>> >
>> > diff -u ./api/v1beta1/zz_generated.deepcopy.go.orig
>> ./api/v1beta1/zz_generated.deepcopy.go
>> > --- ./api/v1beta1/zz_generated.deepcopy.go.orig 2021-09-10
>> 14:58:31.0 -0500
>> > +++ ./api/v1beta1/zz_generated.deepcopy.go 2021-09-10
>> 14:58:31.0 -0500
>> > @@ -1,3 +1,4 @@
>> > +//go:build !ignore_autogenerated
>> >  // +build !ignore_autogenerated
>> >  /*
>> > make: *** [check-format] Error 1
>> >
>> > Then I had to remove controller-gen and reinstall it because the
>> version I had was still built with 1.17
>> >
>> > Check to make sure the generated code is up to date
>> >
>> > diff --recursive api generated-check/api
>> >
>> > diff --recursive api/v1beta1/zz_generated.deepcopy.go
>> generated-check/api/v1beta1/zz_generated.deepcopy.go
>> >
>> > 0a1
>> >
>> > > //go:build !ignore_autogenerated
>> >
>> > make: *** [check-generated] Error 1
>> >
>> > Then I had a bunch of issues running the tests because what I thought
>> was enough Docker resources apparently wasn't. Would appreciate next time
>> explicitly quantifying what "enough CPU and memory" means.
>> >
>> >
>> >
>> >
>> > On Thu, Sep 9, 2021 at 1:43 PM Timothy Potter 
>> wrote:
>> >>
>> >> +1 (binding) for the Solr Operator v0.4.0 RC1
>> >>
>> >> I ran the smoke tester + tested locally in Docker Desktop + deployed
>> in EKS.
>> >>
>> >> Looks great, thanks Houston!
>> >>
>> >> On Wed, Sep 8, 2021 at 1:00 PM Timothy Potter 
>> wrote:
>> >> >
>> >> > If anyone is interested in testing the Solr operator against the
>> >> > recently cut Solr 8.10 branch, I just pushed a Docker image (built
>> >> > locally) to: thelabdude/apache-solr-dev:8.10.0-SNAPSHOT
>> >> >
>> >> > SolrCloud CR YAML:
>> >> >
>> >> >   solrImage:
>> >> > repository: thelabdude/apache-solr-dev
>> >> > tag: 8.10.0-SNAPSHOT
>> >> >
>> >> > Cheers,
>> >> > Tim
>> >> >
>> >> > On Tue, Sep 7, 2021 at 9:40 AM Houston Putman 
>> wrote:
>> >> > >
>> >> > > Please vote for release candidate 1 for the Solr Operator v0.4.0
>> >> > >
>> >> > > The artifacts can be downloaded from:
>> >> > >
>> https://dist.apache.org/repos/dist/dev/solr/solr-operator/solr-operator-v0.4.0-RC1-revfae48c193d24950fa682a72a00e43579c3b8de04
>> >> > >
>> >> > > You can run the full smoke tester, with instructions below.
>> >> > > However, it is also encouraged to go and use the artifacts
>> yourself in a test Kubernetes cluster.
>> >> > > The smoke tester does not require you to download or install the
>> RC artifacts before running.
>> >> > > If you plan on just running the smoke tests, then ignore all other
>> instructions.
>> >> > >
>> >> > > The artifacts are layed out in the following way:
>> >> > >   * solr-operator-v0.4.0.tgz - Contains the source release
>> >> > >   * crds/ - Contains the CRD files
>> >> > >   * helm/ - Contains the Helm release packages
>> >> > >
>> >> > > The RC Docker image can be found at:
>> >> > >   apache/solr-operator:v0.4.0-rc1
>> >> > >
>> >> > > The RC Helm repo can be added with:
>> >> > >   helm repo add apache-solr-rc
>> https://dist.apache.

[Operator] [ANNOUNCE] Apache Solr Operator v0.4.0 released

2021-09-13 Thread Houston Putman
The Apache Solr PMC is pleased to announce the release of the Apache Solr
Operator v0.4.0.

The Apache Solr Operator is a safe and easy way of managing a Solr
ecosystem in Kubernetes.

This release contains numerous bug fixes, optimizations, and improvements,
some of which are highlighted below. The release is available for immediate
download at:

  

### Solr Operator v0.4.0 Release Highlights:

* A new Helm chart for templating the Solr resource.
  * Users must still run the Solr Operator, preferably through the Solr
Operator Helm chart.
* Support for hostpath for the Solr data volume when in ephemeral mode
* Scheduled restarts of Solr Clouds and Solr Prometheus Exporters
* The default version of Solr has been upgraded to 8.9
* Allow for custom service accounts to be used when running Solr
* Upgrade the Zookeeper Operator dependency to v0.2.12
* Allow for ephemeral storage when running a provided Zookeeper cluster
  * The storage type for Zookeeper will default to the option chosen for
Solr
* Enable configuration of provided Zookeeper Config options
* Use a more secure base image for the Solr Operator
* The PrometheusExporter now accepts custom pod probes (liveness,
readiness, startup)
* Fix permissions in the default bootstrapped security.json
* Allow for terminating the Solr TLS at the ingress
* Allow for loading in TLS information from a mounted directory (SolrCloud
and SolrPrometheusExporter)
* SolrCloud now supports separate server and client certs for mTLS
* The Solr Operator supports hot-reloading of TLS client certs used to
connect to Solr (enabled by default)

A summary of important changes is published in the documentation at:

  

For the most exhaustive list, see the change log on ArtifactHub or view the
git history in the solr-operator repo.

  <
https://artifacthub.io/packages/helm/apache-solr/solr-operator?modal=changelog
>

  


Note: The Apache Software Foundation uses an extensive mirroring network for
distributing releases. It is possible that the mirror you are using may not
have
replicated the release yet. If that is the case, please try another mirror.