Re: Cloud storage modules for backup/restore

2023-04-10 Thread Ishan Chattopadhyaya
Oh thanks, Jan. I had missed it. It is a shame because it looks like a very neat project. On Mon, 10 Apr, 2023, 23:53 Jan Høydahl, wrote: > Looks like a nice project. With the promise of low-hanging support for > more providers than those three for free. > > However, https://lists.apache.org/thr

Re: ShardSplitTest flakiness investigation

2023-04-10 Thread Alex Deparvu
Hi, Gentle reminder for anyone interested to take a look at the PR. I have added a lot of detail to this failure (and a fix proposal) and would appreciate some feedback, or at least let me know if you are planning on taking a look at some point in the near future. This would help both with validat

Re: Cloud storage modules for backup/restore

2023-04-10 Thread Jan Høydahl
Looks like a nice project. With the promise of low-hanging support for more providers than those three for free. However, https://lists.apache.org/thread/w61gzk2ohjtshbwcb5gy6wb2htv7fo0x does not look promising - they plan to move the project to the Attic, and no new releases has happened durin

Re: Cloud storage modules for backup/restore

2023-04-10 Thread Gus Heck
Sounds interesting. Don't really know anything about jclouds, a quick glance at your link didn't tell me much, but if they ship libraries that can plug in (or otherwise be leveraged without need for any external software) and handle connectivity that sounds like a win. Not as keen if it requires an

Re: Cloud storage modules for backup/restore

2023-04-10 Thread Ishan Chattopadhyaya
Supported storage providers, FYI: https://jclouds.apache.org/reference/providers/#blobstore-providers On Mon, 10 Apr 2023 at 22:49, Ishan Chattopadhyaya < ichattopadhy...@gmail.com> wrote: > TBH, I haven't personally used either of them extensively, but just synced > up with my colleague who buil

Re: Cloud storage modules for backup/restore

2023-04-10 Thread Ishan Chattopadhyaya
TBH, I haven't personally used either of them extensively, but just synced up with my colleague who built that solution. So, I thought of bringing it up here for any additional points of consideration (in case JClouds wasn't considered earlier). I'm not invested into this effort much either way as

Cloud storage modules for backup/restore

2023-04-10 Thread Ishan Chattopadhyaya
Hi all, For backup/restore, we have out of the box support for GCS and S3, but not Azure. I think we should deprecate both the modules for S3 and GCS, and adopt Apache JCloud project that supports all three. For testing, we could try Minio (unless we are already happy with S3Mock that we use today