mmgaggle commented on PR #12264: URL: https://github.com/apache/iceberg/pull/12264#issuecomment-2680003867
> > How hard would it be for us to get some integration tests with one of these systems into the Iceberg project? Seems like we should have some coverage for these other S3-Compat systems. I'd also be ok with a separate project that we just use as a canary before release. > > Hi @RussellSpitzer, @jbonofre had a similar vision, which led to the creation of [Project Iceland](https://github.com/dremio/iceland) with the goal of providing integration test coverage for various catalogs. Initially, the plan was to cover all catalog types, but given the recent focus on REST and Polaris, we are currently prioritizing REST-based catalogs. This exists, but it's mostly python / boto based. https://github.com/ceph/s3-tests Various vendors create test runners to validate S3 compat including Snowflake, Splunk (uses an older branch of s3-tests), Terradata, etc. Hadoop common has one as well: https://github.com/apache/hadoop/tree/trunk/hadoop-tools/hadoop-aws/src/test If there were an Iceberg one, it would be something we'd validate our Ceph releases against. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
