fuzing commented on issue #12895: URL: https://github.com/apache/iceberg/issues/12895#issuecomment-2839552491
@jesumyip - No need to package separate S3FileIO or AWS SDK jars with the above solution (I believe glue should also work out of the box with the correct config). We're also using AWS S3 (also tested with Minio, Ceph, Digital Ocean and Linode flavors of S3 compatible object stores - with and without SSE) and a bespoke catalog solution that's based loosely on the original databricks/tabular rest setup, combined with the latest (1.9.0) updates from here [test fixtures](https://github.com/apache/iceberg/tree/main/open-api/src/testFixtures/java/org/apache/iceberg/rest). In terms of capacity, we've just completed a setup that's ingesting around 75K rows/events per second, and is robust. Hope all of the helps. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
