vagetablechicken opened a new issue, #9465: URL: https://github.com/apache/iceberg/issues/9465
hi, I'm doing some tests, based on spark quickstart <https://iceberg.apache.org/spark-quickstart/>. I start up it, and try to connect iceberg from outside(host->iceberg_in_containers). And it works when i use pyiceberg in host, I can read & write. But it'll be failed when i use spark-sql in host(3.5.0, the same version with spark-iceberg image). The steps in host are in snippet. Any help/suggestion would be appreciated. [Slack Message](https://apache-iceberg.slack.com/archives/C025PH0G1D4/p1704874503158399?thread_ts=1704874503.158399&cid=C025PH0G1D4) - Start quickstart docker compose, create table and insert - Steps on host: 1. export envs ``` export AWS_ACCESS_KEY_ID=admin export AWS_SECRET_ACCESS_KEY=password export AWS_REGION=us-east-1 ``` 2. spark config(rest&s3 bind localhost ports) ``` spark.sql.extensions org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions spark.sql.catalog.demo org.apache.iceberg.spark.SparkCatalog spark.sql.catalog.demo.type rest spark.sql.catalog.demo.uri http://localhost:8181 spark.sql.catalog.demo.s3.endpoint http://localhost:9000 spark.sql.defaultCatalog demo ``` 3. run sql ``` echo "SELECT * FROM demo.nyc.taxis;" | bin/spark-sql null (Service: S3, Status Code: 404, Request ID: 17A94BFECBFF61D2, Extended Request ID: dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8) (Service: S3, Status Code: 404, Request ID: 17A94BFECBFF61D2) software.amazon.awssdk.services.s3.model.NoSuchKeyException: null (Service: S3, Status Code: 404, Request ID: 17A94BFECBFF61D2, Extended Request ID: dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8) (Service: S3, Status Code: 404, Request ID: 17A94BFECBFF61D2) at software.amazon.awssdk.services.s3.model.NoSuchKeyException$BuilderImpl.build(NoSuchKeyException.java:126) ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
