kevinjqliu commented on issue #1328: URL: https://github.com/apache/iceberg-python/issues/1328#issuecomment-2521085687
> Output: b'' that would explain the validation error. Its weird to me that s3 returns 0 bytes instead of an error. Couple of things you can try. 1. See if the credential is correct and that these credentials can read that file. I noticed in the 2nd example you passed in `profile_name` to get credentials. ``` "s3.endpoint":"http://s3-website-us-east-1.amazonaws.com", "s3.access-key-id":"key id", "s3.secret-access-key":"access key", "s3.session-token": "session-key" ``` 2. the endpoint is set correctly. ``` "s3.endpoint":"http://s3-website-us-east-1.amazonaws.com", ``` you can verify like ``` aws s3 ls s3://bucket/warehouse/tenantdb.db/pinglogs/metadata/ --endpoint-url http://s3-website-us-east-1.amazonaws.com ``` 3. FileIO. Print the FileIO type. S3 can use both PyArrowFileIO and FsspecFileIO https://py.iceberg.apache.org/configuration/#fileio give the other one a try ``` print(type(io)) ``` hope this helps! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org