nastra commented on PR #58: URL: https://github.com/apache/iceberg-go/pull/58#issuecomment-1940935212
I think what's currently missing is having a way to configure the `warehouse` (which I hardcoded for testing) but also handling the signing part of requests against S3, similar to https://github.com/apache/iceberg-python/blob/f66e3652fdf9720d6c63a6fcec7bcd08d5bb186c/pyiceberg/io/fsspec.py#L70-L95 Listing files via `go run ./cmd/iceberg files iceberg124.foobar --catalog rest --uri https://api.dev.tabular.io/ws/ --credential <creds>` will fail with ``` 2024/02/13 10:24:07 could not open manifest file: operation error S3: GetObject, https response error StatusCode: 403, RequestID: 066G7WZD23KHZCBJ, HostID: d4V0iCd2uzvp9gZJWDOWmljaREgSaL9Iro0XxOFsv38ECJpdCd/JHWG8Y6/i7oSal8cONZ87Tis=, api error AccessDenied: Access Denied exit status 1 ``` I believe this is because `FileIO` isn't configured with the `TOKEN` in the authorization header that's coming back from the `config` inside `tblResponse` [here](https://github.com/apache/iceberg-go/blob/e530020e2cc06637bda293fc1ad49e99bd376b94/catalog/rest.go#L616). Reading all other metadata of tables work via CLI, but this is because those never use `FileIO` and only `files` does that atm. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
