geruh commented on issue #515:
URL: https://github.com/apache/iceberg-python/issues/515#issuecomment-2032913100

   No Problem!! 
   
   This could potentially be a bug if we assume that the catalog and FileIO 
(S3) share the same aws profile configs. On one side, having a single profile 
configuration is convenient for the user's  boto client, as it allows 
initializing all AWS clients with the correct credentials. However, on the 
other hand, we could argue that this configuration should only work at the 
catalog level, and for filesystems, separate configurations might be required. 
I'm inclined towards the first option. However, we are using pyarrow's 
S3FileSystem implementation, which has no concept of a aws profile. Therefore, 
we will need to initialize these values through boto's 
session.get_credentials() and pass them to the filesystem.
   
   I'll raise an issue for this 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to