gabeiglio opened a new pull request, #3351:
URL: https://github.com/apache/iceberg-python/pull/3351
<!--
Thanks for opening a pull request!
-->
<!-- In the case this PR will resolve an issue, please replace
${GITHUB_ISSUE_ID} below with the actual Github issue id. -->
<!-- Closes #${GITHUB_ISSUE_ID} -->
# Rationale for this change
When doing long writes to a table (specifically ML training) the credentials
vended with the last load table can be expired if the commit takes too long.
Here as same as Java, we proactively refresh the s3 vended credentials if
they are 5 minutes or less from expiration.
## Are these changes tested?
Yes, added tests to tests/io/test_io.py to test all the logic for when its
needed to call the vended credentials endpoint from the file io
## Are there any user-facing changes?
Yes, users can now add the following properties, to allow automatic vended
credential refresh to take place
```
client.refresh-credentials-endpoint -> endpoint to where to call IRC
client.refresh-credentials-enabled -> Refresh credential enabled set to
"true"
uri -> the catalog uri
```
<!-- In the case of user-facing changes, please add the changelog label. -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
