karuppayya opened a new pull request, #4335: URL: https://github.com/apache/datafusion-comet/pull/4335
## Which issue does this PR close? Closes #4332 ## Rationale for this change Comet's native Iceberg scan only supports static AWS credentials captured at plan time, so jobs running longer than the session-token lifetime will fail mid-scan. Iceberg-rust already exposes a pluggability hook — Comet just wasn't using it. This PR adds a CometCredentialProvider that the native scan calls back into via JNI when a refresh is needed. ## What changes are included in this PR? - New interface for Credential provider - Plumbing for Native to call into JVM via JNI to fetch credentials when needed ## How are these changes tested? - Unit tests added. - Tested e2e by deploying to a Spark cluster -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
