jkolash commented on issue #13693:
URL: https://github.com/apache/iceberg/issues/13693#issuecomment-3164218944
You can implement your own delete function in the existing apis.
```java
/**
* Passes an alternative delete implementation that will be used for
orphan files.
*
* <p>This method allows users to customize the delete function. For
example, one may set a custom
* delete func and collect all orphan files into a set instead of
physically removing them.
*
* <p>If not set, defaults to using the table's {@link
org.apache.iceberg.io.FileIO io}
* implementation.
*
* @param deleteFunc a function that will be called to delete files
* @return this for method chaining
*/
DeleteOrphanFiles deleteWith(Consumer<String> deleteFunc);
```
https://github.com/apache/iceberg/blob/main/api/src/main/java/org/apache/iceberg/actions/DeleteOrphanFiles.java#L72
I believe this is now being viewed more as a catalog responsibilty where the
exact details can be handled by the catalog implementaiton.
I think implementing this custom delete type in this project would
complicate things as it would need to be implemented similiarly across all
cloud object storage providers. The policy would need to be initialized
somewere and that is policy creation is genrally done with a different role
than you'd use when running the delete orphan files procedure.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
