danielcweeks commented on PR #7194: URL: https://github.com/apache/iceberg/pull/7194#issuecomment-1483347111
I think there's a more fundamental consideration that we need to address here which is that this is introducing something that we don't do in the Iceberg project: Invoke an external provider to perform operations on behalf of the library. While Iceberg provides procedures and integration to perform certain executions (like rewrite data files), it does not actually execute them in response to some form of stimulus. While I understand the issues associated with small files, I don't feel that this is a generalizable approach that we would want to standardize on especially because it involves a very specific provider and services. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
