gaborkaszab commented on PR #13926: URL: https://github.com/apache/iceberg/pull/13926#issuecomment-3227195423
Thanks for the PR @gtrettenero! I think the change makes sense. I checked ReachableFileCleanup and it also uses planExecutorService to gather the manifests. One observation I have is that you mention that in case we have many manifests, reading can be slow, however, the improvement here is dependent on the number of snapshots (since the unit of parallelization is by snapshot) and not entirely the number of manifests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
