raunaqmorarka opened a new pull request, #18540: URL: https://github.com/apache/iceberg/pull/18540
Tasks.waitFor sleeps 10 ms whenever any of its futures is still running, and a commit calls it several times. Against a local REST catalog with S3-compatible storage, a one-file merge append now commits in about 20 ms instead of 80 ms. A fast append takes about 20 ms instead of 52 ms. In Trino on Iceberg 1.11.0, a 50-row insert went from 209 ms to 179 ms. waitFor now blocks on each unfinished future with Future.get() instead of sleeping. Task failures and cancellations are still collected after every task finishes. Interrupts are handled as before. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
