mark-major opened a new issue, #1294:
URL: https://github.com/apache/iceberg-python/issues/1294

   ### Feature Request / Improvement
   
   I have experienced throttling exceptions when multiple nodes are reading and 
writing an Iceberg table with a Glue catalog. I have wrapped my calls in a 
retry wrapper, but this functionality should be implemented in the library 
instead.
   
   I would add an option to the Glue catalog constructor to define the maximum 
number of retries and set the boto retry policy to standard instead of the 
default legacy. Standard is adding jitter to the retry interval which would 
ensure independent processes won't block each other ([Thundering herd 
problem](https://en.m.wikipedia.org/wiki/Thundering_herd_problem))


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to