gaborkaszab commented on PR #16207: URL: https://github.com/apache/iceberg/pull/16207#issuecomment-4380914574
Thanks you for the explanation, @grantatspothero ! I feel that ~100k snapshot tables are at the very extreme end of use-cases. I'm wondering if the table is changed every 30sec, then is there any point storing it in a cache. We'd need to reload it frequently anyway. I wanted to advise you to reach out to the dev@ list to see wider community feedback on this. I see you've already done so, thanks! I can take a look at the code, if the improvement is simple enough, I don't see why not to include. If it's messy or complicated, we might need some community support to get it through. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
