bhupixb commented on issue #9193: URL: https://github.com/apache/iceberg/issues/9193#issuecomment-1837959214
@pvary We have tried increasing the memory already, but it didn't help. We are also unable that understand where it's consuming this much memory. Also, there are a total of ~350 files that have a total ~4 GB of data(after decompression). 1. In flink our Task Manager is 16 GB Memory, and it still get OOM. 2. In trino we have 4 workers, each 20 GB memory(essentially heap), and they also get OOM when running `alter table <table> execute optimize;`; -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
