steveloughran commented on issue #10340: URL: https://github.com/apache/iceberg/issues/10340#issuecomment-2374626461
> we solved it is by using HadoopFileIO instead. we put a lot of effort into making S3 stack traces go away, usually adding more handling one support call at a time. Special mention for openssl there. You aren't using it underneath are you? Now that you are using the S3A connector, if you can adopt parquet 14.1 *and* hadoop-3.4.0 then you switch parquet to using hadoop's vector IO for a significant speedup in parquet reads. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org