gitzwz commented on PR #11280: URL: https://github.com/apache/iceberg/pull/11280#issuecomment-2406797716
This works well when table's schema is over 1k, and when there is a need to read table specs & schema after table scan. In our case(2k column, 25.9TB, 460,000 files), this can reduce the time required to get all specs after tableScan from over 10 min to 30s. @aokolnychyi @RussellSpitzer please take a look when you have time~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
