pvary commented on PR #8803: URL: https://github.com/apache/iceberg/pull/8803#issuecomment-1770262566
> I understand the current code is for metadata column selection/projection, not the columns selected to include stats My understanding is that the planning might need stats which are not required by the user. Based on this for changing the stat retrieval here: - We need some more complicated decision tree for which column stats to keep (union of the user requested stats, and the planning required stats) - We (might) need to do the selective copy of the stats later again to remove the planning required stats which are not requested by the user. This might have a detrimental performance impact. This change improves on memory consumption anyway. If we think that we need even more improvement and we accept the extra complexity we can add this feature later. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
