liurenjie1024 commented on issue #777: URL: https://github.com/apache/iceberg-rust/issues/777#issuecomment-2564153339
Thanks @ZENOTME for raising this. > The partition in DataFile should include types to facilitate validation. e.g. the field name and field id Do you mean we should maintain a partition schema in `DataFile` struct, or do you mean to maintain it in serialized format? > Append operations need to add validation checks for scheme evolution: lower bounds, upper_bound. I'm also confusing about this part. I think it's reasonable to validate that the arrow record batch's schema matches current table schema we are using. But doing schema evolution at the time of writing doesn't sound like a good idea to me. They should be two transaction updates. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
