Fokko commented on PR #2333: URL: https://github.com/apache/iceberg-python/pull/2333#issuecomment-3196023989
Fun with timestamps, it is a gift that keeps on giving! :D This is the reference page that I used most of the time: https://cwiki.apache.org/confluence/display/Hive/Different+TIMESTAMP+types The thing is that, as you mentioned, we don't store the timestamp in Iceberg. And according to [spec](https://iceberg.apache.org/spec/#parquet) the timezone should not be set. But in Arrow we _allow_ reading UTC timezones, for example, when you import an existing table then you don't want to rewrite all the data. This is a bit of a slippery slope though, I think supporting UTC should be safe (that was the intend of https://github.com/apache/iceberg-python/pull/910), but anything other than UTC is not supported (and probably should be rewritten). Do we know how Java handles this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
