braislchao commented on PR #11174: URL: https://github.com/apache/iceberg/pull/11174#issuecomment-2598160288
Hey! Just a quick follow up: I encountered the same issue when using the files generated by the connector with Spark, and I came to the same conclusion as @kumarpritam863 : configuring a property in my custom connector and now using it in production. Regarding making this functionality available, as @bryanck says, we can include a simple SMT that transforms all the fields in the key/value that are of type Time into long or Timestamp from epoch. Maybe is not as efficient but it separates the logic from the connector itself. I can handle this in a separate PR, but first, it's necessary that the SMTs be merged as part of the Iceberg repo: https://github.com/apache/iceberg/pull/11936 Let me know if you have any other idea @kumarpritam863 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
