paulpaul1076 commented on issue #8721: URL: https://github.com/apache/iceberg/issues/8721#issuecomment-1751575139
Turns out that the problem is due to Spark caching its catalog, and since I updated the schema through iceberg's Java API instead of Spark, the cached value didn't get updated. Russell Spitzer also told me that we can disable caching by setting spark.sql.catalog.catalog-name.cache-enabled to false. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org