singhpk234 opened a new pull request, #19001: URL: https://github.com/apache/iceberg/pull/19001
Backport referenced-by from Spark 4.2. With spark.sql.iceberg.referenced-by.enabled, tables and views read through an Iceberg view are loaded with a LoadContext carrying the referencing view chain, so REST catalogs can send referenced-by. Spark 4.1 keeps the chain when tables are reloaded before execution. Spark before 4.2 has no relation catalog API, so Iceberg's ResolveViews expands views itself. It now expands them like Spark's own views: the view body is parsed and analyzed with the SQL configs captured at creation, columns bind by the stored query column names, and nested views fail at spark.sql.view.maxNestedViewDepth instead of overflowing the stack. CREATE VIEW captures SQL configs with the keys Spark 4.2 uses, and Spark 4.0 and 4.1 reject schema modes Iceberg views cannot honor. Generated-by: Claude Code -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
