singhpk234 opened a new pull request, #19001:
URL: https://github.com/apache/iceberg/pull/19001

   Backport referenced-by from Spark 4.2. With
   spark.sql.iceberg.referenced-by.enabled, tables and views read through an 
Iceberg view are loaded with a LoadContext carrying the referencing view chain, 
so REST catalogs can send referenced-by. Spark 4.1 keeps the chain when tables 
are reloaded before execution.
   
   Spark before 4.2 has no relation catalog API, so Iceberg's ResolveViews 
expands views itself. It now expands them like Spark's own views: the view body 
is parsed and analyzed with the SQL configs captured at creation, columns bind 
by the stored query column names, and nested views fail at 
spark.sql.view.maxNestedViewDepth instead of overflowing the stack. CREATE VIEW 
captures SQL configs with the keys Spark 4.2 uses, and Spark 4.0 and 4.1 reject 
schema modes Iceberg views cannot honor.
   
   Generated-by: Claude Code


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to