qlong commented on PR #15385: URL: https://github.com/apache/iceberg/pull/15385#issuecomment-4504494697
### Branch update (May 21) Rebased this PR to a **single Spark-only commit** on current `main` (4 files: `SparkV2Filters`, `Spark3Util`, and tests). This keeps review scoped to DSv2 filter → `Expressions.extract()` pushdown and EXPLAIN output. **Merge order:** please merge #15384 first, then rebase this PR and re-run CI. The CI note in the description explains why `testDescribeExtractExpression` fails on `main` today (bracket paths from `PathUtil.toNormalizedPath()` in #15384 vs dot paths on current `main`). Earlier green Spark CI runs were on a branch stacked on #15384 — that was the right integration target but not the same as merging this PR alone. **Still depends on:** [apache/spark#54394](https://github.com/apache/spark/pull/54394) for Spark to pass `variant_get` into DSv2 filters. @huaxingao @aihuaxu PTAL when you have a chance. Thanks @nssalian for the review — addressing the import nit in the next push. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
