autoCAT6 opened a new pull request, #18617: URL: https://github.com/apache/iceberg/pull/18617
Spark metadata deletes can remove NULL rows excluded by SQL when ordinary comparisons or negated predicates are converted to Iceberg expressions. Use separate DELETE conversion that preserves SQL NULL semantics through boolean composition, while keeping scan conversion unchanged and falling back for unsupported predicates. The change covers Spark 3.5, 4.0, 4.1 and 4.2. The separate partitioned prefix residual NPE in #18412 remains unchanged. Addresses #18605. Test plan: * Reproduced the incorrect deletion on original production code in all four profiles. * Full filter and DELETE suites: 608 passed, 8 existing format version skips. * All four module builds, Checkstyle and Spotless passed. **AI Disclosure** * [x] AI generated AI was used for the DELETE conversion, regression tests, and PR description. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
