mattfaltyn opened a new pull request, #3508: URL: https://github.com/apache/iceberg-rust/pull/3508
## Which issue does this PR close? Closes #3355. ## What changes are included in this PR? `<` and `<=` keep every row when an optional column is absent from a Parquet file, even though the same column stored as NULL matches no rows. Treat the absent column as NULL when it has no initial default or non-null identity partition value. Required-field validation and existing default/partition-constant handling are preserved. The broader evaluation of non-null missing values remains in #3302; this fix can land independently. ## Are these changes tested? The three-row audit reproduction now passes all 32 comparison configurations, including row-group/page pruning switches and projected/filter-only columns; it failed 16 configurations before the fix. Repository regression tests and full local/CI validation are being completed before this draft is marked ready. ## AI Disclosure Codex assisted with investigation, implementation, tests, and this description. Review should focus on preserving required-field errors and default/identity-partition behavior while changing only the known-NULL comparison fallback. Non-null missing-value filtering and null-partition/default precedence remain outside this fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
