skrcode opened a new pull request, #17850: URL: https://github.com/apache/iceberg/pull/17850
Companion fix for #17777. Parquet 1.18 writes IEEE-754 total-order statistics by default for float and double columns. That makes the existing `<= 1.0` row-group expectations stale for data containing only `2.0` and NaN: the Parquet row group can now be safely pruned, while ORC remains conservative. This behavior follows the Parquet work in [apache/parquet-java#3393](https://github.com/apache/parquet-java/pull/3393) and [apache/parquet-java#3699](https://github.com/apache/parquet-java/pull/3699). This change: - aligns the two float/double row-group assertions with Parquet 1.18's ordered statistics; - regenerates all seven affected Flink, Spark, and Kafka Connect runtime-dependency baselines with the repository's `-DallModules` task. There are no production-code or dependency-set changes in this companion commit. Each generated manifest records only the same eight existing Parquet artifacts moving from runtime version `1.17` to `1.18`. Verification on JDK 17: - exact Dependabot head reproduced both Parquet failures (2 failures among the 4 focused Parquet/ORC cases); - candidate focused run passed all 4 cases; - `./gradlew :iceberg-data:test :iceberg-kafka-connect:iceberg-kafka-connect-runtime:checkRuntimeDeps spotlessCheck` passed (805 `iceberg-data` tests, 0 failures/errors; 124 Gradle tasks); - `./gradlew -DallModules checkAllRuntimeDeps spotlessCheck` passed (192 Gradle tasks); - `./gradlew -DallModules build -x test -x integrationTest` passed (602 Gradle tasks), covering all-module assembly, checkstyle, compatibility, class-uniqueness, and runtime-dependency checks. --- **AI Disclosure** - Model: GPT-5.6 - Platform/Tool: OpenAI Codex - Human Oversight: unreviewed - Prompt Summary: Complete a failing Dependabot Parquet 1.18 upgrade with a minimal behavior-aligned fix and repository-native verification. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
