charliec05 opened a new pull request, #18284: URL: https://github.com/apache/iceberg/pull/18284
The non-dictionary decimal regression added in #16501 currently runs only for Spark 4.1 and 4.2. Add the same integration scenario for Spark 3.5 and 4.0, following the review discussion, to guard reads of decimal columns whose schemas carry default values. The shared Arrow fix is already present; no production behavior changes. Related: #16502 Test plan: Write non-dictionary Parquet data with default-bearing int-, long-, and fixed-backed decimal columns, then verify vectorized reads in both versions. Temporarily reverting the shared Arrow fix makes all six new/inherited cases fail with the original default-value cast error. After restoring it, the base reader suites and inherited regressions pass (201 passed, 296 skipped), along with Spotless and Checkstyle. --- **AI Disclosure** - Model: GPT-5 - Platform/Tool: OpenAI Codex - Human Oversight: fully reviewed (manual code review confirmed by the author). - Prompt Summary: The author set the contribution goals and constraints, approved the scope, and manually reviewed the changes. Codex adapted the existing Spark 4.1 regression for Spark 3.5/4.0 and ran the validation. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
