DengYiping opened a new pull request, #18446: URL: https://github.com/apache/iceberg/pull/18446
Fields rejected for shredding currently consume the 300-field budget, potentially excluding consistently typed fields. With 300 mixed integer/string fields, a stable integer field disappears entirely from the inferred schema. Prune fields without a shredded representation before applying the cap, including objects and arrays whose contents cannot shred. Preserve frequency ranking and alphabetical tie-breaking. Test plan: - Reproduce the failure at the 299/300 mixed-field boundary. - Cover unshreddable objects and arrays. - Verify frequency ranking, alphabetical selection, and independence from row order. Validation: parquet tests passed (754 passed, 9 skipped), along with Spotless and main/test Checkstyle checks. --- **AI Disclosure** - Model: GPT-6 - Platform/Tool: Codex - Human Oversight: unreviewed - Prompt Summary: Reproduce and surgically fix rejected fields consuming the shredding budget. Analyzer changes and regression tests were generated by Codex. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
