suxiaogang223 opened a new pull request, #70385: URL: https://github.com/apache/doris/pull/70385
### Background The Iceberg Docker stack runs Spark 4.0.0 to generate Paimon regression fixtures and read back Doris writes. Its Paimon 1.4.2 jars currently come from a versioned data archive, while master already uses Paimon 2.1.0 in Doris. ### What problem does this PR solve? Issue Number: None Related PR: None PR Type: Release/Dependency Problem Summary: Align the Docker Spark fixture with Paimon 2.1.0. Download the Spark connector and S3 plugin separately with pinned SHA-256 checksums, retain the existing data archive, and explicitly enable path-style access for MinIO. ### Details - **Versions:** Paimon Spark 4.0 / Scala 2.13 connector and S3 plugin move from 1.4.2 to 2.1.0; Spark stays at 4.0.0. - **Upstream changes:** Exercise the Paimon 2.1.0 runtime already used by Doris master in the external regression fixture. - **Compatibility:** All 14 existing fixture SQL files pass. All 19 partition row counts, file sizes and file counts match current regression expectations. Fluss and Hive compatibility fixtures keep their own versions. - **Rollback:** Revert this commit to restore the archive-provided 1.4.2 jars. - **Behavior change:** Docker startup downloads missing or corrupt Paimon jars through the existing Maven repository override and stops on checksum mismatch. Verified cached jars are reused. ### Testing Locally passed bash -n and git diff --check. Docker Compose config renders two existing read-only 2.1.0 jar mounts. Verified offline cache reuse, fresh download with repository override and trailing slash, checksum rejection and temporary-file cleanup. Ran all 14 unchanged Paimon fixture SQL files using apache/spark:4.0.0 and isolated MinIO; checked Variant/nested fixture counts and compared all 19 partition metadata entries with regression expectations. No Doris build or full FE/BE regression run. ### Release note None ### Check List (For Author) - Behavior changed: Yes (see Details) - Does this need documentation: No - Pre-submission status: Partially verified: Docker fixture checks passed; full Doris FE/BE regression not run. ### AI Disclosure - Tool: Codex (GPT-6) - Generated: Docker configuration, download helper, documentation and commit description. - Human review: Pending. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
