shangeyao commented on issue #4408: URL: https://github.com/apache/streampark/issues/4408#issuecomment-5174195274
## Progress Update (2026-08-04) **Overall:** **Stage 1 & Stage 2 (Flink) remain complete on `dev`.** Post-migration cleanup **#4471 is merged** (2026-08-03). Flink version baseline work continues on PR [#4419](https://github.com/apache/streampark/pull/4419), aligned with the post-Scala Java artifact model. ### Milestone table (updated) | Milestone | Issue | PR | Status | |-----------|-------|-----|--------| | `streampark-common` | #4445 | #4458 | ✅ Merged | | `streampark-flink-core` | #4446 | — | ✅ Closed (N/A — removed in #4432) | | `streampark-flink-shims` | #4447 | #4461 | ✅ Merged | | `streampark-flink-sqlclient` | #4448 | #4462 | ✅ Merged | | `streampark-flink-packer` | #4449 | #4463 | ✅ Merged | | `streampark-flink-proxy` | #4450 | #4464 | ✅ Merged | | `streampark-flink-kubernetes` | #4451 | #4465 | ✅ Merged | | `streampark-flink-client` | #4452 | #4467 | ✅ Merged | | Flink post-migration cleanup | #4470 | #4471 | ✅ **Merged** (2026-08-03) | | Flink 1.17+ / 2.x version track | #4421 | #4419 | 🔄 PR open — build + tests green, awaiting review | | `streampark-spark` | #4453 | — | ⏳ Deferred (15 `.scala` files) | ### Scala inventory (branch `feature/flink-1.17-plus`, 2026-08-04) | Area | `.scala` files | Notes | |------|----------------|-------| | All `streampark-flink/*` | **0** | ✅ | | `streampark-common` | **0** | ✅ | | `streampark-spark` | **15** | ⏳ #4453 | | `streampark-common-scala-bridge` | **2** | Intentional — Logger/Implicits for Spark interop | | **Total** | **17** | Down from ~240 baseline | ### Recent fixes on #4419 branch (Flink + build integration) - Root POM full build restored after Java artifact rename (`streampark-common-scala-bridge`, Spark/Console POM alignment). - Console **dist assembly** still ships scala runtime jars (`scala-library` / `compiler` / `reflect`) — required because Spark modules remain Scala; without them dist fails at startup (`ClassNotFoundException: scala.Product`). Tracked in `75f034548`. - Full unit suite, LICENSE check, and 13 E2E cases pass locally on M1. ### Goals checklist (delta since 2026-08-03) - [x] Remove Scala from Flink build toolchain on `dev` (#4471 merged) - [x] Preserve Console Flink operations on Java codebase - [ ] Eliminate **all** Scala source (Spark + bridge remain — **17 files**) - [ ] User migration guide for Scala-based jobs ### Next steps 1. Merge **#4419** (Flink version baseline — #4421). 2. Pick up **#4453** (`streampark-spark` Scala → Java) when ready. 3. Remove `streampark-common-scala-bridge` after Spark migration completes. Cross-ref: #4421 · #4419 · #4471 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
