shangeyao opened a new pull request, #4368:
URL: https://github.com/apache/streampark/pull/4368
<!--
Thank you for contributing to StreamPark! Please make sure that your code
changes
are covered with tests. And in case of new features or big changes
remember to adjust the documentation.
## Contribution Checklist
- If this is your first time, please read our contributor guidelines:
[Submit Code](https://streampark.apache.org/community/submit_guide/submit_code).
- Make sure that the pull request corresponds to a [GITHUB
issue](https://github.com/apache/streampark/issues).
- Name the pull request in the form "[Feature] Title of the pull request",
where *Feature* can be replaced by `Hotfix`, `Bug`, etc.
- Fill out the template below to describe the changes contributed by the
pull request. That will give reviewers the context they need to do the review.
- If the PR is unfinished, add `[WIP]` in your PR title, e.g.,
`[WIP][Feature] Title of the pull request`.
-->
## What changes were proposed in this pull request
Issue Number: close #4367
This pull request adds support for Apache Flink 2.x series (2.0, 2.1, 2.2)
to StreamPark.
## Brief change log
- Extend `FlinkVersion.scala` to recognize Flink 2.x versions
- Create new shims modules: `streampark-flink-shims_flink-2.0`,
`streampark-flink-shims_flink-2.1`, `streampark-flink-shims_flink-2.2`
- Migrate to Java DataStream API (Scala DataStream API removed in Flink 2.x)
- Handle `ParameterTool` relocation from `org.apache.flink.api.java.utils`
to `org.apache.flink.util`
- Implement Flink 2.1 Model API (`createModel`, `fromCall`, etc.)
- Implement Flink 2.2 `FunctionDescriptor` and Materialized Tables APIs
- Update console-service `EnvInitializer.java` regex to match 2.x shims JARs
- Add 2.0/2.1/2.2 shims JAR dependencies to console-service `pom.xml`
## Verifying this change
This change is already covered by existing tests, such as:
- All shims modules (1.12-1.20 + 2.0-2.2) compile successfully
- Unit tests in `streampark-flink-shims-test` pass
- Console service compiles successfully
## Does this pull request potentially affect one of the following parts
- Dependencies (does it add or upgrade a dependency): yes (adds Flink
2.0.2, 2.1.2, 2.2.1 dependencies)
- The `FlinkVersion.scala` version detection logic: yes
- The shims module structure: yes (adds 3 new modules)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
