Hi devs： On the roadmap mentioned above, with the maturity of flink/hive/spark catalog technology, catalog can greatly improve user experience. I think we should add a function of catalog management to the roadmap. @Huajie Wang，Do you agree？
> 2024年3月27日 17:01，Huajie Wang <[email protected]> 写道： > > hi devs: > > Apache Paimon has graduated to become a top-level Apache project. we > can plan to better support paimon > > > 2024 roadmap: > > 1. Support for PyFlink > 2. Support for Flink CDC 3.0 > 3. Refactor Flink on k8s using k8s-operator > > 4. Integrate Flink sql-gateway > > 5. Support for Apache Spark(Development framework and platform) 6. Document > improvements > > 7. Graduate Apache StreamPark (Incubating) as a TLP > > 8. Apache Flink Metrics monitoring solutions > > 9. Support Paimon > > > Best, > Huajie Wang > > > > Huajie Wang <[email protected]> 于2024年3月25日周一 10:37写道： > >> hi: >> >> Welcome back here, The discussion is expected to end this week. Feel free >> to join the discussion if you have any new ideas. >> >> >> >> Best, >> Huajie Wang >> >> >> >> Huajie Wang <[email protected]> 于2024年3月4日周一 11:19写道： >> >>> +1 >>> >>> Metrics Monitoring are very important foundational capabilities. Apache >>> StreamPark(Incubating) needs to address this part of the capability better. >>> I strongly agree with this proposal. >>> >>> 2024 roadmap: >>> >>> 1. Support for PyFlink >>> 2. Support for Flink CDC 3.0 >>> 3. Refactor Flink on k8s using k8s-operator >>> >>> 4. Integrate Flink sql-gateway >>> >>> 5. Support for Apache Spark(Development framework and platform) 6. >>> Document improvements >>> >>> 7. Graduate Apache StreamPark (Incubating) as a TLP >>> >>> 8. Apache Flink Metrics monitoring solutions >>> >>> >>> Best, >>> Huajie Wang >>> >>> >>> >>> shun SUN <[email protected]> 于2024年3月4日周一 11:07写道： >>> >>>> Hi >>>> >>>> Thanks for the roadmap sharing, LGTM! >>>> >>>> Is it possible to add one point: provide monitoring solutions for Flink >>>> jobs on yarn as well Kubernetes? >>>> >>>> I would like to take this part in coming months. >>>> >>>> Thanks and regards >>>> Sun Shun >>>> >>>> On Mon, 4 Mar 2024 at 10:58 AM, Huajie Wang <[email protected]> wrote: >>>> >>>>> I agree with your proposal: >>>>> >>>>> 1. Support for PyFlink >>>>> 2. Support for Flink CDC 3.0 >>>>> 3. Refactor Flink on k8s using k8s-operator >>>>> >>>>> 4. Integrate Flink sql-gateway >>>>> >>>>> 5. Support for Apache Spark(Development framework and platform) 6. >>>> Document >>>>> improvements >>>>> >>>>> 7. Graduate Apache StreamPark (Incubating) as a TLP >>>>> >>>>> Welcome more discussions! >>>>> >>>>> >>>>> >>>>> Best, >>>>> Huajie Wang >>>>> >>>>> >>>>> >>>>> Cancai Cai <[email protected]> 于2024年3月2日周六 19:34写道： >>>>> >>>>>> This looks good, +1. >>>>>> A small suggestion, should document improvements also be put into the >>>>> 2024 >>>>>> roadmap? >>>>>> >>>>>> Huajie Wang <[email protected]> 于2024年3月2日周六 18:53写道： >>>>>> >>>>>>> Hello everyone: >>>>>>> >>>>>>> The support capability of Apache StreamPark for Apache Flink has >>>> been >>>>>>> increasingly improved and stable., with more and more enterprise >>>> users >>>>>>> using it. This is the effort of all developers, and we are >>>> delighted >>>>>>> to see this. Now I would like to initiate a discussion on the >>>>>>> StreamPark 2024 roadmap, welcoming everyone to participate and >>>> share >>>>>>> their opinions. >>>>>>> >>>>>>> Here are some new features I have in mind for 2024: >>>>>>> >>>>>>> 1. Support for PyFlink >>>>>>> 2. Support for Flink CDC 3.0 >>>>>>> 3. Refactor Flink on k8s using k8s-operator >>>>>>> >>>>>>> 4. Integrate Flink sql-gateway >>>>>>> >>>>>>> 5. Support for Apache Spark(Development framework and platform) >>>>>>> >>>>>>> Looking forward to your opinion. Let's make Apache StramPark even >>>>> better >>>>>> in >>>>>>> 2024! 🚀 >>>>>>> >>>>>>> >>>>>>> Best, >>>>>>> Huajie Wang >>>>>>> >>>>>> >>>>> >>>> >>>
