Hi, devs. Thank you for the discussion and I'm happy to hear about so much exciting comments. Perhaps we should support the availability of high availability . BTW, Should we make a ordered list for the suggestions mentioned by corresponding priority before concluding this discussion ?
Best, Yuepeng Pan On 2024/03/27 09:53:59 wulin wrote: > Hi devs： > On the roadmap mentioned above, with the maturity of flink/hive/spark catalog > technology, catalog can greatly improve user experience. I think we should > add a function of catalog management to the roadmap. @Huajie Wang，Do you > agree？ > > > 2024年3月27日 17:01，Huajie Wang <[email protected]> 写道： > > > > hi devs: > > > > Apache Paimon has graduated to become a top-level Apache project. we > > can plan to better support paimon > > > > > > 2024 roadmap: > > > > 1. Support for PyFlink > > 2. Support for Flink CDC 3.0 > > 3. Refactor Flink on k8s using k8s-operator > > > > 4. Integrate Flink sql-gateway > > > > 5. Support for Apache Spark(Development framework and platform) 6. Document > > improvements > > > > 7. Graduate Apache StreamPark (Incubating) as a TLP > > > > 8. Apache Flink Metrics monitoring solutions > > > > 9. Support Paimon > > > > > > Best, > > Huajie Wang > > > > > > > > Huajie Wang <[email protected]> 于2024年3月25日周一 10:37写道： > > > >> hi: > >> > >> Welcome back here, The discussion is expected to end this week. Feel free > >> to join the discussion if you have any new ideas. > >> > >> > >> > >> Best, > >> Huajie Wang > >> > >> > >> > >> Huajie Wang <[email protected]> 于2024年3月4日周一 11:19写道： > >> > >>> +1 > >>> > >>> Metrics Monitoring are very important foundational capabilities. Apache > >>> StreamPark(Incubating) needs to address this part of the capability > >>> better. > >>> I strongly agree with this proposal. > >>> > >>> 2024 roadmap: > >>> > >>> 1. Support for PyFlink > >>> 2. Support for Flink CDC 3.0 > >>> 3. Refactor Flink on k8s using k8s-operator > >>> > >>> 4. Integrate Flink sql-gateway > >>> > >>> 5. Support for Apache Spark(Development framework and platform) 6. > >>> Document improvements > >>> > >>> 7. Graduate Apache StreamPark (Incubating) as a TLP > >>> > >>> 8. Apache Flink Metrics monitoring solutions > >>> > >>> > >>> Best, > >>> Huajie Wang > >>> > >>> > >>> > >>> shun SUN <[email protected]> 于2024年3月4日周一 11:07写道： > >>> > >>>> Hi > >>>> > >>>> Thanks for the roadmap sharing, LGTM! > >>>> > >>>> Is it possible to add one point: provide monitoring solutions for Flink > >>>> jobs on yarn as well Kubernetes? > >>>> > >>>> I would like to take this part in coming months. > >>>> > >>>> Thanks and regards > >>>> Sun Shun > >>>> > >>>> On Mon, 4 Mar 2024 at 10:58 AM, Huajie Wang <[email protected]> wrote: > >>>> > >>>>> I agree with your proposal: > >>>>> > >>>>> 1. Support for PyFlink > >>>>> 2. Support for Flink CDC 3.0 > >>>>> 3. Refactor Flink on k8s using k8s-operator > >>>>> > >>>>> 4. Integrate Flink sql-gateway > >>>>> > >>>>> 5. Support for Apache Spark(Development framework and platform) 6. > >>>> Document > >>>>> improvements > >>>>> > >>>>> 7. Graduate Apache StreamPark (Incubating) as a TLP > >>>>> > >>>>> Welcome more discussions! > >>>>> > >>>>> > >>>>> > >>>>> Best, > >>>>> Huajie Wang > >>>>> > >>>>> > >>>>> > >>>>> Cancai Cai <[email protected]> 于2024年3月2日周六 19:34写道： > >>>>> > >>>>>> This looks good, +1. > >>>>>> A small suggestion, should document improvements also be put into the > >>>>> 2024 > >>>>>> roadmap? > >>>>>> > >>>>>> Huajie Wang <[email protected]> 于2024年3月2日周六 18:53写道： > >>>>>> > >>>>>>> Hello everyone: > >>>>>>> > >>>>>>> The support capability of Apache StreamPark for Apache Flink has > >>>> been > >>>>>>> increasingly improved and stable., with more and more enterprise > >>>> users > >>>>>>> using it. This is the effort of all developers, and we are > >>>> delighted > >>>>>>> to see this. Now I would like to initiate a discussion on the > >>>>>>> StreamPark 2024 roadmap, welcoming everyone to participate and > >>>> share > >>>>>>> their opinions. > >>>>>>> > >>>>>>> Here are some new features I have in mind for 2024: > >>>>>>> > >>>>>>> 1. Support for PyFlink > >>>>>>> 2. Support for Flink CDC 3.0 > >>>>>>> 3. Refactor Flink on k8s using k8s-operator > >>>>>>> > >>>>>>> 4. Integrate Flink sql-gateway > >>>>>>> > >>>>>>> 5. Support for Apache Spark(Development framework and platform) > >>>>>>> > >>>>>>> Looking forward to your opinion. Let's make Apache StramPark even > >>>>> better > >>>>>> in > >>>>>>> 2024! 🚀 > >>>>>>> > >>>>>>> > >>>>>>> Best, > >>>>>>> Huajie Wang > >>>>>>> > >>>>>> > >>>>> > >>>> > >>> > >
