I have been closely following the development of the Fluss project. As a columnar stream storage engine with real-time update capabilities, Fluss addresses a critical need in the industry. Having been deeply involved in several stream processing projects, I believe Fluss has the potential to make a significant impact. Over the past year, the open-source community around Fluss has shown impressive momentum and engagement. I’m excited about the prospect of Fluss joining the Apache Incubator and look forward to its continued growth and success.
Best, Leonard Xu > 2025 5月 21 23:20，Becket Qin <becket....@gmail.com> 写道： > > Fluss is devoted to providing a unified storage and has a healthy > community. I am glad to see it joining the Apache incubator. > > Cheers, > > Jiangjie (Becket) Qin > > On Wed, May 21, 2025 at 6:07 AM tison <wander4...@gmail.com> wrote: > >> Fluss has a firm community base; I'm glad to see this proposal :D >> >> Best, >> tison. >> >> >> yuxia <luoyu...@alumni.sjtu.edu.cn> 于2025年5月21日周三 21:02写道： >> >>> Hi Yu, >>> >>> Thanks for driving this discussion. As a core developer of Fluss, I'm >>> thrilled to see this proposal submitted, and look forward to incubating >> of >>> Fluss. >>> >>> Having actively participated in Fluss' development for around half a year >>> since its open-source release, I firmly believe our practices align with >>> "The Apache Way". We maintain all architectural discussions and design >>> decisions in public forums, while actively mentoring newcomers to foster >>> inclusive community growth. >>> >>> Under Apache's neutral governance, I believe Fluss will evolve into a >>> truly vendor-neutral solution empowering real-time analytics. Look >> forward >>> to to collaborating with mentors and the community. >>> >>> >>> Best regards, >>> Yuxia >>> >>> ----- 原始邮件 ----- >>> 发件人: "Hongshun Wang" <loserwang1...@gmail.com> >>> 收件人: general@incubator.apache.org >>> 发送时间: 星期三, 2025年 5 月 21日 下午 5:38:14 >>> 主题: [SPAM]RE: [DISCUSS] Incubating Proposal of Fluss >>> >>> Thanks Yu for driving this discussion. I have waiting for a long time. >>> >>> Best, >>> Hongshun >>> >>> On 2025/05/21 08:43:22 Yu Li wrote: >>>> Hi All, >>>> >>>> >>>> I would like to propose Fluss [1] as a new apache incubator project, >> and >>>> you can find the proposal [2] of Fluss for more details. >>>> >>>> >>>> Fluss is a distributed storage service designed to deliver high >>> throughput >>>> and sub-second latency for streaming read and write operations. It aims >>> to >>>> provide a unified data layer that bridges real-time processing with >> data >>>> lakehouse architectures. Building real-time analytics pipelines on top >>> of a >>>> data lakehouse requires key capabilities such as tabular query support, >>>> efficient data updates, changelog subscriptions, and the ability to >>>> periodically snapshot data into lake file formats like Apache Iceberg >> and >>>> Apache Paimon — functionalities that existing message queue systems >> such >>> as >>>> Apache Kafka are not well suited to address. >>>> >>>> >>>> To tackle these challenges, Fluss offers the following features: >>>> >>>> >>>> 1. *Table-Oriented Data Model, Not Topics.* Unlike traditional >> messaging >>>> systems that rely on topics, Fluss treats tables as first-class >> citizens, >>>> aligning its data model with that of modern data lakehouses. >>>> >>>> 2. *Columnar Stream Storage.* By storing streaming data in a columnar >>>> format (specifically Apache Arrow), Fluss achieves up to 10x faster >> read >>>> performance for analytical queries over streaming data. >>>> >>>> 3. *Real-Time Updates and Changelog Subscription.* Fluss natively >>> supports >>>> data updates and generates fine-grained changelogs, enabling >> low-latency >>>> incremental stream processing and state synchronization. >>>> >>>> 4. *Streaming & Lakehouse Unification.* Fluss enhances the stream >>>> processing capabilities of lakehouse architectures by seamlessly >>> supporting >>>> both real-time ingestion and historical analysis within a single >> system. >>>> >>>> >>>> Fluss is currently deployed in production environments at Alibaba and >>> many >>>> other companies, where it has reduced total operational costs by up to >>> 80% >>>> compared to traditional message queue systems in a variety of use >> cases. >>> In >>>> addition, the project has gained traction in the open-source community, >>>> with active adoption from organizations such as ByteDance, AntGroup, >>>> Ververica, eBay, Dynatrace, and Dream11. Many of these users have also >>>> contributed code and improvements, helping to form a vibrant and >> growing >>>> community with dozens of active developers. >>>> >>>> >>>> The proposed initial committers are eager to join the Apache Software >>>> Foundation (ASF) to foster broader collaboration and further strengthen >>> the >>>> community. We believe that bringing Fluss into the Apache Incubator >> will >>>> unlock significant value for the broader open-source ecosystem. >>>> >>>> >>>> I am honored to serve as the champion for this project and will mentor >> it >>>> alongside three additional mentors (many thanks to them all): >>>> >>>> >>>> * Becket Qin (j...@apache.org) >>>> >>>> * Jingsong Lee (lzljs3620...@apache.org) >>>> >>>> * Zili (Tison) Chen (ti...@apache.org) >>>> >>>> >>>> Look forward to your feedback. Thanks. >>>> >>>> Best Regards, >>>> Yu >>>> >>>> [1] https://github.com/alibaba/fluss >>>> >>>> [2] >> https://cwiki.apache.org/confluence/display/INCUBATOR/FlussProposal >>>> >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org >>> For additional commands, e-mail: general-h...@incubator.apache.org >>> >>> >>
