Re: [Discuss][DSIP] Support load binlog from MySQL directly without relying other service

This does lower the threshold for users, but at the same time will this bring additional load to doris and what impact will it have If this is the case are we supporting the delete operation in one piece -- Original -- From: Xu,Yang(INF) https://cwiki.apache.

Re: [Discuss][DSIP] Support load binlog from MySQL directly without relying other service

t; use a MPP database as a MySQL's slave. It's not the same background with >> Flink  >> Connector. >> >> >> >> >> -- 原始邮件 -- >> 发件人: >>

Re:Re: [Discuss][DSIP] Support load binlog from MySQL directly without relying other service

nt >> experience to >> use a MPP database as a MySQL's slave. It's not the same background with >> Flink  >> Connector. >> >> >> >> >> ------ 原始邮件 ------ >> 发件人: >> "dev" >>

Re: [Discuss][DSIP] Support load binlog from MySQL directly without relying other service

; > < > lingm...@apache.org>; > 发送时间: 2022年3月29日(星期二) 晚上8:13 > 收件人: "dev" > 主题: Re: [Discuss][DSIP] Support load binlog from MySQL directly > without relying other service > > > > Hi hui,

Re:回复： [Discuss][DSIP] Support load binlog from MySQL directly without relying other service

data.  > > > > >-- 原始邮件 -- >发件人: > "dev" > 发送时间: 2022年3月29日(星期二) 晚上8:38 >收件人: "dev@doris.apache.org&q

回复： [Discuss][DSIP] Support load binlog from MySQL directly without relying other service

Hi Yang, I have not found any library we can use. Maybe it's a lot of work to put it on BE. I think it's not necessary to put it in BE, Because we can distribute the sync job into  other FE instead of Master, and user can use Flink Connector if there is still too much data. 

?????? [Discuss][DSIP] Support load binlog from MySQL directly without relying other service

Hi Ling,  Do you mean 'canal' component? I have not cancelled any component,  only extended current binlog load with a new type of 'debezium'. Because the Canal service is not provided in my company's product environment, users can't use the current binlog load. I think the new type simplifies th

Re: [Discuss][DSIP] Support load binlog from MySQL directly without relying other service

Hi hui, Thanks for the pr. Is there any way to integrate the binlog aquire and parse function into Be, instead of Fe? 在 2022/3/29 下午8:13，“ling miao” 写入: Hi hui, I want to know what is the reason for canceling the cancel component? Is there any problem in use? What are the benefits

Re: [Discuss][DSIP] Support load binlog from MySQL directly without relying other service

Hi hui, I want to know what is the reason for canceling the cancel component? Is there any problem in use? What are the benefits ? Parsing binlog is not actually the function of Doris itself. Or is it better to appear as a connector? For example, like Flink connector. Ling Miao 陈明雨 于2022年3月29日

??????[Discuss][DSIP] Support load binlog from MySQL directly without relying other service

Hi, I have registered my account, and my cwiki account is `tianhui`. Thanks! -- Hui Tian --  -- ??: "dev"

Re:[Discuss][DSIP] Support load binlog from MySQL directly without relying other service

Hi Hui, Thanks for it. Could you register a cwiki acount and tell me your account id? So that I can create DSIP and grant write priv for you. https://cwiki.apache.org/confluence/signup.action -- 此致！Best Regards 陈明雨 Mingyu Chen Email: chenmin...@apache.org At 2022-03-29 18:17:02, "晖" <82

[Discuss][DSIP] Support load binlog from MySQL directly without relying other service

As issue #8025(https://github.com/apache/incubator-doris/issues/8025) mentioned, the current binlog load is relying on Canal service. We can integrate the binlog aquire and parse function into Doris, so that user can be more convinience to use it.Please determine the final DSIP number for it.