mayc0202 commented on issue #78:
URL:
https://github.com/apache/doris-kafka-connector/issues/78#issuecomment-3051250920
> Try deleting this? sink.properties.columns
我按照您的配置，去掉哪些多余的。重新启动kafka、connector，mysql重新创建一张app_user表，随机生成10条记录。清空doris中app_user表数据。启动服务，将10条数据同步到doris中。接着一条一条的删除mysql中记录，doris中成功的删除了7条数据，还有3条未删除。试了几遍，有时候删除成功4条记录，这让我很费解。如下是连接器配置：
{
"connector.class": "org.apache.doris.kafka.connector.DorisSinkConnector",
"doris.topic2table.map": "SERVER279_.xqh-ddtt.app_user2:app_user",
"doris.http.port": "8030",
"doris.user": "test_user",
"tasks.max": "1",
"topics": "SERVER279_.xqh-ddtt.app_user2",
"buffer.flush.time": "1",
"doris.urls": "192.168.1.161",
"doris.query.port": "9030",
"enable.delete": "true",
"key.converter.schemas.enable": "false",
"doris.database": "test_db",
"buffer.count.records": "20",
"doris.password": "123456",
"value.converter.schemas.enable": "true",
"converter.mode": "debezium_ingestion",
"value.converter": "org.apache.kafka.connect.json.JsonConverter",
"key.converter": "org.apache.kafka.connect.storage.StringConverter"
}
如下是kafka中删除记录
<img width="2196" height="1172" alt="Image"
src="https://github.com/user-attachments/assets/7fb55885-4b94-4165-84a4-b0cd5e1f9484";
/>
如下是doris中未删除记录
<img width="2202" height="1098" alt="Image"
src="https://github.com/user-attachments/assets/ffa3d951-0a30-446e-8f2b-d683f34c446d";
/>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
