This is an automated email from the ASF dual-hosted git repository. diwu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push: new 2bec5485280 [fix](docs) Correct the parameter configuration errors in the Flink connector documentation (#1200) 2bec5485280 is described below commit 2bec5485280832768b8f617d37f40ab6eee971bf Author: Petrichor <31833513+vinle...@users.noreply.github.com> AuthorDate: Thu Oct 31 10:50:15 2024 +0800 [fix](docs) Correct the parameter configuration errors in the Flink connector documentation (#1200) --- common_docs_zh/ecosystem/flink-doris-connector.md | 6 +++--- ecosystem/flink-doris-connector.md | 6 +++--- 2 files changed, 6 insertions(+), 6 deletions(-) diff --git a/common_docs_zh/ecosystem/flink-doris-connector.md b/common_docs_zh/ecosystem/flink-doris-connector.md index c16a821c6d5..1b21bdd8148 100644 --- a/common_docs_zh/ecosystem/flink-doris-connector.md +++ b/common_docs_zh/ecosystem/flink-doris-connector.md @@ -376,7 +376,7 @@ ON a.city = c.city | Key | Default Value | Required | Comment | | --------------------------- | ------------- | -------- |---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | sink.label-prefix | -- | Y | Stream load 导入使用的 label 前缀。2pc 场景下要求全局唯一,用来保证 Flink 的 EOS 语义。 | -| sink.properties.* | -- | N | Stream Load 的导入参数。<br/>例如: 'sink.properties.column_separator' = ', ' 定义列分隔符, 'sink.properties.escape_delimiters' = 'true' 特殊字符作为分隔符,`\x01`会被转换为二进制的 0x01 <br/><br/>JSON 格式导入<br/>'sink.properties.format' = 'json' 'sink.properties.read_json_by_line' = 'true'<br/>详细参数参考[这里](../data-operate/import/stream-load-manual.md)。 | +| sink.properties.* | -- | N | Stream Load 的导入参数。<br />例如: 'sink.properties.column_separator' = ', ' 定义列分隔符, 'sink.properties.escape_delimiters' = 'true' 特殊字符作为分隔符,`\x01`会被转换为二进制的 0x01 。 <br /><br />JSON 格式导入<br />'sink.properties.format' = 'json' 'sink.properties.read_json_by_line' = 'true'<br />详细参数参考[这里](../data-operate/import/stream-load-manual.md)。<br /><br />Group Commit 模式 <br /> 例如:'sink.properties.group_commit' = 'sync_mode' 设置 group commit 为同步模式。fl [...] | sink.enable-delete | TRUE | N | 是否启用删除。此选项需要 Doris 表开启批量删除功能 (Doris0.15+ 版本默认开启),只支持 Unique 模型。 | | sink.enable-2pc | TRUE | N | 是否开启两阶段提交 (2pc),默认为 true,保证 Exactly-Once 语义。关于两阶段提交可参考[这里](../data-operate/import/stream-load-manual.md)。 | | sink.buffer-size | 1MB | N | 写数据缓存 buffer 大小,单位字节。不建议修改,默认配置即可 | @@ -577,8 +577,8 @@ insert into doris_sink select id,name,bank,age from cdc_mysql_source; | --use-new-schema-change | 是否使用新的 schema change,支持同步 MySQL 多列变更、默认值,1.6.0 开始该参数默认为 true。参考[#167](https://github.com/apache/doris-flink-connector/pull/167) | | --schema-change-mode | 解析 schema change 的模式,支持 `debezium_structure`、`sql_parser` 两种解析模式,默认采用 `debezium_structure` 模式。<br/><br/> `debezium_structure` 解析上游 CDC 同步数据时所使用的数据结构,通过解析该结构判断 DDL 变更操作。 <br/> `sql_parser` 通过解析上游 CDC 同步数据时的 DDL 语句,从而判断 DDL 变更操作,因此该解析模式更加准确。<br/> 使用例子:`--schema-change-mode debezium_structure`<br/> 本功能将在 1.6.2.1 后的版本中提供 | | --single-sink | 是否使用单个 Sink 同步所有表,开启后也可自动识别上游新创建的表,自动创建表。 | -| --multi-to-one-origin | 将上游多张表写入同一张表时,源表的配置,比如:`--multi-to-one-origin="a\_.\*\|b_.\*"`,具体参考[#208](https://github.com/apache/doris-flink-connector/pull/208) | -| --multi-to-one-target | 与 multi-to-one-origin 搭配使用,目标表的配置,比如:`--multi-to-one-target="a\`|b" | +| --multi-to-one-origin | 将上游多张表写入同一张表时,源表的配置,比如:`--multi-to-one-origin "a\_.\*\|b_.\*"`,具体参考[#208](https://github.com/apache/doris-flink-connector/pull/208) | +| --multi-to-one-target | 与 multi-to-one-origin 搭配使用,目标表的配置,比如:`--multi-to-one-target "a\`|b" | | --create-table-only | 是否只仅仅同步表的结构 | :::info 备注 diff --git a/ecosystem/flink-doris-connector.md b/ecosystem/flink-doris-connector.md index 5e0fa9b5c2f..355a4a1ad42 100644 --- a/ecosystem/flink-doris-connector.md +++ b/ecosystem/flink-doris-connector.md @@ -368,7 +368,7 @@ ON a.city = c.city | Key | Default Value | Required | Comment | | --------------------------- | ------------- | -------- | ------------------------------------------------------------ | | sink.label-prefix | -- | Y | The label prefix used by Stream load import. In the 2pc scenario, global uniqueness is required to ensure Flink's EOS semantics. | -| sink.properties.* | -- | N | Import parameters for Stream Load. <br/>For example: 'sink.properties.column_separator' = ', ' defines column delimiters, 'sink.properties.escape_delimiters' = 'true' special characters as delimiters, '\x01' will be converted to binary 0x01 <br/><br/>JSON format import<br/>'sink.properties.format' = 'json' 'sink.properties. read_json_by_line' = 'true'<br/>Detailed parameters refer to [here](../data-operate/import/stream-load-manu [...] +| sink.properties.* | -- | N | Import parameters for Stream Load. <br />For example: 'sink.properties.column_separator' = ', ' defines column delimiters, 'sink.properties.escape_delimiters' = 'true' special characters as delimiters, '\x01' will be converted to binary 0x01 <br /><br />JSON format import<br />'sink.properties.format' = 'json' 'sink.properties. read_json_by_line' = 'true'<br />Detailed parameters refer to [here](../data-operate/import/stream-load [...] | sink.enable-delete | TRUE | N | Whether to enable delete. This option requires the Doris table to enable the batch delete function (Doris 0.15+ version is enabled by default), and only supports the Unique model. | | sink.enable-2pc | TRUE | N | Whether to enable two-phase commit (2pc), the default is true, to ensure Exactly-Once semantics. For two-phase commit, please refer to [here](../data-operate/import/stream-load-manual.md). | | sink.buffer-size | 1MB | N | The size of the write data cache buffer, in bytes. It is not recommended to modify, the default configuration is enough | @@ -572,8 +572,8 @@ insert into doris_sink select id,name,bank,age from cdc_mysql_source; | --use-new-schema-change | Whether to use the new schema change to support synchronization of MySQL multi-column changes and default values. since version 1.6.0, the default value has been set to true. Reference [here](https://github.com/apache/doris-flink-connector/pull/167) | | --schema-change-mode | The mode for parsing schema change supports two parsing modes: `debezium_structure` and `sql_parser`. The default mode is `debezium_structure`. <br/><br/> `debezium_structure` parses the data structure used when upstream CDC synchronizes data, and determines DDL change operations by parsing this structure. <br/> `sql_parser` determines the DDL change operation by parsing the DDL statement when the upstream CDC synchronizes data, so this parsing mode is more ac [...] | --single-sink | Whether to use a single Sink to synchronize all tables. When turned on, newly created tables in the upstream can also be automatically recognized and tables automatically created. | -| --multi-to-one-origin | When writing multiple upstream tables into the same table, the configuration of the source table, for example: --multi-to-one-origin="a\_.\*|b_.\*", Reference [here](https://github.com/apache/doris-flink-connector/pull/208) | -| --multi-to-one-target | Used with multi-to-one-origin, the configuration of the target table, such as: --multi-to-one-target="a\|b" | +| --multi-to-one-origin | When writing multiple upstream tables into the same table, the configuration of the source table, for example: --multi-to-one-origin "a\_.\*|b_.\*", Reference [here](https://github.com/apache/doris-flink-connector/pull/208) | +| --multi-to-one-target | Used with multi-to-one-origin, the configuration of the target table, such as: --multi-to-one-target "a\|b" | | --create-table-only | Whether only the table schema should be synchronized | :::info Note --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org