This is an automated email from the ASF dual-hosted git repository. liaoxin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push: new 59ecca5402f [docs](insert-into) reformat parameters in tables (#1793) 59ecca5402f is described below commit 59ecca5402fb364d976d2801336ef41606b7ae24 Author: Kaijie Chen <c...@apache.org> AuthorDate: Wed Jan 15 20:56:53 2025 +0800 [docs](insert-into) reformat parameters in tables (#1793) --- .../import/import-way/insert-into-manual.md | 32 ++++++------------- .../import/import-way/insert-into-values-manual.md | 32 ++++++------------- .../import/import-way/insert-into-manual.md | 36 ++++++---------------- .../import/import-way/insert-into-values-manual.md | 36 ++++++---------------- .../import/import-way/insert-into-manual.md | 36 ++++++---------------- .../import/import-way/insert-into-values-manual.md | 36 ++++++---------------- .../import/import-way/insert-into-manual.md | 36 ++++++---------------- .../import/import-way/insert-into-values-manual.md | 36 ++++++---------------- .../import/import-way/insert-into-manual.md | 32 ++++++------------- .../import/import-way/insert-into-values-manual.md | 32 ++++++------------- .../import/import-way/insert-into-manual.md | 32 ++++++------------- .../import/import-way/insert-into-values-manual.md | 32 ++++++------------- 12 files changed, 120 insertions(+), 288 deletions(-) diff --git a/docs/data-operate/import/import-way/insert-into-manual.md b/docs/data-operate/import/import-way/insert-into-manual.md index a486c053227..791aff2094f 100644 --- a/docs/data-operate/import/import-way/insert-into-manual.md +++ b/docs/data-operate/import/import-way/insert-into-manual.md @@ -140,31 +140,19 @@ The SELECT statement above is similar to a regular SELECT query, allowing operat ### Parameter configuration -**FE** **configuration** +**FE Config** -insert_load_default_timeout_second +| Name | Default Value | Description | +| --- | --- | --- | +| insert_load_default_timeout_second | 14400s (4 hours) | Timeout for import tasks, in seconds. If the import task does not complete within this timeout period, it will be canceled by the system and marked as `CANCELLED`. | -- Default value: 14400s (4 hours) -- Description: Timeout for import tasks, measured in seconds. If the import task does not complete within this timeout period, it will be canceled by the system and marked as CANCELLED. +**Session Variable** -**Environment parameters** - -insert_timeout - -- Default value: 14400s (4 hours) -- Description: Timeout for INSERT INTO as an SQL statement, measured in seconds. - -enable_insert_strict - -- Default value: true -- Description: If this is set to true, INSERT INTO will fail when the task involves invalid data. If set to false, INSERT INTO will ignore invalid rows, and the import will be considered successful as long as at least one row is imported successfully. -- Explanation: Until version 2.1.4. INSERT INTO cannot control the error rate, so this parameter is used to either strictly check data quality or completely ignore invalid data. Common reasons for data invalidity include: source data column length exceeding destination column length, column type mismatch, partition mismatch, and column order mismatch. - -insert_max_filter_ratio - -- Default value: 1.0 - -- Description: Since version 2.1.5. Only effective when `enable_insert_strict` is false. Used to control the error tolerance when using `INSERT INTO FROM S3/HDFS/LOCAL()`. The default value is 1.0, which means all errors are tolerated. It can be a decimal between 0 and 1. It means that when the number of error rows exceeds this ratio, the INSERT task will fail. +| Name | Default Value | Description | +| --- | --- | --- | +| insert_timeout | 14400s (4 hours) | Timeout for INSERT INTO as an SQL statement, in seconds. | +| enable_insert_strict | true | If this is set to true, INSERT INTO will fail when the task involves invalid data. If set to false, INSERT INTO will ignore invalid rows, and the import will be considered successful as long as at least one row is imported successfully. Until version 2.1.4. INSERT INTO cannot control the error rate, so this parameter is used to either strictly check data quality or completely ignore invalid data. Common reasons for data invalidity include: source data colu [...] +| insert_max_filter_ratio | 1.0 | Since version 2.1.5. Only effective when `enable_insert_strict` is false. Used to control the error tolerance when using `INSERT INTO FROM S3/HDFS/LOCAL()`. The default value is 1.0, which means all errors are tolerated. It can be a decimal between 0 and 1. It means that when the number of error rows exceeds this ratio, the INSERT task will fail. | ### Return values diff --git a/docs/data-operate/import/import-way/insert-into-values-manual.md b/docs/data-operate/import/import-way/insert-into-values-manual.md index b020e878cd6..da3a15ea99c 100644 --- a/docs/data-operate/import/import-way/insert-into-values-manual.md +++ b/docs/data-operate/import/import-way/insert-into-values-manual.md @@ -135,31 +135,19 @@ VALUES (val1, val2, ...), (val3, val4, ...), ...; ### Parameter configuration -**FE** **configuration** +**FE Config** -insert_load_default_timeout_second +| Name | Default Value | Description | +| --- | --- | --- | +| insert_load_default_timeout_second | 14400s (4 hours) | Timeout for import tasks, in seconds. If the import task does not complete within this timeout period, it will be canceled by the system and marked as `CANCELLED`. | -- Default value: 14400s (4 hours) -- Description: Timeout for import tasks, measured in seconds. If the import task does not complete within this timeout period, it will be canceled by the system and marked as CANCELLED. +**Session Variable** -**Environment parameters** - -insert_timeout - -- Default value: 14400s (4 hours) -- Description: Timeout for INSERT INTO VALUES as an SQL statement, measured in seconds. - -enable_insert_strict - -- Default value: true -- Description: If this is set to true, INSERT INTO VALUES will fail when the task involves invalid data. If set to false, INSERT INTO VALUES will ignore invalid rows, and the import will be considered successful as long as at least one row is imported successfully. -- Explanation: Until version 2.1.4, INSERT INTO VALUES cannot control the error rate, so this parameter is used to either strictly check data quality or completely ignore invalid data. Common reasons for data invalidity include: source data column length exceeding destination column length, column type mismatch, partition mismatch, and column order mismatch. - -insert_max_filter_ratio - -- Default value: 1.0 - -- Description: Since version 2.1.5. Only effective when `enable_insert_strict` is false. Used to control the error tolerance when using `INSERT INTO VALUES`. The default value is 1.0, which means all errors are tolerated. It can be a decimal between 0 and 1. It means that when the number of error rows exceeds this ratio, the INSERT task will fail. +| Name | Default Value | Description | +| --- | --- | --- | +| insert_timeout | 14400s (4 hours) | Timeout for INSERT INTO as an SQL statement, in seconds. | +| enable_insert_strict | true | If this is set to true, INSERT INTO will fail when the task involves invalid data. If set to false, INSERT INTO will ignore invalid rows, and the import will be considered successful as long as at least one row is imported successfully. Until version 2.1.4. INSERT INTO cannot control the error rate, so this parameter is used to either strictly check data quality or completely ignore invalid data. Common reasons for data invalidity include: source data colu [...] +| insert_max_filter_ratio | 1.0 | Since version 2.1.5. Only effective when `enable_insert_strict` is false. Used to control the error tolerance when using `INSERT INTO FROM S3/HDFS/LOCAL()`. The default value is 1.0, which means all errors are tolerated. It can be a decimal between 0 and 1. It means that when the number of error rows exceeds this ratio, the INSERT task will fail. | ### Return values diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/insert-into-manual.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/insert-into-manual.md index 8185d9bec0f..fa072878927 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/insert-into-manual.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/insert-into-manual.md @@ -139,35 +139,19 @@ INSERT INTO target_table SELECT ... FROM source_table; ### 导入配置参数 -**01 FE 配置** +**FE 配置** -**insert_load_default_timeout_second** +| 参数 | 默认值 | 描述 | +| --- | --- | --- | +| insert_load_default_timeout_second | 14400(4 小时) | 导入任务的超时时间,单位:秒。导入任务在该超时时间内未完成则会被系统取消,变成 `CANCELLED`。 | -- 默认值:14400(4 小时) +**环境变量** -- 参数描述:导入任务的超时时间,单位:秒。导入任务在该超时时间内未完成则会被系统取消,变成 CANCELLED。 - -**02 环境变量** - -**insert_timeout** - -- 默认值:14400(4 小时) - -- 参数描述:INSERT INTO 作为 SQL 语句的的超时时间,单位:秒。 - -**enable_insert_strict** - -- 默认值:true - -- 参数描述:如果设置为 true,当 INSERT INTO 遇到不合格数据时导入会失败。如果设置为 false,INSERT INTO 会忽略不合格的行,只要有一条数据被正确导入,导入就会成功。 - -- 解释:在 2.1.4 及以前的版本中。INSERT INTO 无法控制错误率,只能通过该参数设置为严格检查数据质量或完全忽略错误数据。常见的数据不合格的原因有:源数据列长度超过目的数据列长度、列类型不匹配、分区不匹配、列顺序不匹配等。 - -**insert_max_filter_ratio** - -- 默认值:1.0 - -- 参数描述:自 2.1.5 版本。仅当 `enable_insert_strict` 值为 false 时生效。用于控制当使用 `INSERT INTO FROM S3/HDFS/LOCAL()` 时,设定错误容忍率的。默认为 1.0 表示容忍所有错误。可以取值 0 ~ 1 之间的小数。表示当错误行数超过该比例后,INSERT 任务会失败。 +| 参数 | 默认值 | 描述 | +| --- | --- | --- | +| insert_timeout | 14400(4 小时) | INSERT INTO 作为 SQL 语句的的超时时间,单位:秒。 | +| enable_insert_strict | true | 如果设置为 true,当 INSERT INTO 遇到不合格数据时导入会失败。如果设置为 false,INSERT INTO 会忽略不合格的行,只要有一条数据被正确导入,导入就会成功。在 2.1.4 及以前的版本中。INSERT INTO 无法控制错误率,只能通过该参数设置为严格检查数据质量或完全忽略错误数据。常见的数据不合格的原因有:源数据列长度超过目的数据列长度、列类型不匹配、分区不匹配、列顺序不匹配等。 | +| insert_max_filter_ratio | 1.0 | 自 2.1.5 版本。仅当 `enable_insert_strict` 值为 false 时生效。用于控制当使用 `INSERT INTO FROM S3/HDFS/LOCAL()` 时,设定错误容忍率的。默认为 1.0 表示容忍所有错误。可以取值 0 ~ 1 之间的小数。表示当错误行数超过该比例后,INSERT 任务会失败。 | ### 导入返回值 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/insert-into-values-manual.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/insert-into-values-manual.md index 6c121bdbbee..5cea63ca6c7 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/insert-into-values-manual.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/insert-into-values-manual.md @@ -138,35 +138,19 @@ VALUES (val1, val2, ...), (val3, val4, ...), ...; ### 导入配置参数 -**01 FE 配置** +**FE 配置** -**insert_load_default_timeout_second** +| 参数 | 默认值 | 描述 | +| --- | --- | --- | +| insert_load_default_timeout_second | 14400(4 小时) | 导入任务的超时时间,单位:秒。导入任务在该超时时间内未完成则会被系统取消,变成 `CANCELLED`。 | -- 默认值:14400(4 小时) +**环境变量** -- 参数描述:导入任务的超时时间,单位:秒。导入任务在该超时时间内未完成则会被系统取消,变成 CANCELLED。 - -**02 环境变量** - -**insert_timeout** - -- 默认值:14400(4 小时) - -- 参数描述:INSERT INTO VALUES 作为 SQL 语句的的超时时间,单位:秒。 - -**enable_insert_strict** - -- 默认值:true - -- 参数描述:如果设置为 true,当 INSERT INTO VALUES 遇到不合格数据时导入会失败。如果设置为 false,INSERT INTO VALUES 会忽略不合格的行,只要有一条数据被正确导入,导入就会成功。 - -- 解释:2.1.4 版本及以前,INSERT INTO VALUES 无法控制错误率,只能通过该参数设置为严格检查数据质量或完全忽略错误数据。常见的数据不合格的原因有:源数据列长度超过目的数据列长度、列类型不匹配、分区不匹配、列顺序不匹配等。 - -**insert_max_filter_ratio** - -- 默认值:1.0 - -- 参数描述:自 2.1.5 版本。仅当 `enable_insert_strict` 值为 false 时生效。用于控制 `INSERT INTO VALUES` 时的错误容忍率。默认为 1.0 表示容忍所有错误。可以取值 0 ~ 1 之间的小数。表示当错误行数超过该比例后,INSERT 任务会失败。 +| 参数 | 默认值 | 描述 | +| --- | --- | --- | +| insert_timeout | 14400(4 小时) | INSERT INTO 作为 SQL 语句的的超时时间,单位:秒。 | +| enable_insert_strict | true | 如果设置为 true,当 INSERT INTO 遇到不合格数据时导入会失败。如果设置为 false,INSERT INTO 会忽略不合格的行,只要有一条数据被正确导入,导入就会成功。在 2.1.4 及以前的版本中。INSERT INTO 无法控制错误率,只能通过该参数设置为严格检查数据质量或完全忽略错误数据。常见的数据不合格的原因有:源数据列长度超过目的数据列长度、列类型不匹配、分区不匹配、列顺序不匹配等。 | +| insert_max_filter_ratio | 1.0 | 自 2.1.5 版本。仅当 `enable_insert_strict` 值为 false 时生效。用于控制当使用 `INSERT INTO FROM S3/HDFS/LOCAL()` 时,设定错误容忍率的。默认为 1.0 表示容忍所有错误。可以取值 0 ~ 1 之间的小数。表示当错误行数超过该比例后,INSERT 任务会失败。 | ### 导入返回值 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/data-operate/import/import-way/insert-into-manual.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/data-operate/import/import-way/insert-into-manual.md index 88e4053773a..9431d780e16 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/data-operate/import/import-way/insert-into-manual.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/data-operate/import/import-way/insert-into-manual.md @@ -139,35 +139,19 @@ INSERT INTO target_table SELECT ... FROM source_table; ### 导入配置参数 -**01 FE 配置** +**FE 配置** -**insert_load_default_timeout_second** +| 参数 | 默认值 | 描述 | +| --- | --- | --- | +| insert_load_default_timeout_second | 14400(4 小时) | 导入任务的超时时间,单位:秒。导入任务在该超时时间内未完成则会被系统取消,变成 `CANCELLED`。 | -- 默认值:14400(4 小时) +**环境变量** -- 参数描述:导入任务的超时时间,单位:秒。导入任务在该超时时间内未完成则会被系统取消,变成 CANCELLED。 - -**02 环境变量** - -**insert_timeout** - -- 默认值:14400(4 小时) - -- 参数描述:INSERT INTO 作为 SQL 语句的的超时时间,单位:秒。 - -**enable_insert_strict** - -- 默认值:true - -- 参数描述:如果设置为 true,当 INSERT INTO 遇到不合格数据时导入会失败。如果设置为 false,INSERT INTO 会忽略不合格的行,只要有一条数据被正确导入,导入就会成功。 - -- 解释:在 2.1.4 及以前的版本中。INSERT INTO 无法控制错误率,只能通过该参数设置为严格检查数据质量或完全忽略错误数据。常见的数据不合格的原因有:源数据列长度超过目的数据列长度、列类型不匹配、分区不匹配、列顺序不匹配等。 - -**insert_max_filter_ratio** - -- 默认值:1.0 - -- 参数描述:自 2.1.5 版本。仅当 `enable_insert_strict` 值为 false 时生效。用于控制当使用 `INSERT INTO FROM S3/HDFS/LOCAL()` 时,设定错误容忍率的。默认为 1.0 表示容忍所有错误。可以取值 0 ~ 1 之间的小数。表示当错误行数超过该比例后,INSERT 任务会失败。 +| 参数 | 默认值 | 描述 | +| --- | --- | --- | +| insert_timeout | 14400(4 小时) | INSERT INTO 作为 SQL 语句的的超时时间,单位:秒。 | +| enable_insert_strict | true | 如果设置为 true,当 INSERT INTO 遇到不合格数据时导入会失败。如果设置为 false,INSERT INTO 会忽略不合格的行,只要有一条数据被正确导入,导入就会成功。在 2.1.4 及以前的版本中。INSERT INTO 无法控制错误率,只能通过该参数设置为严格检查数据质量或完全忽略错误数据。常见的数据不合格的原因有:源数据列长度超过目的数据列长度、列类型不匹配、分区不匹配、列顺序不匹配等。 | +| insert_max_filter_ratio | 1.0 | 自 2.1.5 版本。仅当 `enable_insert_strict` 值为 false 时生效。用于控制当使用 `INSERT INTO FROM S3/HDFS/LOCAL()` 时,设定错误容忍率的。默认为 1.0 表示容忍所有错误。可以取值 0 ~ 1 之间的小数。表示当错误行数超过该比例后,INSERT 任务会失败。 | ### 导入返回值 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/data-operate/import/import-way/insert-into-values-manual.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/data-operate/import/import-way/insert-into-values-manual.md index e5462ab7603..25d31b57027 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/data-operate/import/import-way/insert-into-values-manual.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/data-operate/import/import-way/insert-into-values-manual.md @@ -138,35 +138,19 @@ VALUES (val1, val2, ...), (val3, val4, ...), ...; ### 导入配置参数 -**01 FE 配置** +**FE 配置** -**insert_load_default_timeout_second** +| 参数 | 默认值 | 描述 | +| --- | --- | --- | +| insert_load_default_timeout_second | 14400(4 小时) | 导入任务的超时时间,单位:秒。导入任务在该超时时间内未完成则会被系统取消,变成 `CANCELLED`。 | -- 默认值:14400(4 小时) +**环境变量** -- 参数描述:导入任务的超时时间,单位:秒。导入任务在该超时时间内未完成则会被系统取消,变成 CANCELLED。 - -**02 环境变量** - -**insert_timeout** - -- 默认值:14400(4 小时) - -- 参数描述:INSERT INTO VALUES 作为 SQL 语句的的超时时间,单位:秒。 - -**enable_insert_strict** - -- 默认值:true - -- 参数描述:如果设置为 true,当 INSERT INTO VALUES 遇到不合格数据时导入会失败。如果设置为 false,INSERT INTO VALUES 会忽略不合格的行,只要有一条数据被正确导入,导入就会成功。 - -- 解释:2.1.4 版本及以前,INSERT INTO VALUES 无法控制错误率,只能通过该参数设置为严格检查数据质量或完全忽略错误数据。常见的数据不合格的原因有:源数据列长度超过目的数据列长度、列类型不匹配、分区不匹配、列顺序不匹配等。 - -**insert_max_filter_ratio** - -- 默认值:1.0 - -- 参数描述:自 2.1.5 版本。仅当 `enable_insert_strict` 值为 false 时生效。用于控制 `INSERT INTO VALUES` 时的错误容忍率。默认为 1.0 表示容忍所有错误。可以取值 0 ~ 1 之间的小数。表示当错误行数超过该比例后,INSERT 任务会失败。 +| 参数 | 默认值 | 描述 | +| --- | --- | --- | +| insert_timeout | 14400(4 小时) | INSERT INTO 作为 SQL 语句的的超时时间,单位:秒。 | +| enable_insert_strict | true | 如果设置为 true,当 INSERT INTO 遇到不合格数据时导入会失败。如果设置为 false,INSERT INTO 会忽略不合格的行,只要有一条数据被正确导入,导入就会成功。在 2.1.4 及以前的版本中。INSERT INTO 无法控制错误率,只能通过该参数设置为严格检查数据质量或完全忽略错误数据。常见的数据不合格的原因有:源数据列长度超过目的数据列长度、列类型不匹配、分区不匹配、列顺序不匹配等。 | +| insert_max_filter_ratio | 1.0 | 自 2.1.5 版本。仅当 `enable_insert_strict` 值为 false 时生效。用于控制当使用 `INSERT INTO FROM S3/HDFS/LOCAL()` 时,设定错误容忍率的。默认为 1.0 表示容忍所有错误。可以取值 0 ~ 1 之间的小数。表示当错误行数超过该比例后,INSERT 任务会失败。 | ### 导入返回值 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/data-operate/import/import-way/insert-into-manual.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/data-operate/import/import-way/insert-into-manual.md index 88e4053773a..9431d780e16 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/data-operate/import/import-way/insert-into-manual.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/data-operate/import/import-way/insert-into-manual.md @@ -139,35 +139,19 @@ INSERT INTO target_table SELECT ... FROM source_table; ### 导入配置参数 -**01 FE 配置** +**FE 配置** -**insert_load_default_timeout_second** +| 参数 | 默认值 | 描述 | +| --- | --- | --- | +| insert_load_default_timeout_second | 14400(4 小时) | 导入任务的超时时间,单位:秒。导入任务在该超时时间内未完成则会被系统取消,变成 `CANCELLED`。 | -- 默认值:14400(4 小时) +**环境变量** -- 参数描述:导入任务的超时时间,单位:秒。导入任务在该超时时间内未完成则会被系统取消,变成 CANCELLED。 - -**02 环境变量** - -**insert_timeout** - -- 默认值:14400(4 小时) - -- 参数描述:INSERT INTO 作为 SQL 语句的的超时时间,单位:秒。 - -**enable_insert_strict** - -- 默认值:true - -- 参数描述:如果设置为 true,当 INSERT INTO 遇到不合格数据时导入会失败。如果设置为 false,INSERT INTO 会忽略不合格的行,只要有一条数据被正确导入,导入就会成功。 - -- 解释:在 2.1.4 及以前的版本中。INSERT INTO 无法控制错误率,只能通过该参数设置为严格检查数据质量或完全忽略错误数据。常见的数据不合格的原因有:源数据列长度超过目的数据列长度、列类型不匹配、分区不匹配、列顺序不匹配等。 - -**insert_max_filter_ratio** - -- 默认值:1.0 - -- 参数描述:自 2.1.5 版本。仅当 `enable_insert_strict` 值为 false 时生效。用于控制当使用 `INSERT INTO FROM S3/HDFS/LOCAL()` 时,设定错误容忍率的。默认为 1.0 表示容忍所有错误。可以取值 0 ~ 1 之间的小数。表示当错误行数超过该比例后,INSERT 任务会失败。 +| 参数 | 默认值 | 描述 | +| --- | --- | --- | +| insert_timeout | 14400(4 小时) | INSERT INTO 作为 SQL 语句的的超时时间,单位:秒。 | +| enable_insert_strict | true | 如果设置为 true,当 INSERT INTO 遇到不合格数据时导入会失败。如果设置为 false,INSERT INTO 会忽略不合格的行,只要有一条数据被正确导入,导入就会成功。在 2.1.4 及以前的版本中。INSERT INTO 无法控制错误率,只能通过该参数设置为严格检查数据质量或完全忽略错误数据。常见的数据不合格的原因有:源数据列长度超过目的数据列长度、列类型不匹配、分区不匹配、列顺序不匹配等。 | +| insert_max_filter_ratio | 1.0 | 自 2.1.5 版本。仅当 `enable_insert_strict` 值为 false 时生效。用于控制当使用 `INSERT INTO FROM S3/HDFS/LOCAL()` 时,设定错误容忍率的。默认为 1.0 表示容忍所有错误。可以取值 0 ~ 1 之间的小数。表示当错误行数超过该比例后,INSERT 任务会失败。 | ### 导入返回值 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/data-operate/import/import-way/insert-into-values-manual.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/data-operate/import/import-way/insert-into-values-manual.md index dc87f1a5df3..aed10eb0468 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/data-operate/import/import-way/insert-into-values-manual.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/data-operate/import/import-way/insert-into-values-manual.md @@ -138,35 +138,19 @@ VALUES (val1, val2, ...), (val3, val4, ...), ...; ### 导入配置参数 -**01 FE 配置** +**FE 配置** -**insert_load_default_timeout_second** +| 参数 | 默认值 | 描述 | +| --- | --- | --- | +| insert_load_default_timeout_second | 14400(4 小时) | 导入任务的超时时间,单位:秒。导入任务在该超时时间内未完成则会被系统取消,变成 `CANCELLED`。 | -- 默认值:14400(4 小时) +**环境变量** -- 参数描述:导入任务的超时时间,单位:秒。导入任务在该超时时间内未完成则会被系统取消,变成 CANCELLED。 - -**02 环境变量** - -**insert_timeout** - -- 默认值:14400(4 小时) - -- 参数描述:INSERT INTO VALUES 作为 SQL 语句的的超时时间,单位:秒。 - -**enable_insert_strict** - -- 默认值:true - -- 参数描述:如果设置为 true,当 INSERT INTO VALUES 遇到不合格数据时导入会失败。如果设置为 false,INSERT INTO VALUES 会忽略不合格的行,只要有一条数据被正确导入,导入就会成功。 - -- 解释:2.1.4 版本及以前,INSERT INTO VALUES 无法控制错误率,只能通过该参数设置为严格检查数据质量或完全忽略错误数据。常见的数据不合格的原因有:源数据列长度超过目的数据列长度、列类型不匹配、分区不匹配、列顺序不匹配等。 - -**insert_max_filter_ratio** - -- 默认值:1.0 - -- 参数描述:自 2.1.5 版本。仅当 `enable_insert_strict` 值为 false 时生效。用于控制 `INSERT INTO VALUES` 时的错误容忍率。默认为 1.0 表示容忍所有错误。可以取值 0 ~ 1 之间的小数。表示当错误行数超过该比例后,INSERT 任务会失败。 +| 参数 | 默认值 | 描述 | +| --- | --- | --- | +| insert_timeout | 14400(4 小时) | INSERT INTO 作为 SQL 语句的的超时时间,单位:秒。 | +| enable_insert_strict | true | 如果设置为 true,当 INSERT INTO 遇到不合格数据时导入会失败。如果设置为 false,INSERT INTO 会忽略不合格的行,只要有一条数据被正确导入,导入就会成功。在 2.1.4 及以前的版本中。INSERT INTO 无法控制错误率,只能通过该参数设置为严格检查数据质量或完全忽略错误数据。常见的数据不合格的原因有:源数据列长度超过目的数据列长度、列类型不匹配、分区不匹配、列顺序不匹配等。 | +| insert_max_filter_ratio | 1.0 | 自 2.1.5 版本。仅当 `enable_insert_strict` 值为 false 时生效。用于控制当使用 `INSERT INTO FROM S3/HDFS/LOCAL()` 时,设定错误容忍率的。默认为 1.0 表示容忍所有错误。可以取值 0 ~ 1 之间的小数。表示当错误行数超过该比例后,INSERT 任务会失败。 | ### 导入返回值 diff --git a/versioned_docs/version-2.1/data-operate/import/import-way/insert-into-manual.md b/versioned_docs/version-2.1/data-operate/import/import-way/insert-into-manual.md index 4550afc851b..7fc9ce4cf3d 100644 --- a/versioned_docs/version-2.1/data-operate/import/import-way/insert-into-manual.md +++ b/versioned_docs/version-2.1/data-operate/import/import-way/insert-into-manual.md @@ -140,31 +140,19 @@ The SELECT statement above is similar to a regular SELECT query, allowing operat ### Parameter configuration -**FE** **configuration** +**FE Config** -insert_load_default_timeout_second +| Name | Default Value | Description | +| --- | --- | --- | +| insert_load_default_timeout_second | 14400s (4 hours) | Timeout for import tasks, in seconds. If the import task does not complete within this timeout period, it will be canceled by the system and marked as `CANCELLED`. | -- Default value: 14400s (4 hours) -- Description: Timeout for import tasks, measured in seconds. If the import task does not complete within this timeout period, it will be canceled by the system and marked as CANCELLED. +**Session Variable** -**Environment parameters** - -insert_timeout - -- Default value: 14400s (4 hours) -- Description: Timeout for INSERT INTO as an SQL statement, measured in seconds. - -enable_insert_strict - -- Default value: true -- Description: If this is set to true, INSERT INTO will fail when the task involves invalid data. If set to false, INSERT INTO will ignore invalid rows, and the import will be considered successful as long as at least one row is imported successfully. -- Explanation: Until version 2.1.4. INSERT INTO cannot control the error rate, so this parameter is used to either strictly check data quality or completely ignore invalid data. Common reasons for data invalidity include: source data column length exceeding destination column length, column type mismatch, partition mismatch, and column order mismatch. - -insert_max_filter_ratio - -- Default value: 1.0 - -- Description: Since version 2.1.5. Only effective when `enable_insert_strict` is false. Used to control the error tolerance when using `INSERT INTO FROM S3/HDFS/LOCAL()`. The default value is 1.0, which means all errors are tolerated. It can be a decimal between 0 and 1. It means that when the number of error rows exceeds this ratio, the INSERT task will fail. +| Name | Default Value | Description | +| --- | --- | --- | +| insert_timeout | 14400s (4 hours) | Timeout for INSERT INTO as an SQL statement, in seconds. | +| enable_insert_strict | true | If this is set to true, INSERT INTO will fail when the task involves invalid data. If set to false, INSERT INTO will ignore invalid rows, and the import will be considered successful as long as at least one row is imported successfully. Until version 2.1.4. INSERT INTO cannot control the error rate, so this parameter is used to either strictly check data quality or completely ignore invalid data. Common reasons for data invalidity include: source data colu [...] +| insert_max_filter_ratio | 1.0 | Since version 2.1.5. Only effective when `enable_insert_strict` is false. Used to control the error tolerance when using `INSERT INTO FROM S3/HDFS/LOCAL()`. The default value is 1.0, which means all errors are tolerated. It can be a decimal between 0 and 1. It means that when the number of error rows exceeds this ratio, the INSERT task will fail. | ### Return values diff --git a/versioned_docs/version-2.1/data-operate/import/import-way/insert-into-values-manual.md b/versioned_docs/version-2.1/data-operate/import/import-way/insert-into-values-manual.md index 1c3195e6cc8..8e3fc868a53 100644 --- a/versioned_docs/version-2.1/data-operate/import/import-way/insert-into-values-manual.md +++ b/versioned_docs/version-2.1/data-operate/import/import-way/insert-into-values-manual.md @@ -135,31 +135,19 @@ VALUES (val1, val2, ...), (val3, val4, ...), ...; ### Parameter configuration -**FE** **configuration** +**FE Config** -insert_load_default_timeout_second +| Name | Default Value | Description | +| --- | --- | --- | +| insert_load_default_timeout_second | 14400s (4 hours) | Timeout for import tasks, in seconds. If the import task does not complete within this timeout period, it will be canceled by the system and marked as `CANCELLED`. | -- Default value: 14400s (4 hours) -- Description: Timeout for import tasks, measured in seconds. If the import task does not complete within this timeout period, it will be canceled by the system and marked as CANCELLED. +**Session Variable** -**Environment parameters** - -insert_timeout - -- Default value: 14400s (4 hours) -- Description: Timeout for INSERT INTO VALUES as an SQL statement, measured in seconds. - -enable_insert_strict - -- Default value: true -- Description: If this is set to true, INSERT INTO VALUES will fail when the task involves invalid data. If set to false, INSERT INTO VALUES will ignore invalid rows, and the import will be considered successful as long as at least one row is imported successfully. -- Explanation: Until version 2.1.4, INSERT INTO VALUES cannot control the error rate, so this parameter is used to either strictly check data quality or completely ignore invalid data. Common reasons for data invalidity include: source data column length exceeding destination column length, column type mismatch, partition mismatch, and column order mismatch. - -insert_max_filter_ratio - -- Default value: 1.0 - -- Description: Since version 2.1.5. Only effective when `enable_insert_strict` is false. Used to control the error tolerance when using `INSERT INTO VALUES`. The default value is 1.0, which means all errors are tolerated. It can be a decimal between 0 and 1. It means that when the number of error rows exceeds this ratio, the INSERT task will fail. +| Name | Default Value | Description | +| --- | --- | --- | +| insert_timeout | 14400s (4 hours) | Timeout for INSERT INTO as an SQL statement, in seconds. | +| enable_insert_strict | true | If this is set to true, INSERT INTO will fail when the task involves invalid data. If set to false, INSERT INTO will ignore invalid rows, and the import will be considered successful as long as at least one row is imported successfully. Until version 2.1.4. INSERT INTO cannot control the error rate, so this parameter is used to either strictly check data quality or completely ignore invalid data. Common reasons for data invalidity include: source data colu [...] +| insert_max_filter_ratio | 1.0 | Since version 2.1.5. Only effective when `enable_insert_strict` is false. Used to control the error tolerance when using `INSERT INTO FROM S3/HDFS/LOCAL()`. The default value is 1.0, which means all errors are tolerated. It can be a decimal between 0 and 1. It means that when the number of error rows exceeds this ratio, the INSERT task will fail. | ### Return values diff --git a/versioned_docs/version-3.0/data-operate/import/import-way/insert-into-manual.md b/versioned_docs/version-3.0/data-operate/import/import-way/insert-into-manual.md index 4550afc851b..7fc9ce4cf3d 100644 --- a/versioned_docs/version-3.0/data-operate/import/import-way/insert-into-manual.md +++ b/versioned_docs/version-3.0/data-operate/import/import-way/insert-into-manual.md @@ -140,31 +140,19 @@ The SELECT statement above is similar to a regular SELECT query, allowing operat ### Parameter configuration -**FE** **configuration** +**FE Config** -insert_load_default_timeout_second +| Name | Default Value | Description | +| --- | --- | --- | +| insert_load_default_timeout_second | 14400s (4 hours) | Timeout for import tasks, in seconds. If the import task does not complete within this timeout period, it will be canceled by the system and marked as `CANCELLED`. | -- Default value: 14400s (4 hours) -- Description: Timeout for import tasks, measured in seconds. If the import task does not complete within this timeout period, it will be canceled by the system and marked as CANCELLED. +**Session Variable** -**Environment parameters** - -insert_timeout - -- Default value: 14400s (4 hours) -- Description: Timeout for INSERT INTO as an SQL statement, measured in seconds. - -enable_insert_strict - -- Default value: true -- Description: If this is set to true, INSERT INTO will fail when the task involves invalid data. If set to false, INSERT INTO will ignore invalid rows, and the import will be considered successful as long as at least one row is imported successfully. -- Explanation: Until version 2.1.4. INSERT INTO cannot control the error rate, so this parameter is used to either strictly check data quality or completely ignore invalid data. Common reasons for data invalidity include: source data column length exceeding destination column length, column type mismatch, partition mismatch, and column order mismatch. - -insert_max_filter_ratio - -- Default value: 1.0 - -- Description: Since version 2.1.5. Only effective when `enable_insert_strict` is false. Used to control the error tolerance when using `INSERT INTO FROM S3/HDFS/LOCAL()`. The default value is 1.0, which means all errors are tolerated. It can be a decimal between 0 and 1. It means that when the number of error rows exceeds this ratio, the INSERT task will fail. +| Name | Default Value | Description | +| --- | --- | --- | +| insert_timeout | 14400s (4 hours) | Timeout for INSERT INTO as an SQL statement, in seconds. | +| enable_insert_strict | true | If this is set to true, INSERT INTO will fail when the task involves invalid data. If set to false, INSERT INTO will ignore invalid rows, and the import will be considered successful as long as at least one row is imported successfully. Until version 2.1.4. INSERT INTO cannot control the error rate, so this parameter is used to either strictly check data quality or completely ignore invalid data. Common reasons for data invalidity include: source data colu [...] +| insert_max_filter_ratio | 1.0 | Since version 2.1.5. Only effective when `enable_insert_strict` is false. Used to control the error tolerance when using `INSERT INTO FROM S3/HDFS/LOCAL()`. The default value is 1.0, which means all errors are tolerated. It can be a decimal between 0 and 1. It means that when the number of error rows exceeds this ratio, the INSERT task will fail. | ### Return values diff --git a/versioned_docs/version-3.0/data-operate/import/import-way/insert-into-values-manual.md b/versioned_docs/version-3.0/data-operate/import/import-way/insert-into-values-manual.md index febd3b7c239..f4a3d519b94 100644 --- a/versioned_docs/version-3.0/data-operate/import/import-way/insert-into-values-manual.md +++ b/versioned_docs/version-3.0/data-operate/import/import-way/insert-into-values-manual.md @@ -135,31 +135,19 @@ VALUES (val1, val2, ...), (val3, val4, ...), ...; ### Parameter configuration -**FE** **configuration** +**FE Config** -insert_load_default_timeout_second +| Name | Default Value | Description | +| --- | --- | --- | +| insert_load_default_timeout_second | 14400s (4 hours) | Timeout for import tasks, in seconds. If the import task does not complete within this timeout period, it will be canceled by the system and marked as `CANCELLED`. | -- Default value: 14400s (4 hours) -- Description: Timeout for import tasks, measured in seconds. If the import task does not complete within this timeout period, it will be canceled by the system and marked as CANCELLED. +**Session Variable** -**Environment parameters** - -insert_timeout - -- Default value: 14400s (4 hours) -- Description: Timeout for INSERT INTO VALUES as an SQL statement, measured in seconds. - -enable_insert_strict - -- Default value: true -- Description: If this is set to true, INSERT INTO VALUES will fail when the task involves invalid data. If set to false, INSERT INTO VALUES will ignore invalid rows, and the import will be considered successful as long as at least one row is imported successfully. -- Explanation: Until version 2.1.4, INSERT INTO VALUES cannot control the error rate, so this parameter is used to either strictly check data quality or completely ignore invalid data. Common reasons for data invalidity include: source data column length exceeding destination column length, column type mismatch, partition mismatch, and column order mismatch. - -insert_max_filter_ratio - -- Default value: 1.0 - -- Description: Since version 2.1.5. Only effective when `enable_insert_strict` is false. Used to control the error tolerance when using `INSERT INTO VALUES`. The default value is 1.0, which means all errors are tolerated. It can be a decimal between 0 and 1. It means that when the number of error rows exceeds this ratio, the INSERT task will fail. +| Name | Default Value | Description | +| --- | --- | --- | +| insert_timeout | 14400s (4 hours) | Timeout for INSERT INTO as an SQL statement, in seconds. | +| enable_insert_strict | true | If this is set to true, INSERT INTO will fail when the task involves invalid data. If set to false, INSERT INTO will ignore invalid rows, and the import will be considered successful as long as at least one row is imported successfully. Until version 2.1.4. INSERT INTO cannot control the error rate, so this parameter is used to either strictly check data quality or completely ignore invalid data. Common reasons for data invalidity include: source data colu [...] +| insert_max_filter_ratio | 1.0 | Since version 2.1.5. Only effective when `enable_insert_strict` is false. Used to control the error tolerance when using `INSERT INTO FROM S3/HDFS/LOCAL()`. The default value is 1.0, which means all errors are tolerated. It can be a decimal between 0 and 1. It means that when the number of error rows exceeds this ratio, the INSERT task will fail. | ### Return values --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org