This is an automated email from the ASF dual-hosted git repository. wangbo pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push: new f6ad3bbb8d0 [docs]add job bind compute group docs (#2415) f6ad3bbb8d0 is described below commit f6ad3bbb8d0db04cc00604dda71acd0292faed1d Author: wangbo <wan...@apache.org> AuthorDate: Wed May 28 10:32:40 2025 +0800 [docs]add job bind compute group docs (#2415) --- .../workload-group-bind-compute-group.md | 2 +- .../import/import-way/broker-load-manual.md | 9 +++++++++ .../import/import-way/routine-load-manual.md | 12 +++++++++++ .../import/import-way/stream-load-manual.md | 23 ++++++++++++++++++++++ .../workload-group-bind-compute-group.md | 2 +- .../import/import-way/broker-load-manual.md | 8 ++++++++ .../import/import-way/routine-load-manual.md | 10 ++++++++++ .../import/import-way/stream-load-manual.md | 22 +++++++++++++++++++++ sidebars.json | 3 ++- 9 files changed, 88 insertions(+), 3 deletions(-) diff --git a/docs/admin-manual/workload-management/workload-group-bind-compute-group.md b/docs/admin-manual/workload-management/workload-group-bind-compute-group.md index 8b9c1d8e11b..45844c6e1c6 100644 --- a/docs/admin-manual/workload-management/workload-group-bind-compute-group.md +++ b/docs/admin-manual/workload-management/workload-group-bind-compute-group.md @@ -1,7 +1,7 @@ --- { "title": "Workload Group Bind Compute Group", -"language": "zh-CN" +"language": "en" } --- diff --git a/docs/data-operate/import/import-way/broker-load-manual.md b/docs/data-operate/import/import-way/broker-load-manual.md index a105eedb9f9..048b19c1e23 100644 --- a/docs/data-operate/import/import-way/broker-load-manual.md +++ b/docs/data-operate/import/import-way/broker-load-manual.md @@ -200,6 +200,15 @@ For example: To cancel the import job with the label "broker_load_2022_04_01" on CANCEL LOAD FROM demo WHERE LABEL = "broker_load_2022_04_01"; ``` +### Choosing Compute Group +In the storage-computation separation mode, the priority logic for Broker Load to select a Compute Group is as follows: +1. Select the Compute Group specified by the ```use db@cluster statement```; +2. Select the Compute Group specified by the user properties ```default_compute_group```; +3. Select one from the Compute Groups that the current user has permissions to access; + +In the integrated storage-computation mode, select the Compute Group specified in the user properties ```resource_tags.location```; +if not specified in the user properties, use the Compute Group named ```default```; + ## Reference Manual ### SQL syntax for broker load diff --git a/docs/data-operate/import/import-way/routine-load-manual.md b/docs/data-operate/import/import-way/routine-load-manual.md index ff2c9aa4af7..438d2e8731d 100644 --- a/docs/data-operate/import/import-way/routine-load-manual.md +++ b/docs/data-operate/import/import-way/routine-load-manual.md @@ -296,6 +296,18 @@ To stop and delete the `testdb.example_routine_load_csv` load job, you can use t STOP ROUTINE LOAD FOR testdb.example_routine_load_csv; ``` +### Choosing Compute Group +In the storage-computation separation mode, the priority logic for Routine Load to select a Compute Group is as follows: +1. Select the Compute Group specified by the ```use db@cluster statement```; +2. Select the Compute Group specified by the user properties ```default_compute_group```; +3. Select one from the Compute Groups that the current user has permissions to access; + +In the integrated storage-computation mode, select the Compute Group specified in the user properties ```resource_tags.location```; +if not specified in the user properties, use the Compute Group named ```default```; + +It should be noted that the Compute Group for a Routine Load job can only be specified at the time of creation. +Once the Routine Load job is created, the Compute Group bound to the Routine Load cannot be modified. + ## Reference Manual ### Load Commands diff --git a/docs/data-operate/import/import-way/stream-load-manual.md b/docs/data-operate/import/import-way/stream-load-manual.md index e6a06f5a443..8f3a4fe995b 100644 --- a/docs/data-operate/import/import-way/stream-load-manual.md +++ b/docs/data-operate/import/import-way/stream-load-manual.md @@ -251,6 +251,29 @@ mysql> show stream load from testdb; 1 row in set (0.00 sec) ``` +### Choosing Compute Group +Users can specify a particular Compute Group for Stream Load to run on. + +Under the storage-computation separation mode, Compute Groups can be specified in the following ways: +1. Specify via an HTTP Header parameter. +``` +-H "cloud_cluster:cluster1" +``` + +2. Specify Compute Group in the user properties bound to Stream Load. If both user properties and the HTTP header specify a Compute Group, the Compute Group specified in the Header takes precedence. +``` +set property for user1 'default_compute_group'='cluster1'; +``` + +3. If neither user properties nor the HTTP Header specify a Compute Group, a Compute Group that the user bound to Stream Load has permission to access will be selected. + If the user does not have permission to access any Compute Group, the Load will fail. + +Under the integrated storage-computation mode, specifying a Compute Group is only supported through the user properties bound to Stream Load. +If not specified in the user properties, the Compute Group named ```default``` will be selected. +``` +set property for user1 'resource_tags.location'='group_1'; +``` + ### Cancel load job Users cannot manually cancel a Stream Load operation. A Stream Load job will be automatically canceled by the system if it encounters a timeout (set to 0) or an import error. diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/workload-management/workload-group-bind-compute-group.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/workload-management/workload-group-bind-compute-group.md index 7927ff8b3ce..27b89056c8b 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/workload-management/workload-group-bind-compute-group.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/workload-management/workload-group-bind-compute-group.md @@ -1,6 +1,6 @@ --- { -"title": "Workload Group Bind Compute Group", +"title": "Workload Group 绑定 Compute Group", "language": "zh-CN" } --- diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/broker-load-manual.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/broker-load-manual.md index 75deb2a6080..1169463ec29 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/broker-load-manual.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/broker-load-manual.md @@ -197,6 +197,14 @@ LoadFinishTime: 2022-04-01 18:59:11 CANCEL LOAD FROM demo WHERE LABEL = "broker_load_2022_04_01"; ``` +### 绑定 Compute Group +在存算分离模式下,Broker Load 的 Compute Group 选择逻辑按优先级如下: +1. 选择 ```use db@cluster ``` 语句指定的Compute Group; +2. 选择用户属性 ```default_compute_group``` 指定的 Compute Group; +3. 从当前用户有权限的 Compute Group 中选择一个; + +在存算一体模式下,选择用户属性 ```resource_tags.location``` 中指定的 Compute Group;如果用户属性中未指定,那么就使用名为 default 的 Compute Group; + ## 参考手册 ### 导入命令 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/routine-load-manual.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/routine-load-manual.md index a9efe498b8c..ce4544a6c5c 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/routine-load-manual.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/routine-load-manual.md @@ -308,6 +308,16 @@ FROM KAFKA( STOP ROUTINE LOAD FOR testdb.example_routine_load_csv; ``` +### 绑定 Compute Group +在存算分离模式下,Routine Load 的 Compute Group 选择逻辑按优先级如下: +1. 选择 ```use db@cluster ``` 语句指定的Compute Group; +2. 选择用户属性 ```default_compute_group``` 指定的 Compute Group; +3. 从当前用户有权限的 Compute Group 中选择一个; + +在存算一体模式下,选择用户属性 ```resource_tags.location``` 中指定的 Compute Group;如果用户属性中未指定,那么就使用名为 default 的 Compute Group; + +需要注意的是,Routine Load 作业的 Compute Group 只能在创建时指定,一旦 Routine Load 作业被创建后,其绑定的 Compute Group 就无法修改。 + ## 参考手册 ### 导入命令 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/stream-load-manual.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/stream-load-manual.md index c42c425d2c4..c3124c780e0 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/stream-load-manual.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/import-way/stream-load-manual.md @@ -249,6 +249,28 @@ mysql> show stream load from testdb; 用户无法手动取消 Stream Load,Stream Load 在超时或者导入错误后会被系统自动取消。 +### 绑定 Compute Group +用户可以指定 Stream Load 在具体的某个 Compute Group上运行; + +存算分离模式下指定 Compute Group的方式如下: +1. 通过 HTTP Header 参数指定。 +``` +-H "cloud_cluster:cluster1" +``` + +2. 在 Stream Load 绑定的 user 属性中指定 Compute Group。如果 user 属性和 HTTP header 同时指定了 Compute Group,那么以 Header 中指定的 Compute Group 为准。 +``` +set property for user1 'default_compute_group'='cluster1'; +``` + +3. 如果 user 属性中和 HTTP Header 中均未指定 Compute Group,那么会从 Stream Load 绑定的 user 有权限访问的 Compute Group 中选择一个。 +如果 user 没有任何有权限访问的 Compute Group,那么导入就会失败。 + +存算一体模式下,只支持通过 Stream Load 绑定的 user 属性指定 Compute Group,如果 user 属性中未指定,那么就会选择名为 ```default``` 的 Compute Group。 +``` +set property for user1 'resource_tags.location'='group_1'; +``` + ## 参考手册 ### 导入命令 diff --git a/sidebars.json b/sidebars.json index 509cae881a9..e1cef94059e 100644 --- a/sidebars.json +++ b/sidebars.json @@ -581,7 +581,8 @@ "items": [ "admin-manual/workload-management/resource-group", "admin-manual/workload-management/compute-group", - "admin-manual/workload-management/workload-group" + "admin-manual/workload-management/workload-group", + "admin-manual/workload-management/workload-group-bind-compute-group" ] }, "admin-manual/workload-management/analysis-diagnosis", --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org