This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new 0661fbdb3f9 [Fix](community)Update the regression test documentation
to include the following：Pre… (#2645)
0661fbdb3f9 is described below
commit 0661fbdb3f97d445132c0f00a4cd098d46334d8f
Author: Wen Zhenghu <[email protected]>
AuthorDate: Wed Jul 23 09:47:56 2025 +0800
[Fix](community)Update the regression test documentation to include the
following：Pre… (#2645)
…-container startup network configuration checks. Enhanced descriptions
of Hive-related Docker Compose files.Container log viewing commands
## Versions
- [x] dev
- [ ] 3.0
- [ ] 2.1
- [ ] 2.0
## Languages
- [x] Chinese
- [x] English
---
community/developer-guide/regression-testing.md | 23 +++++++++++++---------
.../current/developer-guide/regression-testing.md | 20 +++++++++++++------
2 files changed, 28 insertions(+), 15 deletions(-)
diff --git a/community/developer-guide/regression-testing.md
b/community/developer-guide/regression-testing.md
index 46acaba921c..41a80e0675a 100644
--- a/community/developer-guide/regression-testing.md
+++ b/community/developer-guide/regression-testing.md
@@ -629,6 +629,10 @@ Doris supports queries on external data sources, so the
regression testing frame
To begin with, modify `CONTAINER_UID` in
`docker/thirdparties/custom_settings.env`. For example, `doris-10002-18sda1-`.
The follow-up startup scripts will replace the corresponding names in Docker
Compose to ensure consistency across multiple containers environment.
+ Before starting the containers, you need to check the network configuration
of your server/cloud host to ensure that the mapping relationship between
hostname and host IP address (hostname -i) is configured in /etc/hosts.
+
+ It should look like: `10.0.0.46 iZj6cbwlx5pl6y0681t6scZ
iZj6cbwlx5pl6y0681t6scZ`, which are IP address (output of hostname -i command,
usually the IP of eth0), hostname (output of hostname command), and alias (same
as the previous one).
+
1. Start the Container
So far, Doris has supported Docker Compose for data sources including
Elasticsearch, MySQL, PostgreSQL, Hive, SQLServer, Oracle, Iceberg, Hudi, and
Trino. The relevant files can be found in the directory
`docker/thirdparties/docker-compose`.
@@ -641,7 +645,9 @@ Doris supports queries on external data sources, so the
regression testing frame
cd docker/thirdparties && sh run-thirdparties-docker.sh
```
- Executing this command requires root or sudo privilege. If the command
returns, that means all containers are started. You can check on them by
inputing a `docker ps -a` command.
+ Executing this command requires root or sudo privilege. If the command
returns, that means all containers are started. You can check on them by
inputing a `docker ps -a` command.
+
+ During the container startup process, you can use the `docker logs -f
<container-name>` command to view the container logs.
To stop all containers, you can use the following command:
@@ -681,14 +687,12 @@ Doris supports queries on external data sources, so the
regression testing frame
3. Hive
- You can find the Hive-related Docker Compose files in
`docker/thirdparties/docker-compose/hive` .
-
- * `hive-2x.yaml.tpl`: Docker Compose file template, no modification
required.
-
- * `hadoop-hive.env.tpl`: The configuration file template, no
modification required.
-
- * `gen_env.sh`: The script for initializing the configuration file. In
this script, you can modify the two external ports: `FS_PORT` for defaultFs and
`HMS_PORT` for Hive metastore (default numbers: 8120 and 9183, respectively).
This script will be called once `run-thirdparties-docker.sh` is started.
+ You can find the Hive-related Docker Compose files in
`docker/thirdparties/docker-compose/hive`, supporting both Hive2 and Hive3.
+ * `hive-2x.yaml.tpl`, `hive-3x.yaml.tpl`: Docker Compose file templates,
no modification required.
+ * `hadoop-hive.env.tpl`, `hadoop-hive-2x.env.tpl` and
`hadoop-hive-3x.env.tpl`: Configuration file templates, no modification
required.
+ * `hive-2x_settings.env`: Hive2 initialization configuration script,
which will be automatically called when `run-thirdparties-docker.sh` starts.
You can modify four external ports in this file: `FS_PORT`, `HMS_PORT`,
`HS_PORT`, and `PG_PORT`, which correspond to `hive2HdfsPort`, `hive2HmsPort`,
`hive2ServerPort`, and `hive2PgPort` in `regression-conf.groovy`. The first two
are for Hadoop's defaultFs and Hive metastore ports, with defaults of 8020 and
9083.
+ * `hive-3x_settings.env`: Hive3 initialization configuration script,
which will be automatically called when `run-thirdparties-docker.sh` starts.
You can modify four external ports in this file: `FS_PORT`, `HMS_PORT`,
`HS_PORT`, and `PG_PORT`, which correspond to `hive3HdfsPort`, `hive3HmsPort`,
`hive3ServerPort`, and `hive3PgPort` in `regression-conf.groovy`. The first two
are for Hadoop's defaultFs and Hive metastore ports, with defaults of 8320 and
9383.
* The `scripts/` directory will be mounted to the container once it is
started. Files in this directory require no modifications. Note that you need
to download the pre-built files before you start the container:
Download files from
`https://doris-build-hk-1308700295.cos.ap-hongkong.myqcloud.com/regression/load/tpch1_parquet/tpch1.db.tar.gz`
to the `scripts/` directory and decompress.
@@ -857,7 +861,8 @@ Doris supports queries on external data sources, so the
regression testing frame
* `enableJdbcTest`: This is to enable test for JDBC external tables. For
this purpose, you need to start the MySQL and PostgreSQL containers.
* `mysql_57_port` and `pg_14_port` are the external port of MySQL and
PostgreSQL, respectively. Default port numbers: 3316 and 5442.
* `enableHiveTest`: This is to enable test for Hive external tables. For
this purpose, you need to start the Hive container.
- * `hms_port` is the external port for Hive metastore. Default number: 9183.
+ * `hive2HmsPort` is the external port for Hive2 metastore. Default number:
9083.
+ * `hive2HdfsPort` is the external port for Hive2 HDFS namenode. Default
number: 8020.
* `enableEsTest`: This is to enable test for Elasticsearch external tables.
For this purpose, you need to start the Elasticsearch container.
* `es_6_port`: Port for Elasticsearch 6.
* `es_7_port`: Port for Elasticsearch 7.
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs-community/current/developer-guide/regression-testing.md
b/i18n/zh-CN/docusaurus-plugin-content-docs-community/current/developer-guide/regression-testing.md
index eb42e9e7e7d..2355ab0080c 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs-community/current/developer-guide/regression-testing.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs-community/current/developer-guide/regression-testing.md
@@ -603,6 +603,10 @@ Doris 支持一些外部署数据源的查询。所以回归框架也提供了
之后的启动脚本会，将 docker compose 中对应的名称进行替换，这样可以保证多套 containers 环境的容器名称和网络不会冲突。
+ 启动容器前，需要检查服务器/云主机的网络配置，确认/etc/hosts中是否配置了主机名（hostname）和主机 IP 地址（hostname
-i）的映射关系。
+
+ 形如：`10.0.0.46 iZj6cbwlx5pl6y0681t6scZ iZj6cbwlx5pl6y0681t6scZ`，分别为
IP 地址（hostname -i命令输出，一般为eth0的IP）、主机名（hostname命令输出）、别名（同前）。
+
1. 启动 Container
Doris 目前支持 es, mysql, pg, hive, sqlserver, oracle, iceberg, hudi, trino
等数据源的 Docker compose。相关文件存放在 `docker/thirdparties/docker-compose` 目录下。
@@ -615,6 +619,8 @@ Doris 支持一些外部署数据源的查询。所以回归框架也提供了
```
该命令需要 root 或 sudo 权限。命令返回成功，则代表所有 container 启动完成。可以通过 `docker ps -a` 命令查看。
+
+ container 启动过程中，可以通过 `docker logs -f <container-name>` 命令查看 container 的日志。
可以通过以下命令停止所有 container：
@@ -654,11 +660,12 @@ Doris 支持一些外部署数据源的查询。所以回归框架也提供了
3. Hive
- Hive 相关的 Docker compose 文件存放在 docker/thirdparties/docker-compose/hive
下。
+ Hive 相关的 Docker compose 文件存放在 docker/thirdparties/docker-compose/hive
下，支持Hive2和Hive3。
- * `hive-2x.yaml.tpl`：Docker compose 文件模板，无需修改。
- * `hadoop-hive.env.tpl`：配置文件的模板，无需修改。
- * `gen_env.sh`：初始化配置文件的脚本，可以在其中修改：`FS_PORT` 和 `HMS_PORT` 两个对外端口，分别对应
defaultFs 和 Hive metastore 的端口。默认为 8120 和 9183。`run-thirdparties-docker.sh`
启动时会自动调用这个脚本。
+ * `hive-2x.yaml.tpl`、`hive-3x.yaml.tpl`：Docker compose 文件模板，无需修改。
+ *
`hadoop-hive.env.tpl`、`hadoop-hive-2x.env.tpl`和`hadoop-hive-3x.env.tpl`：配置文件的模板，无需修改。
+ * `hive-2x_settings.env`：Hive2初始化配置文件的脚本，`run-thirdparties-docker.sh`
启动时会自动调用这个脚本。可以在其中修改：`FS_PORT`、`HMS_PORT`、`HS_PORT`和`PG_PORT`
四个对外端口，分别与`regression-conf.groovy`中的`hive2HdfsPort`、`hive2HmsPort`、`hive2ServerPort`和`hive2PgPort`相对应。前两个为hadoop配置的
defaultFs 和 Hive metastore 端口，默认为 8020 和 9083。
+ * `hive-3x_settings.env`：Hive3初始化配置文件的脚本，`run-thirdparties-docker.sh`
启动时会自动调用这个脚本。可以在其中修改：`FS_PORT`、`HMS_PORT`、`HS_PORT`和`PG_PORT`
四个对外端口，分别与`regression-conf.groovy`中的`hive3HdfsPort`、`hive3HmsPort`、`hive3ServerPort`和`hive3PgPort`相对应。前两个为hadoop配置的
defaultFs 和 Hive metastore 端口，默认为 8320 和 9383。
* `scripts/` 目录会在 container 启动后挂载到 container 中。其中的文件内容无需修改。但须注意，在启动
container 之前，需要先下载预制文件：
将
`https://doris-build-hk-1308700295.cos.ap-hongkong.myqcloud.com/regression/load/tpch1_parquet/tpch1.db.tar.gz`
文件下载到 `scripts/` 目录并解压即可。
@@ -811,12 +818,13 @@ Doris 支持一些外部署数据源的查询。所以回归框架也提供了
2. 运行回归测试
- 外表相关的回归测试默认是关闭的，可以修改 `regression-test/conf/regression-conf.groovy`
中的以下配置来开启：
+ 外表相关的回归测试默认是关闭的，可以修改 `regression-test/conf/regression-conf.groovy`
中的配置来开启，相关配置举例如下：
* `enableJdbcTest`：开启 jdbc 外表测试，需要启动 MySQL 和 Postgresql 的 container。
* `mysql_57_port` 和 `pg_14_port` 分别对应 MySQL 和 Postgresql 的对外端口，默认为 3316 和
5442。
* `enableHiveTest`：开启 hive 外表测试，需要启动 hive 的 container。
- * `hms_port` 对应 hive metastore 的对外端口，默认为 9183。
+ * `hive2HmsPort` 对应 hive2 metastore 的对外端口，默认为 9083。
+ * `hive2HdfsPort` 对应 hive2 hdfs namenode 的对外端口，默认为 8020。
* `enableEsTest`：开启 es 外表测试。需要启动 es 的 container。
* `es_6_port`：ES6 的端口。
* `es_7_port`：ES7 的端口。
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
