This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 71d9b383d4 [Enhancement](hdfs) Support loading hdfs config for be from
hdfs-site.xml (#11634)
71d9b383d4 is described below
commit 71d9b383d416a728d98b380d0b707bec57623717
Author: caiconghui <55968745+caicong...@users.noreply.github.com>
AuthorDate: Wed Aug 10 14:49:50 2022 +0800
[Enhancement](hdfs) Support loading hdfs config for be from hdfs-site.xml
(#11634)
* [Enhancement](hdfs) Support loading hdfs config for be from hdfs-site.xml
Co-authored-by: caiconghui1 <caicongh...@jd.com>
---
be/CMakeLists.txt | 1 +
bin/start_be.sh | 3 +++
docs/en/docs/ecosystem/external-table/hive-of-doris.md | 2 +-
docs/zh-CN/docs/ecosystem/external-table/hive-of-doris.md | 1 +
4 files changed, 6 insertions(+), 1 deletion(-)
diff --git a/be/CMakeLists.txt b/be/CMakeLists.txt
index 6d96322f93..0c204f353c 100644
--- a/be/CMakeLists.txt
+++ b/be/CMakeLists.txt
@@ -844,6 +844,7 @@ install(FILES
${BASE_DIR}/../conf/be.conf
${BASE_DIR}/../conf/odbcinst.ini
${BASE_DIR}/../conf/asan_suppr.conf
+ ${BASE_DIR}/../conf/hdfs-site.xml
DESTINATION ${OUTPUT_DIR}/conf)
get_property(dirs DIRECTORY ${CMAKE_CURRENT_SOURCE_DIR} PROPERTY
INCLUDE_DIRECTORIES)
diff --git a/bin/start_be.sh b/bin/start_be.sh
index 4944230252..cab04e610a 100755
--- a/bin/start_be.sh
+++ b/bin/start_be.sh
@@ -186,6 +186,9 @@ if [ ${RUN_IN_AWS} -eq 0 ]; then
export AWS_EC2_METADATA_DISABLED=true
fi
+## set hdfs conf
+export LIBHDFS3_CONF=${DORIS_HOME}/conf/hdfs_site.xml
+
if [ ${RUN_DAEMON} -eq 1 ]; then
nohup $LIMIT ${DORIS_HOME}/lib/doris_be "$@" >> $LOG_DIR/be.out 2>&1 <
/dev/null &
else
diff --git a/docs/en/docs/ecosystem/external-table/hive-of-doris.md
b/docs/en/docs/ecosystem/external-table/hive-of-doris.md
index ce0bd3579b..b9c9726053 100644
--- a/docs/en/docs/ecosystem/external-table/hive-of-doris.md
+++ b/docs/en/docs/ecosystem/external-table/hive-of-doris.md
@@ -165,7 +165,7 @@ PROPERTIES (
**Note:**
- To enable Doris to access the hadoop cluster with kerberos authentication
enabled, you need to deploy the Kerberos client kinit on the Doris all FE and
BE nodes, configure krb5.conf, and fill in the KDC service information.
- The value of the PROPERTIES property `hadoop.kerberos.keytab` needs to
specify the absolute path of the keytab local file and allow the Doris process
to access it.
-
+- The configuration of the HDFS cluster can be written into the hdfs-site.xml
file. The configuration file is in the conf directory of fe and be. When users
create a Hive table, they do not need to fill in the relevant information of
the HDFS cluster configuration.
diff --git a/docs/zh-CN/docs/ecosystem/external-table/hive-of-doris.md
b/docs/zh-CN/docs/ecosystem/external-table/hive-of-doris.md
index e5441d1315..0b59c3f2c0 100644
--- a/docs/zh-CN/docs/ecosystem/external-table/hive-of-doris.md
+++ b/docs/zh-CN/docs/ecosystem/external-table/hive-of-doris.md
@@ -166,6 +166,7 @@ PROPERTIES (
**注意：**
- 若要使 Doris 访问开启kerberos认证方式的hadoop集群，需要在 Doris 集群所有运行节点上部署 Kerberos 客户端
kinit，并配置 krb5.conf，填写KDC 服务信息等。
- PROPERTIES 属性 `hadoop.kerberos.keytab` 的值需要指定 keytab 本地文件的绝对路径，并允许 Doris
进程访问该本地文件。
+-
关于HDFS集群的配置可以写入hdfs-site.xml文件中，该配置文件在fe和be的conf目录下，用户创建Hive表时，不需要再填写HDFS集群配置的相关信息。
## 类型匹配
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
