尊敬的doris开发工程师,你好。我在使用贵公司的优秀产品doris时,遇到如下部署问题,无法解决,希望能得到你们的帮助。
问题:无法建表,识别不了be位置,保存如下
ERROR 1105 (HY000): errCode = 2, detailMessage = Failed to find 3 backends for
policy: cluster|query|load|schedule|tags|medium:
default_cluster|false|false|true|[{"location" : "default"}]|SSD
1. show backends\G; TotalCapacity为空 ,实际应为1.2T
*************************** 1. row ***************************
BackendId: 11002
Cluster: default_cluster
IP: 10.80.240.122
HeartbeatPort: 9050
BePort: 9060
HttpPort: 8040
BrpcPort: 8060
LastStartTime: 2023-03-30 10:22:46
LastHeartbeat: 2023-03-30 10:22:51
Alive: true
SystemDecommissioned: false
ClusterDecommissioned: false
TabletNum: 0
DataUsedCapacity: 0.000
AvailCapacity: 1.000 B
TotalCapacity: 0.000
UsedPct: 0.00 %
MaxDiskUsedPct: 0.00 %
RemoteUsedCapacity: 0.000
Tag: {"location" : "default"}
ErrMsg:
Version: doris-1.2.3-rc02-Unknown
Status:
{"lastStreamLoadTime":-1,"isQueryDisabled":false,"isLoadDisabled":false}
HeartbeatFailureCounter: 0
NodeRole: mix
*************************** 2. row ***************************
BackendId: 11003
Cluster: default_cluster
IP: 10.80.240.142
HeartbeatPort: 9050
BePort: 9060
HttpPort: 8040
BrpcPort: 8060
LastStartTime: 2023-03-30 10:22:47
LastHeartbeat: 2023-03-30 10:22:51
Alive: true
SystemDecommissioned: false
ClusterDecommissioned: false
TabletNum: 0
DataUsedCapacity: 0.000
AvailCapacity: 1.000 B
TotalCapacity: 0.000
UsedPct: 0.00 %
MaxDiskUsedPct: 0.00 %
RemoteUsedCapacity: 0.000
Tag: {"location" : "default"}
ErrMsg:
Version: doris-1.2.3-rc02-Unknown
Status:
{"lastStreamLoadTime":-1,"isQueryDisabled":false,"isLoadDisabled":false}
HeartbeatFailureCounter: 0
NodeRole: mix
*************************** 3. row ***************************
BackendId: 11001
Cluster: default_cluster
IP: 10.80.240.25
HeartbeatPort: 9050
BePort: 9060
HttpPort: 8040
BrpcPort: 8060
LastStartTime: 2023-03-30 10:22:43
LastHeartbeat: 2023-03-30 10:22:51
Alive: true
SystemDecommissioned: false
ClusterDecommissioned: false
TabletNum: 0
DataUsedCapacity: 0.000
AvailCapacity: 1.000 B
TotalCapacity: 0.000
UsedPct: 0.00 %
MaxDiskUsedPct: 0.00 %
RemoteUsedCapacity: 0.000
Tag: {"location" : "default"}
ErrMsg:
Version: doris-1.2.3-rc02-Unknown
Status:
{"lastStreamLoadTime":-1,"isQueryDisabled":false,"isLoadDisabled":false}
HeartbeatFailureCounter: 0
NodeRole: mix
2. be.INF日志 fail to get master client from cache. host=127.0.0.1, port=9020,
code=7
3. show frontends\G; 显示的也是127.0.0.1
*************************** 1. row ***************************
Name: 127.0.0.1_9010_1680073227993
IP: 127.0.0.1
EditLogPort: 9010
HttpPort: 8030
QueryPort: 9030
RpcPort: 9020
Role: FOLLOWER
IsMaster: true
ClusterId: 791948230
Join: true
Alive: true
ReplayedJournalId: 20014
LastHeartbeat: 2023-03-30 10:15:51
IsHelper: true
ErrMsg:
Version: doris-1.2.3-rc02-Unknown
CurrentConnected: Yes
背景:
1. 使用版本1.2.3
2. 集群规划
| 服务器 | IP | ROLE | cpu | 内存 | 磁盘 |
| ------- | ------------- | ---------- | ---- | ---- | ---- |
| doris01 | 10.80.240.42 | FE | 32c | 128G | 100G |
| doris02 | 10.80.240.25 | BE、Broker | 32c | 128G | 1.2T |
| doris03 | 10.80.240.122 | BE、Broker | 32c | 128G | 1.2T |
| doris04 | 10.80.240.142 | BE、Broker | 32c | 128G | 1.2T |
3. fe & be 配置(均无多网卡)
# fe(10.80.240.42)
priority_networks=10.80.240.42/32
meta_dir=/app_home/data/doris/doris-meta
sys_log_dir=/app_home/data/doris/logs/doris/sys
audit_log_dir=/app_home/data/doris/logs/doris/audit
# be(10.80.240.25 10.80.240.122 10.80.240.142)
priority_networks=10.80.240.25/32 #对应每台机器的IP
10.80.240.25/32 10.80.240.122/32 10.80.240.142/32
JAVA_HOME=/usr/local/java/jdk1.8.0_201
storage_root_path=/app_home/data/doris/doris-data
sys_log_dir=/app_home/data/doris/logs/doris/sys
4. 部署过程
4.1 在fe(10.80.240.42)上启动fe,在三台be(10.80.240.25 10.80.240.122 10.80.240.142)启动be
4.2 将be添加至集群
MySQL [(none)]> ALTER SYSTEM ADD BACKEND "10.80.240.25:9050";
MySQL [(none)]> ALTER SYSTEM ADD BACKEND "10.80.240.122:9050";
MySQL [(none)]> ALTER SYSTEM ADD BACKEND "10.80.240.142:9050";
4.3 建表
create database demo;
use demo;
CREATE TABLE IF NOT EXISTS demo.example_tbl
(
`user_id` LARGEINT NOT NULL COMMENT "用户id",
`date` DATE NOT NULL COMMENT "数据灌入日期时间",
`city` VARCHAR(20) COMMENT "用户所在城市",
`age` SMALLINT COMMENT "用户年龄",
`sex` TINYINT COMMENT "用户性别",
`last_visit_date` DATETIME REPLACE DEFAULT "1970-01-01 00:00:00" COMMENT
"用户最后一次访问时间",
`cost` BIGINT SUM DEFAULT "0" COMMENT "用户总消费",
`max_dwell_time` INT MAX DEFAULT "0" COMMENT "用户最大停留时间",
`min_dwell_time` INT MIN DEFAULT "99999" COMMENT "用户最小停留时间"
)
AGGREGATE KEY(`user_id`, `date`, `city`, `age`, `sex`)
DISTRIBUTED BY HASH(`user_id`) BUCKETS 1
PROPERTIES (
"replication_allocation" = "tag.location.default: 3",
"storage_medium" = "ssd"
);
报如下错误:
ERROR 1105 (HY000): errCode = 2, detailMessage = Failed to find 3 backends for
policy: cluster|query|load|schedule|tags|medium:
default_cluster|false|false|true|[{"location" : "default"}]|SSD