Re: [I] Doris 冷存HDFS频繁出现block读取失败导致SQL执行失败[Bug] [doris]

2024-12-17 Thread via GitHub
fdf1779 commented on issue #44236: URL: https://github.com/apache/doris/issues/44236#issuecomment-2550180904 > It seems that your hdfs missed blocks. 在HDFS上这个文件是没有block丢失的情况的,而且当我减少查询分区跨度的时候也是能查询出来的,这个是因为读取并发过大导致的,并非HDFS本身的异常。 -- This is an automated message from the Apache Git Serv

Re: [I] Doris 冷存HDFS频繁出现block读取失败导致SQL执行失败[Bug] [doris]

2024-12-17 Thread via GitHub
dataroaring commented on issue #44236: URL: https://github.com/apache/doris/issues/44236#issuecomment-2548426228 It seems that your hdfs missed blocks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [I] Doris 冷存HDFS频繁出现block读取失败导致SQL执行失败[Bug] [doris]

2024-12-03 Thread via GitHub
ixzc commented on issue #44236: URL: https://github.com/apache/doris/issues/44236#issuecomment-2513967883 we will fix this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] Doris 冷存HDFS频繁出现block读取失败导致SQL执行失败[Bug] [doris]

2024-11-18 Thread via GitHub
fdf1779 commented on issue #44236: URL: https://github.com/apache/doris/issues/44236#issuecomment-2484638082 > 2、增加在冷存HDFS完成的tablet进行完整性校验,保证上报的完整性 还有就是在冷存HDFS时,如果冷存前是多副本存储在冷存后会出现HDFS和Doris各存在一个副本的情况,因此希望能够自动去重本地磁盘的副本,只保存HDFS远端存储的文件,而且实际的be元数据最好还是保留多副本(在两个节点保留元数据)。 -- This is an