fdf1779 opened a new issue, #44236: URL: https://github.com/apache/doris/issues/44236
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version 2.1.2 ### What's Wrong? 使用Doris进行冷备，数据量过大，Doris查询并发较高，在读取时频繁出现missing blocks的错误，但是实际上HDFS的block是正常的，只是在读取并发过大的时候出现了错误，如果每次减少查询分区，分多次查询就可以正常返回，因此确定并非HDFSblock块丢失，HDFS也未显示有块丢失，而是并发较高时读取出现异常后Doris直接进行失败返回。  ### What You Expected? 1、增加Doris冷存HDFS时的写入失败重试最好是针对HDFS block级别的 2、增加在冷存HDFS完成的tablet进行完整性校验，保证上报的完整性 3、增加冷存HDFS的失败tablet自动清除 4、增加冷存HDFS block块级别的读取异常的自动重试功能，最好是允许配置最大重试次数 5、允许用户配置tablet丢失在允许数据缺失的情况下返回剩余部分的数据。类似于spark的spark.sql.files.ignoreCorruptFiles=true ### How to Reproduce? _No response_ ### Anything Else? _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
