qidaye commented on code in PR #59486:
URL: https://github.com/apache/doris/pull/59486#discussion_r2654850084
##########
fe/fe-core/src/main/java/org/apache/doris/load/loadv2/BrokerLoadPendingTask.java:
##########
@@ -102,9 +102,12 @@ protected void getAllFileStatus() throws UserException {
boolean isBinaryFileFormat =
fileGroup.isBinaryFileFormat();
List<TBrokerFileStatus> filteredFileStatuses =
Lists.newArrayList();
for (TBrokerFileStatus fstatus : fileStatuses) {
- if (fstatus.getSize() == 0 && isBinaryFileFormat) {
+ boolean isSuccessFile =
fstatus.path.endsWith("/_SUCCESS")
Review Comment:
支持一个file Group中指定不同的文件类型后，这里其实不过滤也没有问题了。目前是为了保险起见增加了这个_SUCCESS文件的特殊过滤。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
