mongo360 opened a new pull request, #24157:
URL: https://github.com/apache/doris/pull/24157
Problem:
broker load fail when the job has _or_ expression in _where_ condition。
Steps to reproduce:
> LOAD LABEL test_label (
DATA
INFILE("hdfs://127.0.0.1:9000/test/est_data.csv")
INTO TABLE tbl_test_broker_load_with_where
COLUMNS TERMINATED BY ","
FORMAT as "csv"
WHERE
k1 in (11001,11002)
and (
k3 in (1)
or k4 in (1, 2)
)
)
with BROKER "hdfs_broker" (
"username"="ads_report",
"password"="")
PROPERTIES (
"timeout"="1200",
"max_filter_ratio"="0.1");
error message:
> 2023-09-02 15:27:11,513 WARN (pending-load-task-scheduler-pool-0|224)
[LoadTask.exec():73] LOAD_JOB=71011, error_msg={Unexpected failed to execute
load task}
java.lang.IllegalStateException: null
at
com.google.common.base.Preconditions.checkState(Preconditions.java:492)
~[guava-30.0-jre.jar:?]
at org.apache.doris.analysis.SlotRef.getTableName(SlotRef.java:264)
~[doris-fe.jar:1.2-SNAPSHOT]
at
org.apache.doris.rewrite.ExtractCommonFactorsRule.rewriteOrToIn(ExtractCommonFactorsRule.java:532)
~[doris-fe.jar:1.2-SNAPSHOT]
at
org.apache.doris.rewrite.ExtractCommonFactorsRule.makeCompoundRemaining(ExtractCommonFactorsRule.java:455)
~[doris-fe.jar:1.2-SNAPSHOT]
at
org.apache.doris.rewrite.ExtractCommonFactorsRule.extractCommonFactors(ExtractCommonFactorsRule.java:205)
~[doris-fe.jar:1.2-SNAPSHOT]
at
org.apache.doris.rewrite.ExtractCommonFactorsRule.apply(ExtractCommonFactorsRule.java:80)
~[doris-fe.jar:1.2-SNAPSHOT]
at
org.apache.doris.rewrite.ExtractCommonFactorsRule.apply(ExtractCommonFactorsRule.java:92)
~[doris-fe.jar:1.2-SNAPSHOT]
at
org.apache.doris.rewrite.ExprRewriter.applyRuleOnce(ExprRewriter.java:146)
~[doris-fe.jar:1.2-SNAPSHOT]
at
org.apache.doris.rewrite.ExprRewriter.rewrite(ExprRewriter.java:139)
~[doris-fe.jar:1.2-SNAPSHOT]
at
org.apache.doris.planner.external.ExternalFileScanNode.initWhereExpr(ExternalFileScanNode.java:312)
~[doris-fe.jar:1.2-SNAPSHOT]
at
org.apache.doris.planner.external.ExternalFileScanNode.initAndSetWhereExpr(ExternalFileScanNode.java:293)
~[doris-fe.jar:1.2-SNAPSHOT]
at
org.apache.doris.planner.external.ExternalFileScanNode.initParamCreateContexts(ExternalFileScanNode.java:274)
~[doris-fe.jar:1.2-SNAPSHOT]
at
org.apache.doris.planner.external.ExternalFileScanNode.init(ExternalFileScanNode.java:207)
~[doris-fe.jar:1.2-SNAPSHOT]
Solved:
add tableref and do whereExpr analyze before do whereexpr rewrite.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
