xiaoDjun opened a new issue, #14599: URL: https://github.com/apache/doris/issues/14599
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version 1.1.3-rc02 ### What's Wrong? When use sparkload to import data into temporary partitions, the etl job failed. And the log shows no tem partitionInfo was found from the OlapTable#tempPartitions. Here are the stack trace in fe.log ``` 2022-11-17 16:17:57,421 WARN (Load etl checker|33) [LoadManager.lambda$processEtlStateJobs$6():452] update load job etl status failed. job id: 11881811 org.apache.doris.common.LoadException: errCode = 2, detailMessage = LOAD_JOB=11881811, database_id={9350049}, label={label_doris_test_dayliy_1117_4}, error_msg={all partitions have no load data} at org.apache.doris.load.loadv2.SparkLoadJob.submitPushTasks(SparkLoadJob.java:550) ~[doris-fe.jar:1.0-SNAPSHOT] at org.apache.doris.load.loadv2.SparkLoadJob.updateEtlStatus(SparkLoadJob.java:320) ~[doris-fe.jar:1.0-SNAPSHOT] at org.apache.doris.load.loadv2.LoadManager.lambda$processEtlStateJobs$6(LoadManager.java:446) ~[doris-fe.jar:1.0-SNAPSHOT] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) ~[?:1.8.0_172] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_172] at java.util.concurrent.ConcurrentHashMap$ValueSpliterator.forEachRemaining(ConcurrentHashMap.java:3566) ~[?:1.8.0_172] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) ~[?:1.8.0_172] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) ~[?:1.8.0_172] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) ~[?:1.8.0_172] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) ~[?:1.8.0_172] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_172] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) ~[?:1.8.0_172] at org.apache.doris.load.loadv2.LoadManager.processEtlStateJobs(LoadManager.java:444) ~[doris-fe.jar:1.0-SNAPSHOT] at org.apache.doris.load.loadv2.LoadEtlChecker.runAfterCatalogReady(LoadEtlChecker.java:42) ~[doris-fe.jar:1.0-SNAPSHOT] at org.apache.doris.common.util.MasterDaemon.runOneCycle(MasterDaemon.java:58) ~[doris-fe.jar:1.0-SNAPSHOT] at org.apache.doris.common.util.Daemon.run(Daemon.java:116) ~[doris-fe.jar:1.0-SNAPSHOT] ``` ### What You Expected? able to import to temporary partition using spark load. ### How to Reproduce? 1. `alter table doris_test add TEMPORARY PARTITION tp20221116 values [("2022-11-16"), ("2022-11-17"));` 2. ``` LOAD LABEL test.label_doris_test ( DATA FROM TABLE doris_test_hive_external INTO TABLE doris_test TEMPORARY PARTITION (tp20221116) SET ( k1=k1,k2=k2,k3=k3,dt=dt ) where dt = '2022-11-16' ) WITH RESOURCE 'sparkload_resource' ( "spark.executor.memory" = "5g", "spark.shuffle.compress" = "true" ) PROPERTIES ( "timeout" = "3600" ); ``` ### Anything Else? _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
