mortimer-cra opened a new issue, #17210:
URL: https://github.com/apache/doris/issues/17210

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no 
similar issues.
   
   
   ### Version
   
   1.2.1
   
   ### What's Wrong?
   
   UNIQUE表通过spark导入数据后,数据条数对不上、多次查询count数据条数不一。yarn、fe.log日志均无报错信息
   
   
![image](https://user-images.githubusercontent.com/29452751/221735275-5e056c99-39c8-425f-90e5-a6d6b0d06bc8.png)
   
   建表语句:
   
   ```
   create table xxxx()
   UNIQUE KEY(`msisdn`)
   DISTRIBUTED BY HASH(`msisdn`) BUCKETS 50;
   ```
   
   导入语句:
   
   ```
   LOAD LABEL spark_12
   (
       DATA INFILE("hdfs://ns3/user/liujinguang_pt/test_load/big1/*")
       INTO TABLE migu_user_label_mix_total_test_2
       FORMAT AS "parquet"
   )
   WITH RESOURCE 'spark0'
   (
       "spark.executor.memory" = "8g",
       "spark.shuffle.compress" = "true"
   )
   PROPERTIES
   (
       "timeout" = "21600",
        "max_filter_ratio" = "0.5"
   );
   ```
   
   spark-shell 统计相同路径结果截图
   
![image](https://user-images.githubusercontent.com/29452751/221735786-c2b1389c-b4f2-465a-81bd-23145a575507.png)
   
   
   
   ### What You Expected?
   
   可以保证数据的正确性
   
   ### How to Reproduce?
   
   _No response_
   
   ### Anything Else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org

Reply via email to