Kris1314Love opened a new issue, #222: URL: https://github.com/apache/doris-spark-connector/issues/222
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version Spark Doris Connector 3.1_2.12 Spark 3.4.0 Doris 2.0.0 ### What's Wrong? When Spark reads Doris data as a DataFrame based on time conditions, if the time condition data keeps growing, updating the read DataFrame data will cause inaccurate updates ### What You Expected? fix this bug ### How to Reproduce? Doris Spark connector reads Doris data as a DataFrame based on time conditions. At this time, a routineload is writing data to the table where the DataFrame is located with the same time condition. Then, it writes the read DataFrame data to other tables in Doris and updates a column of data in the DataFrame to be written back to the original table in Doris. However, it is found that the number of data written to other tables does not match the number of data updated ### Anything Else? doris- spark-connector按照时间条件读取Doris数据为DataFrame、此时有routineload正在往DataFrame所在表里相同时间条件写数据、然后将读取到的DataFrame数据写入Doris其他表、并更新DataFrame中一列的数据写回Doris原始表里、会发现写入到其他表的数据条数和更新的数据条数不一致 ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
