Re: [PR] [Fix] fix arrow read timestamp bug [doris-spark-connector]

2024-08-04 Thread via GitHub
JNSimba merged PR #221: URL: https://github.com/apache/doris-spark-connector/pull/221 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

Re: [PR] [Fix] fix arrow read timestamp bug [doris-spark-connector]

2024-07-29 Thread via GitHub
liugddx commented on code in PR #221: URL: https://github.com/apache/doris-spark-connector/pull/221#discussion_r1696166655 ## spark-doris-connector/src/main/java/org/apache/doris/spark/serialization/RowBatch.java: ## @@ -369,28 +374,23 @@ public void convertArrowToRowBatch() th

Re: [PR] [Fix] fix arrow read timestamp bug [doris-spark-connector]

2024-07-29 Thread via GitHub
liugddx commented on code in PR #221: URL: https://github.com/apache/doris-spark-connector/pull/221#discussion_r1696166655 ## spark-doris-connector/src/main/java/org/apache/doris/spark/serialization/RowBatch.java: ## @@ -369,28 +374,23 @@ public void convertArrowToRowBatch() th

Re: [PR] [Fix] fix arrow read timestamp bug [doris-spark-connector]

2024-07-29 Thread via GitHub
JNSimba commented on code in PR #221: URL: https://github.com/apache/doris-spark-connector/pull/221#discussion_r1696163971 ## spark-doris-connector/src/main/java/org/apache/doris/spark/serialization/RowBatch.java: ## @@ -369,28 +374,23 @@ public void convertArrowToRowBatch() th

[PR] [Fix] fix arrow read timestamp bug [doris-spark-connector]

2024-07-29 Thread via GitHub
liugddx opened a new pull request, #221: URL: https://github.com/apache/doris-spark-connector/pull/221 # Proposed changes Issue Number: close #xxx Currently, when reading arrow, since the be layer hard-codes all datetimev2 scales to 6, arrow returns TimeStampMicroVector