luwei16 opened a new pull request, #67181:
URL: https://github.com/apache/doris/pull/67181
### What problem does this PR solve?
Issue Number: None
Related PR: None
Problem Summary: In cloud mode, time-based incremental reads treated an
empty committed-transaction list as proof that a read window was complete. A
transaction could already have a commit timestamp in the window while its
delete bitmap and partition version were still being published, allowing the
query to return an empty result and downstream consumers to close the window.
Capture a MetaService transaction ID watermark at query start, wait for earlier
target-table transactions to finish through the existing conflict check, and
fetch fresh visible versions for incremental scans after the wait.
### Release note
Cloud time-based incremental reads now wait for transactions registered
before query start to finish and read the latest visible partition versions
before scanning.
### Check List (For Author)
- Test: Unit Test
- ./run-fe-ut.sh --run
org.apache.doris.qe.TimeBasedChangeVisibleWaiterTest,org.apache.doris.planner.OlapScanNodeTest
- ./build.sh --fe
- Behavior changed: Yes. Cloud time-based incremental reads wait for
query-start transactions and fail on wait/check timeout or error instead of
succeeding against an incomplete snapshot.
- Does this need documentation: No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
