9aman opened a new pull request, #16496:
URL: https://github.com/apache/pinot/pull/16496
## Problem
For large tables, the segment status check process can take several minutes
to complete. The issue occurred when:
1. External view snapshot is taken at the beginning of the check
2. Individual segment checks use System.currentTimeMillis() for comparison
3. Segments updated after the snapshot but before their individual check
could be incorrectly flagged as OFFLINE
Solution
- Capture the external view snapshot timestamp (evSnapshotTimestamp) at
the beginning of the status check
- Use this consistent timestamp for all segment evaluations instead of
calling System.currentTimeMillis() for each segment
- This ensures all segments are evaluated against the same point in time
when the `external view was captured`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
