Jackie-Jiang opened a new issue, #10800: URL: https://github.com/apache/pinot/issues/10800
Currently, when snapshot is enabled, snapshot is taken when shutting down the server. This will cause inconsistency because the changes made by the new consuming segment has already been reflected into the snapshots, but when we restart the servers and reload all the segments, the consuming segment will be re-consumed. This problem is more critical for partial-upsert table because the snapshot will mark the old record as invalid, but the new record still sit in the consuming segment thus not persisted. The fix should be to persist the snapshot when a new consuming segment is created but before any record is consumed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
