Jackie-Jiang commented on PR #13362: URL: https://github.com/apache/pinot/pull/13362#issuecomment-2204749693
After a second thought, the root cause of the problem is that: retention manager always keeps the last completed segment even if it is already expired. I think we need to fix this behavior because it is violating the retention agreement. @sajjad-moradi Do you think consumption pause/resume can work if we cleanup the last committed segment? Basically we should resume from the earliest offset @KKcorps Does Kinesis work if we clean up the last committed segment for a closed partition? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
