Jackie-Jiang commented on issue #15802: URL: https://github.com/apache/pinot/issues/15802#issuecomment-2899413539
There is one potential issue if we remove the key immediately from the metadata when the flag is set: if by any chance the events come at wrong order (this is possible from upstream), the old event will be ingested again because the key doesn't exist. So starting the metadata TTL timer is a good way to workaround it. One thing we need to handle: if we allow certain events to not honor TTL, we cannot skip loading metadata for any segment. cc @klsince @tibrewalpratik17 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
