mapshen commented on issue #7004: URL: https://github.com/apache/incubator-pinot/issues/7004#issuecomment-882903914
Unfortunately no. We don't always only care about the latest. Also, this UPSERT feature has its limitations as documented here [1], of which the required partition expansion is a showstopper already. On top of it, we need to break ties correctly and reliably when it happens, for which we cannot rely on the time column, as there might be 2 messages with the same timestamp and primary key but different offsets. [1] https://docs.google.com/document/d/1qljEMndPMxbbKtjlVn9mn2toz7Qrk0TGQsHLfI--7h8/edit#bookmark=kix.zg5cmgwqyx7e -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
