jadami10 opened a new pull request, #17200:
URL: https://github.com/apache/pinot/pull/17200

   This is a small `bugfix` to support `TIMESTAMP` time columns in Pinot 
deduplication. This is actually already mostly supported since `TIMESTAMP` 
stores a long data type, but the table config util disallowed it because 
`TIMESTAMP` is not strictly numeric. 
https://github.com/apache/pinot/blob/master/pinot-segment-local/src/main/java/org/apache/pinot/segment/local/indexsegment/mutable/MutableSegmentImpl.java#L718
 actually just needs the underlying data to be numeric.
   
   This has unit tests in this PR. I also deployed this to an internal cluster 
that publishes synthetic, duplicate data and verified deduplication continues 
to work.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to