jackjlli commented on issue #8068: URL: https://github.com/apache/pinot/issues/8068#issuecomment-1021862826
@Manis99803 For APPEND use cases, these timestamps are the minmax value of the time column in your raw input file, which differentiates which batch of jobs the segments belong to. Without the values of time column appeared in the segment name, there is no way to tell when this batch of segments it belong to. What's worse, since segment name is the identifier for segment, if the minmax value is missing from the segment name, the newer batch of segments will replace the existing segments in the table, since the segment name would be the same (e.g. old and new segment name are both called `user_OFFLINE_0`). Unless you want to use REFRESH type for the table, where the time column field isn't needed, then you can skip the minmax value in the segment name. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
