snleee commented on issue #6979: URL: https://github.com/apache/incubator-pinot/issues/6979#issuecomment-848387224
1. `SegmentProcessorFramework` does not need to know about the time buckets or start time. The only input config that we need is `timeGranularity (e.g. daily, monthly...etc)`. 2. Internally, the segment processor framework should correctly transform time column value and partition it accordingly based on the output partition value. ``` e.g. input data between 02/2021 to 05/2021 , use monthly time bucket time_column_value | partition value 05/21/2021 12:13:12 | 05/01/2021 04/13/2021 14:34:6 | 04/01/2021 ... ``` If we make sure that all the data with the same partition value goes to the same file, then we are good. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
