jtao15 commented on issue #6979: URL: https://github.com/apache/incubator-pinot/issues/6979#issuecomment-849869980
Besides the time partition, it's good to make the resulted segment name configurable also. Listing down the requirements of the improvements: 1. Time partition - Partition bucket granularity (Hourly, Daily, Weekly, Monthly, Yearly) should be configurable. - Each mapper directory can only contains data in one time bucket. (E.g. merge segments (from 02/2021 to 05/2021) by month, there should be 4 mapper phase result directories: 02/2021, 03/2021, 04/2021, 05/2021) 2. Segment name - The name patterns or prefixes of result segments should be configurable. - The result segments of minion tasks should not collide with current segments. - The segments between minion tasks (same or different task types) should not collide with each other. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
