mcvsubbu commented on issue #6453: URL: https://github.com/apache/incubator-pinot/issues/6453#issuecomment-762444076
I am not sure creating empty segments is a good idea all the time. Certainly, for offline use cases, it is better to flag this early and fail the job, so at the minimum, we should implement this as an option. Even in the realtime use cases, generating many empty segments may cause unnecessary overhead during query processing. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org