oker1 opened a new pull request #6994: URL: https://github.com/apache/incubator-pinot/pull/6994
## Description We saw high disk usage when using RealtimeToOfflineSegmentsTask, and as I looked into the code I've found that it keeps lots of temporary files around until the whole task is finished. As I understand the compressed files can be deleted immediately after they are extracted, and the extracted segment files don't need to be copied. It would be even better to download/extract/process the files one by one to reduce the disk space needed for the task, but this seems like a small change with nice immediate benefits. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
