zhtaoxiang opened a new pull request, #10335: URL: https://github.com/apache/pinot/pull/10335
In SegmentGenerationAndPushTask, the SEQUENCE_ID used to identify each segment is only unique to each round of task generation. Across multiple rounds of task generation, the SEQUENCE_ID can be the same. This may lead to segment name collision, and existing segments will be overridden. Since old segments are overridden, corresponding files become un-ingested, the generator will generate new tasks, which generates segments with same names, and override existing segments again... It becomes an endless loop We add uuid to segment name to avoid segment collision across multiple rounds of task generation to solve the problem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
