hongkunxu opened a new pull request, #16890: URL: https://github.com/apache/pinot/pull/16890
Aiming the issue: #16889，I have developed a new job command called: **BackfillIngestionJobCommand** This job leverages Pinot's segment lineage functionality as its core mechanism. And the detail workflow consist of following steps: 1. **Fetch Segments**: Retrieve the existing segments that are scheduled for backfill and replacement. 2. **Generate Segments**: Execute the segment generation job locally to produce new segments. 3. **Create Lineage**: Establish a lineage entry to track the relationship between old and newly generated segments. 4. **Push & Finalize**: Upload the new segments to Pinot and mark the lineage entry as completed to make them active. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
