pengding-stripe commented on PR #14443: URL: https://github.com/apache/pinot/pull/14443#issuecomment-2480043312
@rohityadav1993 I did more tests to push multiple segments, you can see that these segments are for different partitions with same timestamp. Because I submitted multiple job specs to a spark app and ran in parallel. This PR doesn't cover segment partition part though, it just fixes some bugs for Spark upsert table backfill. Users need to have their own upstream jobs to partition data correctly. <img width="733" alt="Screenshot 2024-11-15 at 10 05 17 AM" src="https://github.com/user-attachments/assets/1f400e04-67f6-4971-ba4c-1dde5682d817";> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
