pengding-stripe commented on PR #14443:
URL: https://github.com/apache/pinot/pull/14443#issuecomment-2480043312

   @rohityadav1993 I did more tests to push multiple segments, you can see that 
these segments are for different partitions with same timestamp. Because I 
submitted multiple job specs to a spark app and ran in parallel. This PR 
doesn't cover segment partition part though, it just fixes some bugs for Spark 
upsert table backfill. Users need to have their own upstream jobs to partition 
data correctly.
   <img width="733" alt="Screenshot 2024-11-15 at 10 05 17 AM" 
src="https://github.com/user-attachments/assets/1f400e04-67f6-4971-ba4c-1dde5682d817";>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org

Reply via email to