pengding-stripe opened a new pull request, #14443: URL: https://github.com/apache/pinot/pull/14443
`bugfix` ### Summary - `SegmentNameGenerator` for `UPLOADED_REALTIME` should get parameters from job spec instead of table config. This PR fixes this issue https://github.com/apache/pinot/issues/14083 - `getTableConfig` doesn't handle realtime table which looks like `{"REALTIME": {...)}`, `SparkSegmentGenerationJobRunner` uses it to decode table config and create segments This PR fills gaps of backfilling upsert table with batch data using Spark ### Test I uploaded a segment with one row of fake data using Spark ingestion pipeline, verified query returns fake data for this primary key `charge_id` now. <img width="1367" alt="Screenshot 2024-11-13 at 1 56 36 PM" src="https://github.com/user-attachments/assets/af65f648-eaa9-4037-a9d0-5af6f0d2ea6f";> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
