bowen-stripe opened a new issue #8011: URL: https://github.com/apache/pinot/issues/8011
whenever i refresh an offline table (via Spark to run job SegmentCreationAndMetadataPush), Pinot server CPU usage goes up (from 15% to 70%) and query latency is affected noticeably (from 20ms to 2s) during that time. Reducing `pushParallelism` (to 2) helps but latency impact is still noticeable (from 20ms to 1s). We need a way to offload these table preparation work from Pinot server to minimize query performance impact. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
