vrajat opened a new issue, #16015:
URL: https://github.com/apache/pinot/issues/16015

   `PerQueryCPUMemResourceUsageAccountant` uses request id as the id as the key 
to accumulate resource usage statistics. However the request id is different 
b/w broker and server as well as b/w OFFLINE/REALTIME requests in the server. 
Check the examples below - one from SSE and another from MSE:
   
   
![Image](https://github.com/user-attachments/assets/b791a394-e466-4cc5-8e2c-2c64055e8176)
   
![Image](https://github.com/user-attachments/assets/66a001fa-2a2e-4788-aac6-9790570f10fc)
   
   * query id is numerical in the broker.
   * query id has a prefix as well as two types of suffix `O | R` on the server 
depending on the table that is being processed. 
   
   Due to these differences, aggregation will not happen correctly on the 
server AND it cumbersome to track resource usage across components. 
   
   Use (correlation 
id)[https://docs.pinot.apache.org/users/user-guide-query/query-correlation-id] 
as the key. Check the example below where the query id is consistent across all 
threads.
   
   
![Image](https://github.com/user-attachments/assets/b705e3ad-456a-49e2-a7b5-054ac06614cd)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org

Reply via email to