mqliang commented on pull request #6710: URL: https://github.com/apache/incubator-pinot/pull/6710#issuecomment-806145868
@Jackie-Jiang > High level question: why do we need this new field? We should be able to use the metadata field for this We wanner measure CPU time to serialize datatable (AKA: `serialization_cost`)on each server, and send it back to broker. Here is the dilemma: we will only know the CPU time after the serialization is completed, however if the serialization is already completed, how can make `serialization_cost` as part of the payload (it's a chicken-and-egg problem)? To add `serialization_cost` to serialized bytes of datatable, basically we have two options (we don't want serialize two times): * append it to the end of bytes. * put a temporary value of serialization_cost when serialization, after serialization is done, replace it as the actual value. No matter which options we adopt, we need bump up the version. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
