morningman commented on PR #63376: URL: https://github.com/apache/doris/pull/63376#issuecomment-4628709312
## Redundant re-serialization on the Parquet cold-read path When writing to disk, the footer is **re-serialized** via `to_thrift()` + `ThriftSerializer`, even though `parse_thrift_footer` just read the original footer bytes from the file moments earlier. This adds one serialization pass of CPU per cold read. If you're willing to change the `parse_thrift_footer` interface to expose the raw footer bytes, you could persist those bytes directly and skip the re-serialization. This is an optimization and can be done as a follow-up. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
