morningman opened a new pull request, #4622: URL: https://github.com/apache/doris-website/pull/4622
The Routine Load metric reference does not explain whether `doris_fe_routine_load_receive_bytes` measures source input or data written after a `WHERE` clause. Clarify that it counts received source-message payload bytes before filtering, including data excluded by `WHERE`, rather than table-write bytes. Fixes #2254. The same flow was checked on Doris master and branches 3.0, 3.1, 4.0 and 4.1: - The consumer subtracts `msg->len()` from its batch byte budget and reports the resulting `receive_bytes`. - `StreamLoadExecutor` transfers that count into `receivedBytes` in the Routine Load transaction attachment. - `RoutineLoadJob.updateNumOfData` increments the FE counter with that value, independently of the filtered/unselected row counts. Source example: [3.0 consumer](https://github.com/apache/doris/blob/4090f6c40d2238b7aff73185bcada48f96fbd6be/be/src/runtime/routine_load/data_consumer_group.cpp), [executor](https://github.com/apache/doris/blob/4090f6c40d2238b7aff73185bcada48f96fbd6be/be/src/runtime/stream_load/stream_load_executor.cpp), [FE accounting](https://github.com/apache/doris/blob/4090f6c40d2238b7aff73185bcada48f96fbd6be/fe/fe-core/src/main/java/org/apache/doris/load/routineload/RoutineLoadJob.java). ## Review and validation | Checkpoint | Conclusion | | --- | --- | | Goal | Distinguishes source payload from post-filter table writes. | | Scope | One metric-description cell in each counterpart. | | Versions/locales | Dev, 4.x, 3.x EN/ZH updated together; behavior checked in corresponding source branches. Archives unchanged. | | Links/navigation | No links, headings, routes or sidebars changed. | | Framework | Not affected. | | Validation | Reviewed consumer-to-FE accounting; checked six Markdown row shapes, JSON front matter and `git diff --check`. No cluster test or site build. | | Other issues | No introduced issue found in self-review. Does not claim the FE metric counts unreported/in-flight task bytes. | ## Versions - [x] dev - [x] 4.x - [x] 3.x - [ ] 2.1 or older ## Languages - [x] Chinese - [x] English ## Docs Checklist - [x] Checked by AI - [ ] Test Cases Built - [x] Updated required version and language counterparts - [x] Updated both languages -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
