cadonna commented on PR #16684: URL: https://github.com/apache/kafka/pull/16684#issuecomment-2252568028
> Even if we ignore all DSL features (eg suppress(), emit-final aggregations, caching/forward coupling), I can have a custom Processor with state store, I can put a record into the store and don't forward anything. Next, when a second input record comes in, I pull out the first record and forward it and processing downstream could lead to an error. For an error handling, it seems most useful to get the first record handed into it, and the source record (which is the second record) might not be too helpful for this case? Given that we pass into the processing exception handler the first record (i.e. the record that throws the error), the raw source record (i.e. the record read from the source topic partition of the current sub-topology of the task) in the error handler context would give the context for which source record the first record ran into the issue. I think this is valuable information, although not for each and every use case. However, I am wondering whether the topic, partition, and offset would not be enough to give context. In the end, those are the information to identify the raw source record. The good thing is that we have all of this information in the current caches and buffers as far as I understand. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
