qidaye commented on PR #44999: URL: https://github.com/apache/doris/pull/44999#issuecomment-2581606221
This pull request introduces several updates to the `logstash-output-doris` plugin, including the addition of a retry mechanism for handling failed events, improvements to logging, and minor bug fixes. The most important changes are summarized below: ### Retry Mechanism: * Added a new `max_retry_queue_size` configuration option to limit the size of the retry queue. * Implemented a retry mechanism using a `DelayQueue` to handle failed events and retry them with exponential backoff. [[1]](diffhunk://#diff-6d787856fd5c1daa72da68f5f3a8954c47a5a2fbe868c14ec4c882117eff157fR137-R175) [[2]](diffhunk://#diff-6d787856fd5c1daa72da68f5f3a8954c47a5a2fbe868c14ec4c882117eff157fL160-R245) * Introduced a new `DelayEvent` class to manage delayed events in the retry queue. ### Logging Improvements: * Enhanced logging to provide more detailed information about the retry process and response statuses. [[1]](diffhunk://#diff-6d787856fd5c1daa72da68f5f3a8954c47a5a2fbe868c14ec4c882117eff157fL160-R245) [[2]](diffhunk://#diff-6d787856fd5c1daa72da68f5f3a8954c47a5a2fbe868c14ec4c882117eff157fL287-R326) ### Bug Fixes: * Corrected a typo in the configuration comment for `label_prefix`. * Simplified the `send_events` method to improve readability and efficiency. These changes aim to improve the robustness and maintainability of the `logstash-output-doris` plugin. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
