harangozop commented on issue #25030: URL: https://github.com/apache/pulsar/issues/25030#issuecomment-4154232102
Submitted a fix for this in the pulsar-connectors repo: https://github.com/apache/pulsar-connectors/pull/9 The PR addresses 4 root causes: 1. **Bounded internal queue** — `write()` now rejects records when the queue exceeds `maxQueueSize` (configurable, defaults to `batchSize * 10`), applying back-pressure via negative acknowledgment 2. **State check in `write()`** — records are failed immediately when sink state != OPEN 3. **Connection validation & auto-reconnect** — `ensureConnection()` validates via `Connection.isValid()` and reconnects before each flush 4. **Scheduled flush cancellation** — `fatal()` cancels the periodic flush task Includes 2 new tests. All existing tests pass. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
