[GitHub] [camel-kafka-connector] arjun180 commented on issue #1236: idempotency support in Kafka AWS s3 source connector

[GitBox]

arjun180 commented on issue #1236:
URL: 
https://github.com/apache/camel-kafka-connector/issues/1236#issuecomment-884422512


   Once I removed the bootstrap server parameter, it just tries to connect to 
local host. The log snippet below keeps getting repeated 
   
   `kubectl logs -f my-kafka-connect-cluster-connect`
   ```
        at 
org.apache.camel.component.aws2.s3.AWS2S3Consumer.processBatch(AWS2S3Consumer.java:289)
        at 
org.apache.camel.component.aws2.s3.AWS2S3Consumer.poll(AWS2S3Consumer.java:164)
        at 
org.apache.camel.support.ScheduledPollConsumer.doRun(ScheduledPollConsumer.java:190)
        at 
org.apache.camel.support.ScheduledPollConsumer.run(ScheduledPollConsumer.java:107)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
        at 
java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
        at 
java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:829)
   2021-07-21 18:53:03,909 ERROR Failed delivery for (MessageId: 
AB7DE03FAF78DF0-00000000000E39D4 on ExchangeId: 
AB7DE03FAF78DF0-00000000000E39D4). Exhausted after delivery attempt: 1 caught: 
java.lang.IllegalStateException: Queue full
   
   Message History (complete message history is disabled)
   
---------------------------------------------------------------------------------------------------------------------------------------
   RouteId              ProcessorId          Processor                          
                                              Elapsed (ms)
   [route35           ] [route35           ] 
[from[aws2-s3://my-kakfa-connect?prefix=my-connect/&region=<region>] [        
35]
        ...
   [route35           ] [toD35             ] 
[seda:end?pollingConsumerQueueSize=1000&pollingConsumerBlockTimeout=0&pollingCo]
 [         0]
   
   Stacktrace
   
---------------------------------------------------------------------------------------------------------------------------------------
    (org.apache.camel.processor.errorhandler.DefaultErrorHandler) [Camel 
(camel-35) thread #67 - aws2-s3://my-kakfa-connect]
   java.lang.IllegalStateException: Queue full
        at java.base/java.util.AbstractQueue.add(AbstractQueue.java:98)
        at 
org.apache.camel.component.seda.SedaProducer.addToQueue(SedaProducer.java:251)
        at 
org.apache.camel.component.seda.SedaProducer.process(SedaProducer.java:149)
        at 
org.apache.camel.processor.SendDynamicProcessor.lambda$process$0(SendDynamicProcessor.java:197)
        at 
org.apache.camel.support.cache.DefaultProducerCache.doInAsyncProducer(DefaultProducerCache.java:318)
        at 
org.apache.camel.processor.SendDynamicProcessor.process(SendDynamicProcessor.java:182)
        at 
org.apache.camel.processor.errorhandler.RedeliveryErrorHandler$SimpleTask.run(RedeliveryErrorHandler.java:439)
        at 
org.apache.camel.impl.engine.DefaultReactiveExecutor$Worker.schedule(DefaultReactiveExecutor.java:181)
        at 
org.apache.camel.impl.engine.DefaultReactiveExecutor.scheduleMain(DefaultReactiveExecutor.java:62)
        at org.apache.camel.processor.Pipeline.process(Pipeline.java:167)
        at 
org.apache.camel.impl.engine.CamelInternalProcessor.process(CamelInternalProcessor.java:388)
        at 
org.apache.camel.component.aws2.s3.AWS2S3Consumer.processBatch(AWS2S3Consumer.java:289)
        at 
org.apache.camel.component.aws2.s3.AWS2S3Consumer.poll(AWS2S3Consumer.java:164)
        at 
org.apache.camel.support.ScheduledPollConsumer.doRun(ScheduledPollConsumer.java:190)
        at 
org.apache.camel.support.ScheduledPollConsumer.run(ScheduledPollConsumer.java:107)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
        at 
java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
        at 
java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:829)
   2021-07-21 18:53:03,909 WARN [Consumer 
clientId=consumer-d850d938-f647-481c-a82e-315512b12218-11, 
groupId=d850d938-f647-481c-a82e-315512b12218] Connection to node -1 
(localhost/127.0.0.1:9092) could not be established. Broker may not be 
available. (org.apache.kafka.clients.NetworkClient) [Camel (camel-43) thread 
#89 - KafkaIdempotentRepository]
   2021-07-21 18:53:03,909 WARN [Consumer 
clientId=consumer-d850d938-f647-481c-a82e-315512b12218-11, 
groupId=d850d938-f647-481c-a82e-315512b12218] Bootstrap broker localhost:9092 
(id: -1 rack: null) disconnected (org.apache.kafka.clients.NetworkClient) 
[Camel (camel-43) thread #89 - KafkaIdempotentRepository]
   2021-07-21 18:53:03,909 WARN Error processing exchange. 
Exchange[AB7DE03FAF78DF0-00000000000E39D4]. Caused by: 
[java.lang.IllegalStateException - Queue full] 
(org.apache.camel.component.aws2.s3.AWS2S3Consumer) [Camel (camel-35) thread 
#67 - aws2-s3://my-kakfa-connect]
   java.lang.IllegalStateException: Queue full
   
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org