arjun180 commented on issue #1236:
URL:
https://github.com/apache/camel-kafka-connector/issues/1236#issuecomment-884402562
Sure, my configuration looks like this. I realized that there was an option
to add the broker config, so I did that as well :
```
apiVersion: kafka.strimzi.io/v1beta2
kind: KafkaConnector
metadata:
name: s3-source-connector
namespace :my-kakfa
labels:
strimzi.io/cluster: my-kafka-connect-cluster
spec:
class: org.apache.camel.kafkaconnector.aws2s3.CamelAws2s3SourceConnector
tasksMax: 1
config:
topics: my-test-topic
camel.source.path.bucketNameOrArn: my-kakfa-connect
#camel.source.endpoint.useDefaultCredentials Provider: true
camel.component.aws2-s3.useDefaultCredentialsProvider: true
camel.component.aws2-s3.deleteAfterRead: false
camel.source.endpoint.region: <region>
camel.source.endpoint.prefix: 'my-connect/'
camel.idempotency.enabled: true
camel.idempotency.repository.type: kafka
camel.idempotency.expression.type: body
camel.idempotency.kafka.topic : my.idempotency.topic
camel.idempotency.kafka.max.cache.size: 30000
camel.idempotency.kafka.poll.duration.ms: 150
camel.idempotency.kafka.bootstrap.servers : my-dev.com:9093
```
The error from the connector looks like this
```
at
org.apache.camel.processor.errorhandler.RedeliveryErrorHandler$SimpleTask.run(RedeliveryErrorHandler.java:439)
at
org.apache.camel.impl.engine.DefaultReactiveExecutor$Worker.schedule(DefaultReactiveExecutor.java:181)
at
org.apache.camel.impl.engine.DefaultReactiveExecutor.scheduleMain(DefaultReactiveExecutor.java:62)
at org.apache.camel.processor.Pipeline.process(Pipeline.java:167)
at
org.apache.camel.impl.engine.CamelInternalProcessor.process(CamelInternalProcessor.java:388)
at
org.apache.camel.component.aws2.s3.AWS2S3Consumer.processBatch(AWS2S3Consumer.java:289)
at
org.apache.camel.component.aws2.s3.AWS2S3Consumer.poll(AWS2S3Consumer.java:164)
at
org.apache.camel.support.ScheduledPollConsumer.doRun(ScheduledPollConsumer.java:190)
at
org.apache.camel.support.ScheduledPollConsumer.run(ScheduledPollConsumer.java:107)
at
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at
java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
at
java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2021-07-21 18:25:50,017 WARN [Producer clientId=producer-12] Connection to
node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be
available. (org.apache.kafka.clients.NetworkClient)
[kafka-producer-network-thread | producer-12]
2021-07-21 18:25:50,017 WARN [Producer clientId=producer-12] Bootstrap
broker localhost:9092 (id: -1 rack: null) disconnected
(org.apache.kafka.clients.NetworkClient) [kafka-producer-network-thread |
producer-12]
2021-07-21 18:25:50,044 WARN [Producer clientId=producer-15] Bootstrap
broker my-dev.com:9093 (id: -1 rack: null) disconnected
(org.apache.kafka.clients.NetworkClient) [kafka-producer-network-thread |
producer-15]
2021-07-21 18:25:50,045 WARN [Consumer
clientId=consumer-b3c6ac69-f646-4a35-88a3-086f914a64df-17,
groupId=b3c6ac69-f646-4a35-88a3-086f914a64df] Bootstrap broker my-dev.com:9093
(id: -1 rack: null) disconnected (org.apache.kafka.clients.NetworkClient)
[Camel (camel-49) thread #101 - KafkaIdempotentRepository]
```
It looks to be struggling to connect to my broker? But that's not been a
problem before
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
