saranyaeu2987 commented on issue #282: URL: https://github.com/apache/camel-kafka-connector/issues/282#issuecomment-646336477
> And you don't have to replace any jar in your plugin. Simply download the Aws2 s3 zipped connector and unzip it in your plugin path. Don't mix up dependencies. Thats what I did in last run. **Configurations** 1. K8S on EKS cluster. Pod instance config  2. Yaml file ``` apiVersion: kafka.strimzi.io/v1alpha1 kind: KafkaConnector metadata: name: s3-abcd-connector labels: strimzi.io/cluster: emd-kafka-cluster spec: class: org.apache.camel.kafkaconnector.CamelSinkConnector tasksMax: 1 config: key.converter: org.apache.kafka.connect.storage.StringConverter value.converter: org.apache.kafka.connect.storage.StringConverter topics: DB.EMD.COMPANY.0 camel.sink.url: aws2-s3://<bucketname>?keyName=s3-connect/${date:now:yyyyMMdd}/${date:now:yyyyMMdd-HHmmssSSS} camel.sink.maxPollDuration: 1000 camel.sink.maxBatchPollSize: 10 camel.component.aws2-s3.configuration.autocloseBody: false camel.component.aws2-s3.useIAMCredentials: true ``` 3. Env variables property set in pod ``` [kafka@emd-kafka-cluster-connect-5fb8cdf44d-jf6s2 kafka]$ printenv |grep aws AWS_ROLE_ARN=arn:aws:iam::<arn>:role/emd-kafka-cluster-connect AWS_WEB_IDENTITY_TOKEN_FILE=/var/run/secrets/eks.amazonaws.com/serviceaccount/token ``` 4. (K8s Pod Configuration) Service Account which has access to bucket ``` ML-C02Z605SLVDQ:selumalai-k8s-s3-connect e192270$ aws-vault exec heb-dsol-foundational-projects-bld-staff -- kubectl get serviceaccounts emd-kafka-cluster-connect -o yaml apiVersion: v1 kind: ServiceAccount metadata: annotations: eks.amazonaws.com/role-arn: arn:aws:iam::<xxxxxxxxx>:role/emd-kafka-cluster-connect kubectl.kubernetes.io/last-applied-configuration: | {"apiVersion":"v1","kind":"ServiceAccount","metadata":{"annotations":{"eks.amazonaws.com/role-arn":"arn:aws:iam::<xxxxxxxx>:role/emd-kafka-cluster-connect"},"creationTimestamp":"2020-06-17T21:48:25Z","labels":{"app.kubernetes.io/instance":"emd-kafka-cluster","app.kubernetes.io/managed-by":"strimzi-cluster-operator","app.kubernetes.io/name":"kafka-connect","app.kubernetes.io/part-of":"strimzi-emd-kafka-cluster","strimzi.io/cluster":"emd-kafka-cluster","strimzi.io/kind":"KafkaConnect","strimzi.io/name":"strimzi"},"name":"emd-kafka-cluster-connect","namespace":"default","resourceVersion":"855936","selfLink":"/api/v1/namespaces/default/serviceaccounts/emd-kafka-cluster-connect","uid":"24bdb5d3-1d43-4bf6-b883-b275b0f5397e"},"secrets":[{"name":"emd-kafka-cluster-connect-token-glprh"}]} creationTimestamp: "2020-06-17T22:19:54Z" labels: app.kubernetes.io/instance: emd-kafka-cluster app.kubernetes.io/managed-by: strimzi-cluster-operator app.kubernetes.io/name: kafka-connect app.kubernetes.io/part-of: strimzi-emd-kafka-cluster strimzi.io/cluster: emd-kafka-cluster strimzi.io/kind: KafkaConnect strimzi.io/name: strimzi name: emd-kafka-cluster-connect namespace: default resourceVersion: "859885" selfLink: /api/v1/namespaces/default/serviceaccounts/emd-kafka-cluster-connect uid: 528c4309-4581-4fcb-a66f-f64741299709 secrets: - name: emd-kafka-cluster-connect-token-glprh - name: emd-kafka-cluster-connect-token-bvq9n ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
