stuartm21 commented on issue #1347:
URL:
https://github.com/apache/camel-kafka-connector/issues/1347#issuecomment-1077281805
@oscerd The data are archiving to S3 bucket now with the naming of
"20220324-062313122-FA895CFA87E6-0000000000000000)". So as we discussed before,
we need to move the topics to a "topics" directory and inside that we need to
segregate the with year -> Month -> day -> time like this way too.
**KafkaConnector:**
```
apiVersion: kafka.strimzi.io/v1beta2
kind: KafkaConnector
metadata:
name: s3-sink-connector
namespace: kafka
labels:
strimzi.io/cluster: "strimzi-kafka"
spec:
class: org.apache.camel.kafkaconnector.aws2s3.CamelAws2s3SinkConnector
tasksMax: 2
config:
key.converter: org.apache.kafka.connect.storage.StringConverter
value.converter: org.apache.kafka.connect.storage.StringConverter
topics: kafka-topic
camel.sink.path.bucketNameOrArn: test-kafka-connect
camel.sink.endpoint.keyName: ${date:now:yyyyMMdd-HHmmssSSS}-${exchangeId}
camel.sink.maxPollDuration: 10000
camel.component.aws2-s3.configuration.autocloseBody: false
camel.component.aws2-s3.accessKey:
${file:/opt/kafka/external-configuration/aws-credentials/aws-credentials.properties:aws_access_key_id}
camel.component.aws2-s3.secretKey:
${file:/opt/kafka/external-configuration/aws-credentials/aws-credentials.properties:aws_secret_access_key}
camel.component.aws2-s3.region: ca-central-1
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
