chrishanKH commented on issue #10654: URL: https://github.com/apache/pinot/issues/10654#issuecomment-1521750495
The fix is to pass the extra configs as a YAML file and include it in `extra.configs` so they are populated in [this](https://github.com/apache/pinot/blob/b0284994393c09d79917e529592b8ac10258e9ea/kubernetes/helm/pinot/templates/controller/configmap.yaml#L34) block. An example, working config looks like: ``` controller: enable: split: commit: true data: dir: s3://data-pinot-deep-storage extra: configs: |- pinot.set.instance.id.to.hostname=true controller.task.scheduler.enabled=true controller.local.temp.dir=/tmp/pinot-tmp-data/ pinot.controller.storage.factory.class.s3=org.apache.pinot.plugin.filesystem.S3PinotFS pinot.controller.storage.factory.s3.region=ap-south-1 pinot.controller.segment.fetcher.protocols=file,http,s3 pinot.controller.segment.fetcher.s3.class=org.apache.pinot.common.utils.fetcher.PinotFSSegmentFetcher server: extra: configs: |- pinot.server.storage.factory.class.s3=org.apache.pinot.plugin.filesystem.S3PinotFS pinot.server.storage.factory.s3.region=ap-south-1 pinot.server.segment.fetcher.protocols=file,http,s3 pinot.server.segment.fetcher.s3.class=org.apache.pinot.common.utils.fetcher.PinotFSSegmentFetcher pinot.server.instance.enable.split.commit=true pinot.server.storage.factory.s3.httpclient.maxConnections=50 pinot.server.storage.factory.s3.httpclient.socketTimeout=30s pinot.server.storage.factory.s3.httpclient.connectionTimeout=2s pinot.server.storage.factory.s3.httpclient.connectionTimeToLive=0s pinot.server.storage.factory.s3.httpclient.connectionAcquisitionTimeout=10s minion: extra: configs: |- pinot.minion.storage.factory.class.s3=org.apache.pinot.plugin.filesystem.S3PinotFS pinot.minion.storage.factory.s3.region=ap-south-1 pinot.minion.segment.fetcher.protocols=file,http,s3 pinot.minion.segment.fetcher.s3.class=org.apache.pinot.common.utils.fetcher.PinotFSSegmentFetcher ``` Put this into a file called values-s3-deepstore.yaml and then pass it to help install: `helm install -f values.yaml -f values-s3-deepstore.yaml pinot pinot/pinot -n namespace' -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
