rkanumul opened a new pull request #6531: URL: https://github.com/apache/incubator-pinot/pull/6531
## Description Linkedin plans to use ADLSGen2PinotFS but requires 1) Service principal based authentication to do that for better ACL control. The current accesskey based auth would be harder to maintain with multiple applications. https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-directory-file-acl-java#connect-by-using-azure-active-directory-azure-ad 2) The current implementation fails in case the blob container(file system) is not created beforehand. This adds additional friction when on-boarding new use cases or standing up pinot on a new environment. 3) Introduces unit tests to ADLSGen2PinotFS to improve craftsmanship. ## Upgrade Notes Improves ADLSGen2PinotFS with service principal based auth, auto create container on initial run. Is backwards compatible with key based auth. But also optionally understands clientId, tenantId, clientSecret configs. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
