fx19880617 opened a new issue #6377:
URL: https://github.com/apache/incubator-pinot/issues/6377


   The motivation of this is due to my recent test with S3 and other remote 
filesystems. If we want to use PinotFS in Pinot, the only way is to build a 
custom config file and set the configurations explicitly, then restart the 
Pinot components. And it's impossible for users to run Pinot Quickstart and 
interact with deep store like s3.
   
   The proposed change is to add new APIs in all Pinot components to allow 
users to dynamically load Pinot plugins. E.g. For PinotFS, we can ask users to 
provide <scheme, class name, a map of fs configs>.
   
   Below are sample APIs:
   ```
   GET /plugins/filesystem
   GET /plugins/filesystem/<scheme>
   POST /plugins/filesystem/load
   DELETE /plugins/filesystem/<scheme>  
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org

Reply via email to