npawar opened a new pull request #6354:
URL: https://github.com/apache/incubator-pinot/pull/6354


   ## Description
   Adding APIs for uploading data to an offline table. These are meant for 
quick testing/trials, and not intended for production usage. We will be using 
these in the Cluster Manager to introduce a "Test a file" flow.
   
   **File ingest**
   ```
   curl 
"http://localhost:9000/ingestFromFile?tableName=transcript_OFFLINE&batchConfigMapStr={"inputFormat":"json"}";
  -F file=@part1.json
   ```
   
   **URI ingest** 
   Note: 
   1. The fs details only need to be provided if scheme is not already 
registered. 
   2. Credentials will by default be taken from local aws credentials
   ```
   curl 
"http://localhost:9000/ingestFromURI?tableName=transcript_OFFLINE&batchConfigMapStr={"inputFormat":"json","input.fs.className":"org.apache.pinot.plugin.filesystem.S3PinotFS","input.fs.prop.region":"us-central","input.fs.prop.accessKey":"foo","input.fs.prop.secretKey":"bar"}&sourceURIStr=s3://test.bucket/jsondata/part1.json";
 \
     -X POST
   ```
   
   ## Release Notes
   Introduced 2 new APIs `/ingestFromFile` and `/ingestFromURI`


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org

Reply via email to