xiangfu0 commented on issue #14677:
URL: https://github.com/apache/pinot/issues/14677#issuecomment-2565603928
> I don't get it. Could you describe the task further?
>
> Does it affect the broker and controller rest api? The GRPC direct access?
The current REST format is something like:
>
> ```json
> {
> "resultTable": {
> "dataSchema": {
> "columnNames": [
> "c1",
> "c2"
> ],
> "columnDataTypes": [
> "INT",
> "STRING"
> ]
> },
> "rows": [
> [
> 208,
> "a"
> ],
> [
> 243,
> "b"
> ],
> [
> 279,
> "c"
> ]
> ]
> }
> }
> ```
>
> Do you suggest to change it to something like:
>
> ```json
> {
> "resultTable": {
> "dataSchema": {
> "columnNames": [
> "c1",
> "c2"
> ],
> "columnDataTypes": [
> "INT",
> "STRING"
> ]
> },
> "columns": [
> [
> 208,
> 243,
> 279
> ],
> [
> "a",
> "b",
> "c"
> ]
> ]
> },
> ```
>
> ?
>
> That could be done with a query param, but we could also return the same
data in arrow format by changing the `Accept: application/json` to `Accept:
application/vnd.apache.arrow.stream` or `Accept:
application/vnd.apache.arrow.file`
Exactly as you mentioned.
This is to change the response format to columnar, so java or jdbc client
could use column API to iterator through data.
Arrow format is mostly for encoding support, which could be a different
goal, but will definitely help for column API performance.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org
