felipecrv opened a new issue, #43185:
URL: https://github.com/apache/arrow/issues/43185

   ### Describe the enhancement requested
   
   When arrays using 32-bit offsets into data buffers are concatenated and the 
data buffers of the results grow beyond 2GB, `Concatenate` returns a bad 
`Status` with a very simple message:
   
   `"offset overflow while concatenating arrays"`
   
   The contract that `Concatenate` honors is very simple: arrays of input type 
T lead to output of the same type T, so we can't, for instance, return a 
`LARGE_STRING` [1] array when the input is `STRING`.
   
   But we can **suggest a cast** to the caller in case an overflow error is 
detected. Either programatically (by taking an output parameter) or by giving a 
better error message to users.
   
   
   
   [1] `LARGE_STRING` can use 64-bit offsets
   
   ### Component(s)
   
   C++


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to