fangchenli opened a new issue, #23876:
URL: https://github.com/apache/datafusion/issues/23876

   ### Describe the bug
   
   Arrow's Substrait consumer reads relation fields through deprecated 
accessors from a vendored Substrait proto pinned to v0.44.0, so values that 
current producers such as DataFusion send through the newer forms introduced 
around v0.63.0 are silently dropped and defaulted, producing wrong results with 
no error.
   
   FetchRel limits arrive via count_expr/offset_expr while Arrow reads the 
unset scalar count/offset, turning every LIMIT n into LIMIT 0 (empty result) 
and ignoring OFFSET. 
   
   AggregateRel grouping keys arrive via expression_references while Arrow 
reads the deprecated inline field, collapsing every row into a single group. 
   
   We should bump the vendored proto to v0.63.0 (matching DataFusion's pinned 
substrait-rs, where the new forms coexist with the still-readable deprecated 
arms) and updates the FetchRel and AggregateRel consumers to read the modern 
forms with a fallback for older producers.
   
   ### To Reproduce
   
   _No response_
   
   ### Expected behavior
   
   _No response_
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to