davlee1972 opened a new issue, #3008:
URL: https://github.com/apache/arrow-adbc/issues/3008

   ### What feature or improvement would you like to see?
   
   https://docs.snowflake.com/en/sql-reference/data-types-numeric
   
   According to their own documentation..
   
   
![Image](https://github.com/user-attachments/assets/f8d7d54f-2f2e-4470-b3a9-73d308f6d893)
   
   But it doesn't look like ADBC is using this info and sizing everything to 
the internal decimal(38,0) type Snowflake uses.
   
   In reality Snowflake doesn't use a decimal(38,0) either. It finds the 
largest INT value in a micropartition and sizes that entire micropartiion Int 
column to 128, 64, 32, 16 or 8 bit integers..
   
   Shouldn't the ADBC Driver look at the metadata and if a column is defined as 
a TinyInt it should allocate a PyArrow Int8 instead of a Int128.. This would 
save a lot of memory on the client side..
    


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to