C0DK opened a new issue, #44061:
URL: https://github.com/apache/arrow/issues/44061
### Describe the bug, including details regarding any error messages,
version, and platform.
Converting from decimal.Decimal to PyAarrows Decimal has given me the
`pyarrow.lib.ArrowInvalid: Rescaling Decimal128 value would cause data
loss` error.
I understand that to fix this, I have to ensure that the DecimalType (I am
using PySpark, and their schema) I have to max the precision and scaling to the
value I want to store.
However, to not allocate more memory than needed, I want to right-size the
data; however, receiving the above error in production, without any indication
of which value is outside this range, is frustrating and not very helpful.
There are similar lacks in many other error messages regarding invalid data
### Component(s)
Python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
