IEEE754 says doubles are supposed to provide 16 significant digits: Correctly rounded results can be obtained by converting to decimal and back again to the binary format using: 5 decimal digits for binary16 9 decimal digits for binary32 17 decimal digits for binary64 36 decimal digits for binary128
from http://en.wikipedia.org/wiki/IEEE_754-2008 this is looking a little like a system library issue. 8.400000000000005 -- the rounding error looks like the original ANSI standard (from the fortran implimentation) - if it was binary64 there would be two more zeros in there. -- Luid: floating point operations seems not to match specification https://bugs.launchpad.net/bugs/586087 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
