Re: [Mesa-dev] [PATCH] mesa: Use GLdouble for depthMax in final unpack conversions.

2012-08-13 Thread Brian Paul
On Mon, Aug 13, 2012 at 2:06 AM, Kenneth Graunke wrote: > The final step of _mesa_unpack_depth_span is to take the temporary > GLfloat depth values and convert them to the desired format. When > converting to GL_UNSIGNED_INTEGER with depthMax > 0xff, we use > double-precision math to avoid ov

[Mesa-dev] [PATCH] mesa: Use GLdouble for depthMax in final unpack conversions.

2012-08-13 Thread Kenneth Graunke
The final step of _mesa_unpack_depth_span is to take the temporary GLfloat depth values and convert them to the desired format. When converting to GL_UNSIGNED_INTEGER with depthMax > 0xff, we use double-precision math to avoid overflow and precision problems. Or at least that's the idea. Unf