PR #22357 opened by Martin Storsjö (mstorsjo) URL: https://code.ffmpeg.org/FFmpeg/FFmpeg/pulls/22357 Patch URL: https://code.ffmpeg.org/FFmpeg/FFmpeg/pulls/22357.patch
Accept up to 15 ULP difference. This fixes running "checkasm --test=ac3dsp <seed>" for the seeds 2043066705, 24168 and 111972 on ARM, and the seeds 40552 and 209754 on aarch64. This is the same change as 8e4c904c8e30c68ea6c7da3740139bf2f4ffa907, increasing the tolerance further. With this change, checkasm passes for over 500 000 seeds on both ARM and aarch64. From 9b2bf89796b2b32bb2d61367c87d61b19f06ad5d Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Martin=20Storsj=C3=B6?= <[email protected]> Date: Tue, 3 Mar 2026 10:57:22 +0200 Subject: [PATCH] checkasm: ac3dsp: Increase the float tolerance for sum_square_butterfly_float Accept up to 15 ULP difference. This fixes running "checkasm --test=ac3dsp <seed>" for the seeds 2043066705, 24168 and 111972 on ARM, and the seeds 40552 and 209754 on aarch64. This is the same change as 8e4c904c8e30c68ea6c7da3740139bf2f4ffa907, increasing the tolerance further. With this change, checkasm passes for over 500 000 seeds on both ARM and aarch64. --- tests/checkasm/ac3dsp.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/tests/checkasm/ac3dsp.c b/tests/checkasm/ac3dsp.c index 97732112a5..fa2fe17276 100644 --- a/tests/checkasm/ac3dsp.c +++ b/tests/checkasm/ac3dsp.c @@ -181,7 +181,7 @@ static void check_ac3_sum_square_butterfly_float(AC3DSPContext *c) { call_ref(v1, lt, rt, ELEMS); call_new(v2, lt, rt, ELEMS); - if (!float_near_ulp_array(v1, v2, 13, 4)) + if (!float_near_ulp_array(v1, v2, 15, 4)) fail(); bench_new(v2, lt, rt, ELEMS); -- 2.52.0 _______________________________________________ ffmpeg-devel mailing list -- [email protected] To unsubscribe send an email to [email protected]
