[issue31227] regrtest: reseed random with the same seed before running a test file

STINNER Victor added the comment: I didn't get a strong +1 on the issue and I'm not convinced myself by my approach. Moreover, Refleaks buildbots now seem to be reliable thanks to other fixes. For all these reasons, I close the issue. -- ___ Python

[issue31227] regrtest: reseed random with the same seed before running a test file

Change by STINNER Victor : -- resolution: -> rejected stage: -> resolved status: open -> closed ___ Python tracker ___ ___ Python-b

[issue31227] regrtest: reseed random with the same seed before running a test file

STINNER Victor added the comment: > The exact behavior depends on the order of files in directories, on string > hashes randomization, on address randomization, and on many other things out > of our control. For hash randomization, maybe we need to generate a PYTHONHASHSEED, as tox test runne

[issue31227] regrtest: reseed random with the same seed before running a test file

Serhiy Storchaka added the comment: The PRNG is not the only source of the randomness in the tests. The exact behavior depends on the order of files in directories, on string hashes randomization, on address randomization, and on many other things out of our control. Couldn't reseeding the PRN

[issue31227] regrtest: reseed random with the same seed before running a test file

STINNER Victor added the comment: I'm not sure if we should use the same RNG seed for all tests, or create one seed per test when the option -r is used. For example, I expect that "./python -m test -r -F test_tools" will catch a random bug which only occurs for a specific random seed. ---

[issue31227] regrtest: reseed random with the same seed before running a test file

STINNER Victor added the comment: Antoine Pitrou: "If refleaks depend on the random seed, perhaps it's a bug worth fixing?" I propose to change regrtest behaviour even when -R is not used, to make regrtest more deterministic. Currently, when you run "./python -m test -r test_xxx test_", i

[issue31227] regrtest: reseed random with the same seed before running a test file

Antoine Pitrou added the comment: If refleaks depend on the random seed, perhaps it's a bug worth fixing? -- ___ Python tracker ___ __

[issue31227] regrtest: reseed random with the same seed before running a test file

Changes by STINNER Victor : -- nosy: +pitrou, serhiy.storchaka ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue31227] regrtest: reseed random with the same seed before running a test file

Changes by STINNER Victor : -- pull_requests: +3159 ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mai

[issue31227] regrtest: reseed random with the same seed before running a test file

New submission from STINNER Victor: Attached PR changes regrtest to reseed the random RNG before each test file. Use also more entropy for the seed: 2**32 (32 bits) rather than 10_000_000 (24 bits). The change should avoid random failure of test_tools when hunting reference leaks: see bpo-3117