One test can mess with the state of the machine and cause later tests to fail. Because of this, the testing order found in the report should reflect the actual testing order, in order to identify the test that has messed up the state.
There has been some effort to preserve order internally (OrderedDict used in some places), but not consistently. This patch makes preservation of the test order within testrun explicit: . use OrderedDict comprehension when copying 'tests' . read files from tests-dir in numerical order . use OrderedDict instead of dict when necessary Style-question: Instead of collections.OrderedDict, I've used narrower import and OrderedDict. Which way would be preferred here? Any comments welcome! Tomi Sarvela (2): framework/results.py: Copy 'tests' internally to OrderedDict framework/backends/json.py: preserve 'tests' order framework/backends/json.py | 42 +++++++++++++++++++++++++++++------------- framework/results.py | 16 +++++++++------- 2 files changed, 38 insertions(+), 20 deletions(-) -- 2.9.3 _______________________________________________ Piglit mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/piglit
