--- Begin Message ---
Source: python-pytest-subtests
Version: 0.8.0-2
Severity: serious
Tags: sid bookworm
User: debian...@lists.debian.org
Usertags: needs-update
User: debian-pyt...@lists.debian.org
Usertags: python3.11
Control: affects -1 src:python3-defaults
Dear maintainer(s),
We are in the transition of adding python3.11 as a supported Python
version [0]. With a recent upload of python3-defaults the autopkgtest of
python-pytest-subtests fails in testing when that autopkgtest is run
with the binary packages of python3-defaults from unstable. It passes
when run with only packages from testing. In tabular form:
pass fail
python3-defaults from testing 3.10.6-3
python-pytest-subtests from testing 0.8.0-2
all others from testing from testing
I copied some of the output at the bottom of this report.
Currently this regression is blocking the migration of python3-defaults
to testing [1]. https://docs.python.org/3/whatsnew/3.11.html lists
what's new in Python3.11, it may help to identify what needs to be updated.
More information about this bug and the reason for filing it can be found on
https://wiki.debian.org/ContinuousIntegration/RegressionEmailInformation
Paul
[0] https://bugs.debian.org/1021984
[1] https://qa.debian.org/excuses.php?package=python3-defaults
https://ci.debian.net/data/autopkgtest/testing/amd64/p/python-pytest-subtests/28750729/log.gz
=================================== FAILURES
===================================
______________ TestSubTest.test_simple_terminal_normal[unittest]
_______________
self = <test_subtests.TestSubTest object at 0x7f70940cc650>
simple_script =
local('/tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2/test_simple_terminal_normal.py')
testdir = <Testdir
local('/tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2')>
runner = 'unittest'
@pytest.mark.parametrize("runner", ["unittest", "pytest-normal",
"pytest-xdist"])
def test_simple_terminal_normal(self, simple_script, testdir, runner):
if runner == "unittest":
result = testdir.run(sys.executable, simple_script)
result.stderr.fnmatch_lines(
[
"FAIL: test_foo (__main__.T) [custom] (i=1)",
"AssertionError: 1 != 0",
"FAIL: test_foo (__main__.T) [custom] (i=3)",
"AssertionError: 1 != 0",
"Ran 1 test in *",
"FAILED (failures=2)",
]
)
E Failed: nomatch: 'FAIL: test_foo (__main__.T) [custom] (i=1)'
E and: 'FF'
E and:
'======================================================================'
E and: 'FAIL: test_foo (__main__.T.test_foo) [custom] (i=1)'
E and:
'----------------------------------------------------------------------'
E and: 'Traceback (most recent call last):'
E and: ' File
"/tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2/test_simple_terminal_normal.py",
line 8, in test_foo'
E and: ' self.assertEqual(i % 2, 0)'
E and: 'AssertionError: 1 != 0'
E and: ''
E and:
'======================================================================'
E and: 'FAIL: test_foo (__main__.T.test_foo) [custom] (i=3)'
E and:
'----------------------------------------------------------------------'
E and: 'Traceback (most recent call last):'
E and: ' File
"/tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2/test_simple_terminal_normal.py",
line 8, in test_foo'
E and: ' self.assertEqual(i % 2, 0)'
E and: 'AssertionError: 1 != 0'
E and: ''
E and:
'----------------------------------------------------------------------'
E and: 'Ran 1 test in 0.001s'
E and: ''
E and: 'FAILED (failures=2)'
E remains unmatched: 'FAIL: test_foo (__main__.T) [custom] (i=1)'
/tmp/autopkgtest-lxc.agke3g8v/downtmp/autopkgtest_tmp/tests/test_subtests.py:142:
Failed
----------------------------- Captured stdout call
-----------------------------
running: /usr/bin/python3.11
/tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2/test_simple_terminal_normal.py
in: /tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2
----------------------------- Captured stderr call
-----------------------------
FF
======================================================================
FAIL: test_foo (__main__.T.test_foo) [custom] (i=1)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2/test_simple_terminal_normal.py",
line 8, in test_foo
self.assertEqual(i % 2, 0)
AssertionError: 1 != 0
======================================================================
FAIL: test_foo (__main__.T.test_foo) [custom] (i=3)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2/test_simple_terminal_normal.py",
line 8, in test_foo
self.assertEqual(i % 2, 0)
AssertionError: 1 != 0
----------------------------------------------------------------------
Ran 1 test in 0.001s
FAILED (failures=2)
______________ TestSubTest.test_simple_terminal_verbose[unittest]
______________
self = <test_subtests.TestSubTest object at 0x7f7094100450>
simple_script =
local('/tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2/test_simple_terminal_verbose.py')
testdir = <Testdir
local('/tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2')>
runner = 'unittest'
@pytest.mark.parametrize("runner", ["unittest", "pytest-normal",
"pytest-xdist"])
def test_simple_terminal_verbose(self, simple_script, testdir, runner):
if runner == "unittest":
result = testdir.run(sys.executable, simple_script, "-v")
result.stderr.fnmatch_lines(
[
"test_foo (__main__.T) ... ",
"FAIL: test_foo (__main__.T) [custom] (i=1)",
"AssertionError: 1 != 0",
"FAIL: test_foo (__main__.T) [custom] (i=3)",
"AssertionError: 1 != 0",
"Ran 1 test in *",
"FAILED (failures=2)",
]
)
E Failed: nomatch: 'test_foo (__main__.T) ... '
E and: 'test_foo (__main__.T.test_foo) ... '
E and: ' test_foo (__main__.T.test_foo) [custom] (i=1)
... FAIL'
E and: ' test_foo (__main__.T.test_foo) [custom] (i=3)
... FAIL'
E and: ''
E and:
'======================================================================'
E and: 'FAIL: test_foo (__main__.T.test_foo) [custom] (i=1)'
E and:
'----------------------------------------------------------------------'
E and: 'Traceback (most recent call last):'
E and: ' File
"/tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2/test_simple_terminal_verbose.py",
line 8, in test_foo'
E and: ' self.assertEqual(i % 2, 0)'
E and: 'AssertionError: 1 != 0'
E and: ''
E and:
'======================================================================'
E and: 'FAIL: test_foo (__main__.T.test_foo) [custom] (i=3)'
E and:
'----------------------------------------------------------------------'
E and: 'Traceback (most recent call last):'
E and: ' File
"/tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2/test_simple_terminal_verbose.py",
line 8, in test_foo'
E and: ' self.assertEqual(i % 2, 0)'
E and: 'AssertionError: 1 != 0'
E and: ''
E and:
'----------------------------------------------------------------------'
E and: 'Ran 1 test in 0.001s'
E and: ''
E and: 'FAILED (failures=2)'
E remains unmatched: 'test_foo (__main__.T) ... '
/tmp/autopkgtest-lxc.agke3g8v/downtmp/autopkgtest_tmp/tests/test_subtests.py:176:
Failed
----------------------------- Captured stdout call
-----------------------------
running: /usr/bin/python3.11
/tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2/test_simple_terminal_verbose.py
-v
in: /tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2
----------------------------- Captured stderr call
-----------------------------
test_foo (__main__.T.test_foo) ... test_foo (__main__.T.test_foo)
[custom] (i=1) ... FAIL
test_foo (__main__.T.test_foo) [custom] (i=3) ... FAIL
======================================================================
FAIL: test_foo (__main__.T.test_foo) [custom] (i=1)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2/test_simple_terminal_verbose.py",
line 8, in test_foo
self.assertEqual(i % 2, 0)
AssertionError: 1 != 0
======================================================================
FAIL: test_foo (__main__.T.test_foo) [custom] (i=3)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2/test_simple_terminal_verbose.py",
line 8, in test_foo
self.assertEqual(i % 2, 0)
AssertionError: 1 != 0
----------------------------------------------------------------------
Ran 1 test in 0.001s
FAILED (failures=2)
=========================== short test summary info
============================
FAILED
tests/test_subtests.py::TestSubTest::test_simple_terminal_normal[unittest]
FAILED
tests/test_subtests.py::TestSubTest::test_simple_terminal_verbose[unittest]
=================== 2 failed, 19 passed, 5 xfailed in 2.44s
====================
autopkgtest [00:14:54]: test upstream
OpenPGP_signature
Description: OpenPGP digital signature
--- End Message ---
