Package: autopkgtest Version: 5.16 Severity: normal X-Debbugs-Cc: mo...@debian.org
Hello, There are at least 2 main places where source packages declare tests: 1. in debian/rules, to be executed at build-time 2. in debina/tests/*, to be executed post-build via autopkgtests Usually 1) are written first, because you need to get them to pass during build-time; this activity also require to add additional dependencies to debian/control, which are only required by tests (and not by the package building commands). And then there's 2), where often you're required to duplicate the steps from 1) and that could lead to misalignment, forgotten dependencies (and so failures), etc. In general, it's preferred to reduce duplication to the minimum, just to avoid the problems listed above, but autopkgtest kinda requires you to have exactly this duplication. F.e., i make sure to mark <!nocheck> all the b-d only needed for tests, but there's no selector in debian/tests/control to only pull in those packages, and sometimes the quickest way is to get all @builddeps@, even if that has the risk to include extra packages in the mix. There's also the problem of duplicating how we run tests; while autopkgtest is less restrictive than the buildd environment (f.e. via allow-network), there could be substantial duplication on how test runners are setup in d/rules and in autopkgtest. I dont know if you ever thought about the duplication problem, i feel it would be really helpful if that could be substantially reduced. Thanks, Sandro -- System Information: Debian Release: 11.0 APT prefers unstable APT policy: (500, 'unstable'), (1, 'experimental') Architecture: amd64 (x86_64) Foreign Architectures: i386 Kernel: Linux 5.14.0-4-amd64 (SMP w/8 CPU threads) Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE not set Shell: /bin/sh linked to /bin/dash Init: systemd (via /run/systemd/system) LSM: AppArmor: enabled Versions of packages autopkgtest depends on: ii apt-utils 2.3.12 ii libdpkg-perl 1.20.9 ii procps 2:3.3.17-5 ii python3 3.9.8-1 ii python3-debian 0.1.39 Versions of packages autopkgtest recommends: ii autodep8 0.24 Versions of packages autopkgtest suggests: ii lxc 1:4.0.10-1 pn lxd <none> pn ovmf <none> pn qemu-efi-aarch64 <none> pn qemu-efi-arm <none> pn qemu-system <none> ii qemu-utils 1:6.1+dfsg-8+b1 ii schroot 1.6.10-12 pn vmdb2 <none> -- no debconf information