Control: reassign -1 src:mmdebstrap 0.7.5-1
Control: found -1 0.7.5-2
Control: retitle -1 mmdebstrap: autopkgtest fails when run on 
autopkgtest-virt-qemu

On Mon, 22 Feb 2021 at 09:15:49 +0900, Ryutaroh Matsumoto wrote:
> I report yet another testbed difference between lxc and qemu,
> affecting mmdebstrap 0.7.5-1 testsuite.

Please note that differences between the testbed backends do not
*necessarily* indicate a bug in autopkgtest. If we could guarantee that
the behaviour of each backend would be the same in all respects, then we
would not need multiple backends, or the isolation-machine and
isolation-container restrictions.

We have multiple backends *because* they are different.

> On lxc testbed, the testsuite always return 
> testsuite            SKIP exit status 77 and marked as skippable

This appears to have happened because the test runs make_mirror.sh with
a 20 minute timeout, but that operation timed out and was terminated.

I think it would be useful if this made use of a configured http proxy
in the testbed (if any) - that would probably make testing a lot faster
in the case where something like apt-cacher-ng is used.

It would probably also be useful if the time actually taken for mirroring
could be shown in the logs, to be able to assess whether the 20 minute
timeout is enough.

> while on qemu it always return
> testsuite            FAIL non-zero exit status 1
> 
> testsuite-stderr on qemu ends as:
> + capsh --drop=cap_sys_admin -- -c exec "$@" exec mmdebstrap --mode=root 
> --variant=apt testing /tmp/debian-chroot http://127.0.0.1/debian
> E: root mode requires mount which requires CAP_SYS_ADMIN
> + ret=25
> + [ 25 = 0 ]
> + rm -r /tmp/debian-chroot
> rm: cannot remove '/tmp/debian-chroot': No such file or directory
> test.sh failed

This looks more like a bug in mmdebstrap (or a bug in mmdebstrap's
tests?) being detected by the test. I can reproduce this locally in
0.7.5-2 (I used autopkgtest-build-qemu and autopkgtest directly, rather
than using debci).

It's possible that this is only detectable on backends with full
machine isolation such as qemu or null, because the lxc backend doesn't
necessarily have enough privileges to be able to exercise this part.

> In addition to the above, the newest test result of mmdebstrap 0.7.5-1 on 
> ci.debian.net is "PASS",
> which is different from both of the above.

>From the debci logs, it looks as though in some runs the 20 minute
timeout to run make_mirror.sh is sufficient (resulting in tests being run),
and in some runs it is not (resulting in further testing being skipped).
This probably depends on how heavily-loaded the underlying machine is and
how much else it's running in parallel.

    smcv

Reply via email to