Hi, [Mostly documenting a conversation we had in the team.]
On Fri, 9 Feb 2024 13:56:54 +0000 Ian Jackson <[email protected]> wrote:
tl;dr: autopkgtest is slower than it needs to be for packages with many tests. I can see at least one easy opportunity for a potentially substantial improvement, and have another more doubtful idea.
While performance is obviously interesting, there's also the concern of test isolation, see e.g. https://bugs.launchpad.net/ubuntu/+source/autopkgtest/+bug/2058040. We discussed this and agreed for the moment that we are more in favor of ensuring testbeds are actually isolated from one-another, because it has the property of least surprise (like the launchpad bug is requesting) than for more optimization of sharing testbeds between different tests. Now obviously we can work hard to have both, but reverting a backend that supports that is much easier than figuring out all corner-cases where tests can influence each other if we need to do it ourselves between tests. So when moving forward we might go that route to keep src:autopkgtest maintainable.
Paul
OpenPGP_signature.asc
Description: OpenPGP digital signature
