Public bug reported:

[Impact]

 * linux autopkgtest should only execute either rebuild tests, when triggered 
by toolchain.
   or execute regression suite when triggered by meta
   but never both. As otherwise, it results in false negative results for the 
kernel

[Test Case]

 * Trigger adt test of linux with a matching linux-meta. Check that
rebuild test is skipped, and that the regression suite test runs.

 * trigger adt test of linux with triggered by gcc-6/7/8 (as
appropriate) and observe that rebuild test runs, and regression suite
test is skipped.

 * (when this is applied to flavours) trigger adt test of linux-* with a
matching flavour meta, and check that regression test-suite is skipped
on kernels that cannot boot in scaling stack (e.g. gcp, azure, aws, etc)

[Fix]

 * debian/tests/* are modified to pay more attention as to what they are
triggered by, and raise appropriate skipped error codes

[Regression Potential]

 * incorrect tests may run at incorrect time is the regression potential
here, hence the two test cases verify that the right tests are executed
when expected.

 * care was taken to take into account all linux kernel flavours, hence
the third test case need to be reverified on flavoured kernels.

[Other Info]

 * affects all stable series xenial and up, across all kernel flavours

** Affects: linux (Ubuntu)
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1823056

Title:
  autopkgtests run too often, too much and don't skip enough

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1823056/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Reply via email to