We have run the full ubuntu-advantage-tools integration test suite against version 35, while it was in -proposed. The results are attached. Some of the tests failed, and the explanation for those is detailed below.
You can verify the correct version was used by checking the output of the first test in each file, which prints the version number. I am marking the verification done for this particular bug. Failed tests: 1. Several tests have failed due to the known outage of the Security API. Those are flaky as they depend on the API to respond properly. We have manually checked some of those results and have made sure it works when the API works. This is a problem already present in the current version of the Pro Client, so not considered a regression for the purpose of this SRU. List of failing tests: Xenial VM: - features/fix.feature:611 Fix command on an unattached machine Xenial LXD: - features/fix.feature:610 Fix command on an unattached machine - features/api/fix_execute.feature:185 Fix execute command on invalid CVEs/USNs - features/api/fix_execute.feature:1115 Fix execute API command on a Xenial machine - features/api/fix_plan.feature:177 Fix command on an unattached machine - features/api/fix_plan.feature:1889 Fix command on an unattached machine Bionic WSL: - features/fix.feature:918 Fix command on an unattached machine Focal WSL: - features/fix.feature:226 Fix command on an unattached machine Bug: https://github.com/canonical/ubuntu-com-security-api/issues/165 2. Focal VM tests which include enabling the FIPS service when secure-boot is turned on started to fail now. This is not related to the client: images are actually broken and can't be fixed, as the FIPS package versions are pinned, and the shim version present in Focal got revoked. I have manually checked and disabling secure boot before running those particular tests make them pass. List of failing tests: Focal VM - features/enable_fips_vm.feature:131 Attached enable of FIPS in an ubuntu lxd vm - features/enable_fips_vm.feature:293 Attached enable fips-updates on fips enabled vm - features/cli/disable.feature:317 Disable and purge fips - features/cli/disable.feature:351 Disable does not purge if no other kernel found Bug: https://github.com/canonical/ubuntu-pro-client/issues/3420 3. A bug in pycloudlib image selection causes fips-updates instances to be created for Focal, making the FIPS test fail. I have manually checked and using the fips instance the test passes. I have sent a PR to pycloudlib to fix the issue, and opened a bug against the Pro Client to make sure to cover both FIPS and FIPS-Updates testing where available on the clouds. List of failing tests: Focal VM - features/ubuntu_pro_fips.feature:151 Bug: https://github.com/canonical/ubuntu-pro-client/issues/3415 Pycloudlib PR: https://github.com/canonical/pycloudlib/pull/483 4. A race condition (a race we lost here) with LXD makes the auto-attach feature we are shipping here not to work out of the box. We have created a separate LP issue for that, and have updated the version in -proposed to 35.1ubuntu0 to fix it. Verification of that bug (and for that version) will be done separately, and tracked there. I am marking this bug here as done, as the SRU process will only continue when 2106660 is marked done. List of failing tests: Jammy VM - features/lxd.feature:234 LXD guest auto-attach -- @1.1 Bug: https://bugs.launchpad.net/ubuntu/+source/ubuntu-advantage-tools/+bug/2106660 ** Bug watch added: github.com/canonical/ubuntu-com-security-api/issues #165 https://github.com/canonical/ubuntu-com-security-api/issues/165 ** Bug watch added: github.com/canonical/ubuntu-pro-client/issues #3420 https://github.com/canonical/ubuntu-pro-client/issues/3420 ** Bug watch added: github.com/canonical/ubuntu-pro-client/issues #3415 https://github.com/canonical/ubuntu-pro-client/issues/3415 ** Attachment added: "results-v35.tar.gz" https://bugs.launchpad.net/ubuntu/+source/ubuntu-advantage-tools/+bug/2083973/+attachment/5873550/+files/results-v35.tar.gz ** Tags removed: block-proposed verification-needed verification-needed-bionic verification-needed-focal verification-needed-jammy verification-needed-noble verification-needed-oracular verification-needed-xenial ** Tags added: verification-done verification-done-bionic verification-done-focal verification-done-jammy verification-done-noble verification-done-oracular verification-done-xenial -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2083973 Title: [SRU] ubuntu-advantage-tools (34 -> 35) Xenial, Bionic, Focal, Jammy, Noble, Oracular To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/ubuntu-advantage-tools/+bug/2083973/+subscriptions -- ubuntu-bugs mailing list [email protected] https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
