[Bug 2101120] [NEW] mptcp BUG 'scheduling while atomic' in mptcp_pm_nl_append_new_local_addr

2025-03-07 Thread Krister Johansen
Public bug reported: [Impact] If mptcp endpoints are configured on a host using an address that is external to the host, then the kernel will create an implicit endpoint with the host's local address when mptcp receives its first flow. If multiple packets for these local interfaces arrive in par

[Bug 2101120] Re: mptcp BUG 'scheduling while atomic' in mptcp_pm_nl_append_new_local_addr

2025-03-06 Thread Krister Johansen
I have a patch for this accepted upstream that I'll send to the Ubuntu kernel team in short order. This has been merged to Linus's tree but has yet to be picked up by Stable. It's tagged to go there, it just hasn't been picked up by the robots yet. It affects all releases from 5.17 onward, which

[Bug 2101120] Re: mptcp BUG 'scheduling while atomic' in mptcp_pm_nl_append_new_local_addr

2025-03-06 Thread Krister Johansen
Patches sent to kernel team's list: https://lists.ubuntu.com/archives/kernel-team/2025-March/157856.html -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2101120 Title: mptcp BUG 'scheduling while ato

[Bug 2089373] Re: WARN in trc_wait_for_one_reader about failed IPIs

2025-01-21 Thread Krister Johansen
I've re-run the tests against the proposed kernel and no longer see these warnings. Thanks for taking the patches to fix this! ** Tags removed: verification-needed-jammy-linux ** Tags added: verification-done-jammy-linux -- You received this bug notification because you are a member of Ubuntu B

[Bug 2090972] Re: /boot intermittently fails to mount on boot

2025-01-15 Thread Krister Johansen
Hi Matthew, I appreciate the update and your persistence in prodding these stubborn tests along. Is it okay to release the Noble build of this package ahead of the Oracular one? Thanks again, -K -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribe

[Bug 2090972] Re: /boot intermittently fails to mount on boot

2025-01-06 Thread Krister Johansen
Hi Matthew, Thanks for you help with getting this fixed. Please let me know if there's anything else I can do to assist. Thanks, -K -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2090972 Title: /

[Bug 2090972] Re: /boot intermittently fails to mount on boot

2024-12-20 Thread Krister Johansen
I didn't take an exhaustive look at the reported test failures, but the ones I did look at above appear to be related to the test infrastructure not starting up. Can we give those another kick to see if a subsequent run does any better? Thanks. -- You received this bug notification because you

[Bug 2090972] Re: /boot intermittently fails to mount on boot

2024-12-20 Thread Krister Johansen
Just wanted to follow-up to report that I've run the reproducer on Noble and Oracular since the 17th and while I did reproduce the bug on both releases with the old version of the package, I did not see any occurrences with the new versions of the packages. If there are no objections, I'll mark th

[Bug 2090972] Re: /boot intermittently fails to mount on boot

2024-12-17 Thread Krister Johansen
Hi Matthew and Timo, Thanks for getting the Noble and Oracular proposed packages posted so promptly. I'll go ahead and kick off test runs on these this morning and can follow up by Friday morning (Pacific Time) about whether they have passed. If you don't think that's long enough, I can let th

[Bug 2090972] Re: /boot intermittently fails to mount on boot

2024-12-16 Thread Krister Johansen
Hi Matthew, I've been running the tests on the patched version of Plucky since 12/10 and have not observed a recurrence of the bug. In accordance with our previous discussion, I'm going to mark this as plucky-verification-done. (Assuming that's the correct tag). Is this sufficient to unblock

[Bug 2090972] Re: /boot intermittently fails to mount on boot

2024-12-16 Thread Krister Johansen
Ah, there's no verification-done-plucky tag, but if there were, I'd use it. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2090972 Title: /boot intermittently fails to mount on boot To manage notifi

[Bug 2090972] Re: /boot intermittently fails to mount on boot

2024-12-10 Thread Krister Johansen
Hi Matthew, A quick update from me on the testing. It took a couple of days to find a recipe that reproduces the problem on Plucky, but I now have a test that's reproduced the issue 4 times in the last 2 days. This isn't as frequently as Noble, where we saw it approx 1:2000 boots in production

[Bug 2090972] Re: /boot intermittently fails to mount on boot

2024-12-05 Thread Krister Johansen
Hi Matthew, I went ahead and put together a plucky cloud image so I can try running the tests against this. I'll report back with the results. Conceptually, the test just launches a qemu instance and the greps the logs at an interval to determine if it's either booted or hit the bug. If it's boo

[Bug 2090972] [NEW] /boot intermittently fails to mount on boot

2024-12-03 Thread Krister Johansen
Public bug reported: Starting on Noble, we see /boot fail to mount in approximately one out of every two thousand boots. The error looks like this: Found device dev-disk-by\x2dlabel-BOOT.device - QEMU NVMe Ctrl BOOT. Starting systemd-fsck@dev-disk-by… Check on /dev/disk/by-label/BOOT...

[Bug 2089373] Re: WARN in trc_wait_for_one_reader about failed IPIs

2024-11-22 Thread Krister Johansen
Patches to kernel team: https://lists.ubuntu.com/archives/kernel-team/2024-November/155489.html -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2089373 Title: WARN in trc_wait_for_one_reader about fa

[Bug 2089373] Re: WARN in trc_wait_for_one_reader about failed IPIs

2024-11-22 Thread Krister Johansen
This specifically affects Jammy and the 5.15 series. I have the necessary patches prepared and will e-mail those to the kernel team's mailing list. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2089373

[Bug 2089373] [NEW] WARN in trc_wait_for_one_reader about failed IPIs

2024-11-22 Thread Krister Johansen
Public bug reported: [Impact] When ending bpf tracing, 5.15 kernels now report a warning in trc_wait_for_one_reader() on platforms that support hot-plugging CPUs, but that do not have all of their hotplug slots populated. In this submitter's environment, it reproduces on Xen EC2 instances, but n

[Bug 2036467] Re: Resizing cloud-images occasionally fails due to superblock checksum mismatch in resize2fs

2024-10-21 Thread Krister Johansen
Thanks Matthew and Andreas! Very much appreciate getting the fix released for Noble, Jammy, and Focal. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2036467 Title: Resizing cloud-images occasionally

[Bug 2036467] Re: Resizing cloud-images occasionally fails due to superblock checksum mismatch in resize2fs

2024-08-29 Thread Krister Johansen
Hi, Thanks for getting the updates released for Jammy and Noble. Is there any plan to get packages for Focal released as part of the updates cycle? The status here says the fix is committed. It's where we ran into this issue initially, which is part of the reason we're still interested in pic

[Bug 2036467] Re: Resizing cloud-images occasionally fails due to superblock checksum mismatch in resize2fs

2024-07-08 Thread Krister Johansen
Thanks for the note, Matthew. I was just getting ready to check back with you. :) It would be fantastic if we could get the patches for the backport sponsored in F, J, M, N. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bug

[Bug 2067924] Re: systemd-networkd crashes on systems with amazon-vpc-cni-k8s

2024-06-03 Thread Krister Johansen
I'm hitting this segfault as well and would love to get it fixed in Noble. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2067924 Title: systemd-networkd crashes on systems with amazon-vpc-cni-k8s T

[Bug 2036467] Re: Resizing cloud-images occasionally fails due to superblock checksum mismatch in resize2fs

2024-05-21 Thread Krister Johansen
Hi Matthew, Ted has cut the 1.47.1 release as well as tagged a version for Debian. Are you good to pull that version in as well as apply the patches for this fix to Focal and Jammy? Thanks again, -K -- You received this bug notification because you are a member of Ubuntu Bugs, which is subsc

[Bug 2036467] Re: Resizing cloud-images occasionally fails due to superblock checksum mismatch in resize2fs

2024-04-25 Thread Krister Johansen
Hi Matthew, It's been a couple months. We'd really love to get the fix for Focal, Jammy, and Noble. Any chance this could get sponsored and approved soon? I also checked up on upstream and it appears that they're preparing a 1.47.1 release of e2fsprogs that should include this fix. It hasn't b

[Bug 2056227] Re: KVM: arm64: softlockups in stage2_apply_range

2024-04-11 Thread Krister Johansen
I've tested linux/5.15.0-104.114 and it passes my tests. Marking verification-done-jammy-linux. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2056227 Title: KVM: arm64: softlockups in stage2_apply_

[Bug 2056227] Re: KVM: arm64: softlockups in stage2_apply_range

2024-04-11 Thread Krister Johansen
For posterity, LTS 5.15 picked up this fix in 5.15.154 ** Tags removed: verification-needed-jammy-linux ** Tags added: verification-done-jammy-linux -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/20562

[Bug 2056227] Re: KVM: arm64: softlockups in stage2_apply_range

2024-03-05 Thread Krister Johansen
Patches to mailing list here: https://lists.ubuntu.com/archives/kernel-team/2024-March/149383.html -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2056227 Title: KVM: arm64: softlockups in stage2_app

[Bug 2056227] Re: KVM: arm64: softlockups in stage2_apply_range

2024-03-05 Thread Krister Johansen
This specifically affects Jammy and the 5.15 series. I have the necessary patches prepared and will e-mail those to the kernel team's mailing list. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/205622

[Bug 2056227] [NEW] KVM: arm64: softlockups in stage2_apply_range

2024-03-05 Thread Krister Johansen
Public bug reported: [Impact] Tearing down kvm VMs on arm64 can cause softlockups to appear on console. When terminating VMs with > 100Gb of memory and 4k pages, the memory unmap times often exceed 20 seconds, which can trigger the softlockup detector. Portions of the unmap path also have inter

[Bug 2036467] Re: Resizing cloud-images occasionally fails due to superblock checksum mismatch in resize2fs

2024-02-26 Thread Krister Johansen
Thanks for the update, Matthew. We're looking forward to getting this fix from Ubuntu. My team patched our version the e2fsprogs package from Focal about a year ago, before we submitted the fix upstream. Since that patch, we haven't had any re-occurrences of the problem. It used to show up abou