I've dug some more and discovered that the ephemeral initrd files
provided by MAAS for Ubuntu 26.04 seem to be missing a lot of driver
files. My investigations involved a machine configured to use the
candidate stream at http://images.maas.io/ephemeral-v3/candidate/.

To begin, I did a deployment of Ubuntu 24.04 on my home MAAS server. The
MAAS logs included the following line:

HTTP Request -
/images/02d329e/ubuntu/amd64/ga-24.04/noble/candidate/boot-initrd

The equivalent line for a deployment of Ubuntu 26.04 was:

HTTP Request -
/images/128d3bf/ubuntu/amd64/ga-26.04/resolute/candidate/boot-initrd

I then found the files with those hexadecimal names (02d329e and
128d3bf) in /var/snap/maas/common/maas/image-storage on the MAAS server.
I verified that they were initrd files.

A first clue of the problem is in their relative sizes:

ls -lh /var/snap/maas/common/maas/image-storage/02d329e 
/var/snap/maas/common/maas/image-storage/128d3bf
-rw-r--r-- 1 root root 79M May  4 16:45 
/var/snap/maas/common/maas/image-storage/02d329e
-rw-r--r-- 1 root root 67M May  4 16:45 
/var/snap/maas/common/maas/image-storage/128d3bf

Note that the 26.04 initrd (128d3bf) is 12M smaller than the 24.04
initrd (02d329e).

I extracted their contents into separate directories with unmkinitramfs
and searched for kernel drivers. I'm attaching a tarball with two files
listing the modules I found, with directory paths tweaked a bit so as to
enable comparison via diff, meld, or similar tools. Quite a few PATA,
SATA, RAID, and Infiniband drivers are present in the noble module list
but not in the resolute module list, including (but not limited to):

./kernel/drivers/ata/pata_netcell.ko.zst
./kernel/drivers/ata/pata_sl82c105.ko.zst
./kernel/drivers/ata/pata_cypress.ko.zst
./kernel/drivers/ata/pata_hpt3x3.ko.zst
./kernel/drivers/ata/pata_amd.ko.zst
./kernel/drivers/ata/sata_sx4.ko.zst
./kernel/drivers/ata/sata_mv.ko.zst
./kernel/drivers/ata/sata_qstor.ko.zst
./kernel/drivers/ata/pata_pdc202xx_old.ko.zst
./kernel/drivers/ata/pata_hpt366.ko.zst
./kernel/drivers/ata/ahci_platform.ko.zst
./kernel/drivers/ata/sata_promise.ko.zst
./kernel/drivers/ata/pata_it821x.ko.zst
./kernel/drivers/ata/pata_artop.ko.zst
./kernel/drivers/ata/pata_hpt3x2n.ko.zst
./kernel/drivers/ata/pata_piccolo.ko.zst
./kernel/drivers/ata/sata_uli.ko.zst
./kernel/drivers/ata/pata_ali.ko.zst
./kernel/drivers/ata/pata_mpiix.ko.zst
./kernel/drivers/ata/pata_sch.ko.zst
./kernel/drivers/ata/acard-ahci.ko.zst
./kernel/drivers/ata/sata_vsc.ko.zst
./kernel/drivers/ata/pata_rdc.ko.zst
./kernel/drivers/ata/pata_pdc2027x.ko.zst
./kernel/drivers/ata/pata_sil680.ko.zst
./kernel/drivers/ata/pata_hpt37x.ko.zst
./kernel/drivers/ata/pata_ninja32.ko.zst
./kernel/drivers/ata/pata_efar.ko.zst
./kernel/drivers/ata/pata_atiixp.ko.zst
./kernel/drivers/ata/pata_rz1000.ko.zst
./kernel/drivers/ata/pata_optidma.ko.zst
./kernel/drivers/ata/sata_sis.ko.zst
./kernel/drivers/ata/pata_atp867x.ko.zst
./kernel/drivers/ata/sata_via.ko.zst
./kernel/drivers/ata/libahci_platform.ko.zst
./kernel/drivers/ata/sata_svw.ko.zst
./kernel/drivers/ata/pata_legacy.ko.zst
./kernel/drivers/ata/pata_it8213.ko.zst
./kernel/drivers/ata/sata_inic162x.ko.zst
./kernel/drivers/ata/pata_parport/pata_parport.ko.zst
./kernel/drivers/ata/pata_via.ko.zst
./kernel/drivers/ata/sata_nv.ko.zst
./kernel/drivers/ata/pata_oldpiix.ko.zst
./kernel/drivers/ata/pdc_adma.ko.zst
./kernel/drivers/ata/pata_marvell.ko.zst
./kernel/drivers/ata/ahci_dwc.ko.zst
./kernel/drivers/ata/pata_ns87410.ko.zst
./kernel/drivers/ata/pata_pcmcia.ko.zst
./kernel/drivers/ata/pata_triflex.ko.zst
./kernel/drivers/ata/pata_ns87415.ko.zst
./kernel/drivers/ata/pata_opti.ko.zst
./kernel/drivers/ata/pata_cmd64x.ko.zst
./kernel/drivers/ata/pata_cmd640.ko.zst
./kernel/drivers/scsi/iscsi_boot_sysfs.ko.zst
./kernel/drivers/scsi/hptiop.ko.zst
./kernel/drivers/scsi/scsi_transport_sas.ko.zst
./kernel/drivers/scsi/qla2xxx/qla2xxx.ko.zst
./kernel/drivers/scsi/vmw_pvscsi.ko.zst
./kernel/drivers/scsi/dc395x.ko.zst
./kernel/drivers/scsi/scsi_transport_fc.ko.zst
./kernel/drivers/scsi/megaraid.ko.zst
./kernel/drivers/scsi/qedi/qedi.ko.zst
./kernel/drivers/scsi/stex.ko.zst
./kernel/drivers/scsi/3w-9xxx.ko.zst
./kernel/drivers/scsi/myrs.ko.zst
./kernel/drivers/scsi/smartpqi/smartpqi.ko.zst
./kernel/drivers/scsi/libiscsi.ko.zst
./kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko.zst
./kernel/drivers/scsi/elx/efct.ko.zst
./kernel/drivers/scsi/fcoe/libfcoe.ko.zst
./kernel/drivers/scsi/fcoe/fcoe.ko.zst
./kernel/drivers/scsi/mpi3mr/mpi3mr.ko.zst
./kernel/drivers/scsi/isci/isci.ko.zst
./kernel/drivers/scsi/scsi_transport_srp.ko.zst
./kernel/drivers/scsi/iscsi_tcp.ko.zst
./kernel/drivers/scsi/3w-xxxx.ko.zst
./kernel/drivers/scsi/aic7xxx/aic79xx.ko.zst
./kernel/drivers/scsi/aic7xxx/aic7xxx.ko.zst
./kernel/drivers/scsi/3w-sas.ko.zst
./kernel/drivers/scsi/qla4xxx/qla4xxx.ko.zst
./kernel/drivers/scsi/advansys.ko.zst
./kernel/drivers/scsi/wd719x.ko.zst
./kernel/drivers/scsi/qla1280.ko.zst
./kernel/drivers/scsi/scsi_transport_iscsi.ko.zst
./kernel/drivers/scsi/fnic/fnic.ko.zst
./kernel/drivers/scsi/aic94xx/aic94xx.ko.zst
./kernel/drivers/scsi/ipr.ko.zst
./kernel/drivers/scsi/qlogicfas408.ko.zst
./kernel/drivers/scsi/bfa/bfa.ko.zst
./kernel/drivers/scsi/pmcraid.ko.zst
./kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko.zst
./kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko.zst
./kernel/drivers/scsi/cxgbi/libcxgbi.ko.zst
./kernel/drivers/scsi/megaraid/megaraid_sas.ko.zst
./kernel/drivers/scsi/megaraid/megaraid_mm.ko.zst
./kernel/drivers/scsi/megaraid/megaraid_mbox.ko.zst
./kernel/drivers/scsi/BusLogic.ko.zst
./kernel/drivers/scsi/bnx2i/bnx2i.ko.zst
./kernel/drivers/scsi/raid_class.ko.zst
./kernel/drivers/scsi/csiostor/csiostor.ko.zst
./kernel/drivers/scsi/bnx2fc/bnx2fc.ko.zst
./kernel/drivers/scsi/ips.ko.zst
./kernel/drivers/scsi/hv_storvsc.ko.zst
./kernel/drivers/scsi/myrb.ko.zst
./kernel/drivers/scsi/imm.ko.zst
./kernel/drivers/scsi/initio.ko.zst
./kernel/drivers/scsi/esp_scsi.ko.zst
./kernel/drivers/scsi/fdomain.ko.zst
./kernel/drivers/scsi/scsi_transport_spi.ko.zst
./kernel/drivers/scsi/pcmcia/sym53c500_cs.ko.zst
./kernel/drivers/scsi/pcmcia/qlogic_cs.ko.zst
./kernel/drivers/scsi/pcmcia/aha152x_cs.ko.zst
./kernel/drivers/scsi/atp870u.ko.zst
./kernel/drivers/scsi/mpt3sas/mpt3sas.ko.zst
./kernel/drivers/scsi/arcmsr/arcmsr.ko.zst
./kernel/drivers/scsi/scsi_debug.ko.zst
./kernel/drivers/scsi/pm8001/pm80xx.ko.zst
./kernel/drivers/scsi/am53c974.ko.zst
./kernel/drivers/scsi/mvumi.ko.zst
./kernel/drivers/scsi/esas2r/esas2r.ko.zst
./kernel/drivers/scsi/a100u2w.ko.zst
./kernel/drivers/scsi/lpfc/lpfc.ko.zst
./kernel/drivers/scsi/snic/snic.ko.zst
./kernel/drivers/scsi/libfc/libfc.ko.zst
./kernel/drivers/scsi/hpsa.ko.zst
./kernel/drivers/scsi/qedf/qedf.ko.zst
./kernel/drivers/scsi/ppa.ko.zst
./kernel/drivers/scsi/xen-scsifront.ko.zst
./kernel/drivers/scsi/libiscsi_tcp.ko.zst
./kernel/drivers/scsi/aacraid/aacraid.ko.zst
./kernel/drivers/infiniband/ulp/rtrs/rtrs-core.ko.zst
./kernel/drivers/infiniband/ulp/rtrs/rtrs-server.ko.zst
./kernel/drivers/infiniband/ulp/rtrs/rtrs-client.ko.zst
./kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko.zst
./kernel/drivers/infiniband/ulp/opa_vnic/opa_vnic.ko.zst
./kernel/drivers/infiniband/ulp/isert/ib_isert.ko.zst
./kernel/drivers/infiniband/ulp/iser/ib_iser.ko.zst
./kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko.zst
./kernel/drivers/infiniband/ulp/srp/ib_srp.ko.zst
./kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko.zst
./kernel/drivers/infiniband/hw/vmw_pvrdma/vmw_pvrdma.ko.zst
./kernel/drivers/infiniband/hw/bnxt_re/bnxt_re.ko.zst
./kernel/drivers/infiniband/hw/mana/mana_ib.ko.zst
./kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko.zst
./kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko.zst
./kernel/drivers/infiniband/hw/qib/ib_qib.ko.zst
./kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko.zst
./kernel/drivers/infiniband/hw/qedr/qedr.ko.zst
./kernel/drivers/infiniband/hw/efa/efa.ko.zst
./kernel/drivers/infiniband/hw/hfi1/hfi1.ko.zst
./kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko.zst
./kernel/drivers/infiniband/hw/mthca/ib_mthca.ko.zst
./kernel/drivers/infiniband/hw/irdma/irdma.ko.zst
./kernel/drivers/infiniband/hw/erdma/erdma.ko.zst
./kernel/drivers/infiniband/core/ib_cm.ko.zst
./kernel/drivers/infiniband/core/ib_uverbs.ko.zst
./kernel/drivers/infiniband/core/rdma_ucm.ko.zst
./kernel/drivers/infiniband/core/iw_cm.ko.zst
./kernel/drivers/infiniband/core/rdma_cm.ko.zst
./kernel/drivers/infiniband/core/ib_umad.ko.zst
./kernel/drivers/infiniband/core/ib_core.ko.zst
./kernel/drivers/infiniband/sw/rxe/rdma_rxe.ko.zst
./kernel/drivers/infiniband/sw/siw/siw.ko.zst
./kernel/drivers/infiniband/sw/rdmavt/rdmavt.ko.zst

A spot check shows that at least many of these drivers are included in a
deployed 26.04 system, on nodes that are unaffected by this bug (such as
systems with nothing but NVMe drives). Thus, the deployed images include
the relevant kernel modules, but the initrd used for deployment lacks
them.

It therefore appears that the initrd file used for MAAS deployments on
AMD64 needs to be re-built to include these missing files ASAP.

** Attachment added: "Listings of modules for noble and resolute in the initrds 
delivered by MAAS"
   
https://bugs.launchpad.net/maas/+bug/2151116/+attachment/5968242/+files/comparative-modules.tgz

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2151116

Title:
  26.04 Unable to Deploy:  Failed to find storage

To manage notifications about this bug go to:
https://bugs.launchpad.net/maas/+bug/2151116/+subscriptions


-- 
ubuntu-bugs mailing list
[email protected]
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Reply via email to