After updating the MAAS images to use an update version of the -stable
images, it now appears the ThunderX2 will boot with focal linux-generic:
See Below,

The Deployed kernel did not experience a "synchronous external abort: 96000610 
[#1] SMP" when a reboot command was issued to power cycle.
Deployed Kernel: 5.4.0-81-generic #91-Ubuntu SMP Thu Jul 15 19:10:30 UTC 2021

After rebooting into the new -proposed kernel at this time, the Host came up , 
followed by the kernel panic. This did NOT render the system unusable. 
Upgraded Kernel: 5.4.0-83-generic #93-Ubuntu 

helo-kernel login: [  139.500352] Internal error: synchronous external abort: 
96000610 [#1] SMP
[  139.507134] Modules linked in: nls_iso8859_1 dm_multipath scsi_dh_rdac 
scsi_dh_emc scsi_dh_alua joydev input_leds ipmi_ssif ipmi_devintf 
ipmi_msghandler thunderx2_pmu cppc_cpufreq sch_fq_codel ip_tables x_tables 
autofs4 btrfs zstd_compress raid10 raid456 async_raid6_recov async_memcpy 
async_pq async_xor async_tx xor xor_neon raid6_pq libcrc32c raid1 raid0 
multipath linear i2c_smbus hid_generic usbhid hid uas ast drm_vram_helper ttm 
crct10dif_ce drm_kms_helper ghash_ce syscopyarea sha2_ce sysfillrect 
sha256_arm64 mpt3sas sysimgblt usb_storage qede sha1_ce fb_sys_fops raid_class 
qed drm scsi_transport_sas igb ahci i2c_algo_bit crc8 gpio_xlp i2c_xlp9xx 
aes_neon_bs aes_neon_blk aes_ce_blk crypto_simd cryptd aes_ce_cipher
[  139.570639] CPU: 56 PID: 4157 Comm: landscape-sysin Not tainted 
5.4.0-83-generic #93-Ubuntu
[  139.578976] Hardware name: To be filled by O.E.M. Saber/Saber, BIOS 0ACKL030 
06/04/2020
[  139.586965] pstate: 20400009 (nzCv daif +PAN -UAO)
[  139.591767] pc : qed_memcpy_hw+0x98/0x140 [qed]
[  139.596295] lr : qed_memcpy_hw+0x12c/0x140 [qed]
[  139.600898] sp : ffff8000364131b0
[  139.604199] x29: ffff8000364131b0 x28: 0000000000000000 
[  139.609497] x27: ffff009ee6803538 x26: 0000000000000000 
[  139.614795] x25: 0000000000001000 x24: ffff800036413298 
[  139.620093] x23: 0000000001d04b68 x22: 0000000000000040 
[  139.625391] x21: ffff009ed9b70090 x20: 0000000000000040 
[  139.630688] x19: 0000000000000000 x18: 0000000000000000 
[  139.635986] x17: 0000000000000000 x16: 0000000000000000 
[  139.641283] x15: 0000000000000000 x14: 0000000000000000 
[  139.646581] x13: 0000000000000000 x12: 0000000000000020 
[  139.651878] x11: 0101010101010101 x10: 7f7f7f7f7f7f7f7f 
[  139.657176] x9 : 0000000000000000 x8 : ffff8000364132d8 
[  139.662473] x7 : ffff800036413298 x6 : 000000000000000f 
[  139.667771] x5 : 0000000000000000 x4 : 0000000000000040 
[  139.673068] x3 : 0000000001d04b68 x2 : ffff800025b8a000 
[  139.678366] x1 : ffff800025b80000 x0 : 0000000000000010 
[  139.683665] Call trace:
[  139.686110]  qed_memcpy_hw+0x98/0x140 [qed]
[  139.690289]  qed_memcpy_from+0x64/0xc0 [qed]
[  139.694555]  __qed_get_vport_mstats+0x90/0x148 [qed]
[  139.699515]  _qed_get_vport_stats+0x198/0x298 [qed]
[  139.704388]  qed_get_vport_stats+0x30/0x88 [qed]
[  139.708997]  qede_fill_by_demand_stats+0x44/0x290 [qede]
[  139.714297]  qede_get_stats64+0x30/0xd0 [qede]
[  139.718729]  dev_get_stats+0x6c/0xd8
[  139.722292]  rtnl_fill_stats+0x50/0x148
[  139.726115]  rtnl_fill_ifinfo+0x510/0xd60
[  139.730110]  rtnl_dump_ifinfo+0x25c/0x528
[  139.734108]  netlink_dump+0xfc/0x330
[  139.737671]  __netlink_dump_start+0x144/0x1c0
[  139.742013]  rtnetlink_rcv_msg+0x240/0x338
[  139.746096]  netlink_rcv_skb+0x60/0x120
[  139.749918]  rtnetlink_rcv+0x2c/0x38
[  139.753480]  netlink_unicast+0x188/0x210
[  139.757389]  netlink_sendmsg+0x1c0/0x368
[  139.761301]  sock_sendmsg+0x58/0x68
[  139.764776]  __sys_sendto+0xe8/0x158
[  139.768338]  __arm64_sys_sendto+0x34/0x48
[  139.772335]  el0_svc_common.constprop.0+0xe4/0x1f0
[  139.777112]  el0_svc_handler+0x38/0xa8
[  139.780848]  el0_svc+0x10/0x2c8
[  139.783980] Code: d37e7cc8 91001108 8b0800e8 b4000140 (b9400046) 
[  139.790060] ---[ end trace f0a24c697c627870 ]---
[  415.995884] Internal error: synchronous external abort: 96000610 [#2] SMP
[  416.002669] Modules linked in: nls_iso8859_1 dm_multipath scsi_dh_rdac 
scsi_dh_emc scsi_dh_alua joydev input_leds ipmi_ssif ipmi_devintf 
ipmi_msghandler thunderx2_pmu cppc_cpufreq sch_fq_codel ip_tables x_tables 
autofs4 btrfs zstd_compress raid10 raid456 async_raid6_recov async_memcpy 
async_pq async_xor async_tx xor xor_neon raid6_pq libcrc32c raid1 raid0 
multipath linear i2c_smbus hid_generic usbhid hid uas ast drm_vram_helper ttm 
crct10dif_ce drm_kms_helper ghash_ce syscopyarea sha2_ce sysfillrect 
sha256_arm64 mpt3sas sysimgblt usb_storage qede sha1_ce fb_sys_fops raid_class 
qed drm scsi_transport_sas igb ahci i2c_algo_bit crc8 gpio_xlp i2c_xlp9xx 
aes_neon_bs aes_neon_blk aes_ce_blk crypto_simd cryptd aes_ce_cipher
[  416.066204] CPU: 0 PID: 14 Comm: kworker/0:1 Tainted: G      D           
5.4.0-83-generic #93-Ubuntu
[  416.075323] Hardware name: To be filled by O.E.M. Saber/Saber, BIOS 0ACKL030 
06/04/2020
[  416.083337] Workqueue: events igb_ptp_overflow_check [igb]
[  416.088813] pstate: 20400009 (nzCv daif +PAN -UAO)
[  416.093602] pc : igb_rd32+0x30/0xd8 [igb]
[  416.097610] lr : igb_ptp_read_82576+0x2c/0x50 [igb]
[  416.102475] sp : ffff800012a7bd20
[  416.105777] x29: ffff800012a7bd20 x28: 0000000000000000 
[  416.111078] x27: ffff009ef29cb400 x26: ffff800011b98400 
[  416.116377] x25: 0000000000000000 x24: ffff009ed56098d0 
[  416.121677] x23: 0000000000000000 x22: ffff009efbda9500 
[  416.126976] x21: ffff009ed5608e08 x20: 000000000000b600 
[  416.132276] x19: ffff80002622b600 x18: 0000000000000017 
[  416.137575] x17: 0000000000000007 x16: 000000000000000e 
[  416.142874] x15: 0000000000000004 x14: 0000000000000019 
[  416.148173] x13: 0000000000000000 x12: 0000000000000001 
[  416.153473] x11: ffff800011258368 x10: 0000000000000ad0 
[  416.158772] x9 : ffff009ef29cb46c x8 : fefefefefefefeff 
[  416.164071] x7 : 0000000000000018 x6 : ffff009ef29cb46c 
[  416.169370] x5 : 000073746e657665 x4 : 000000000000002f 
[  416.174669] x3 : 0000000000000000 x2 : 0000000000000018 
[  416.179969] x1 : ffff800026220000 x0 : ffff800008f10de4 
[  416.185269] Call trace:
[  416.187715]  igb_rd32+0x30/0xd8 [igb]
[  416.191374]  igb_ptp_read_82576+0x2c/0x50 [igb]
[  416.195897]  timecounter_read+0x28/0x70
[  416.199729]  igb_ptp_overflow_check+0x24/0x78 [igb]
[  416.204599]  process_one_work+0x1d0/0x468
[  416.208598]  worker_thread+0x154/0x4e0
[  416.212335]  kthread+0xf0/0x118
[  416.215468]  ret_from_fork+0x10/0x18
[  416.219037] Code: d503201f f94006a1 b40002c1 8b344033 (b9400273) 
[  416.225120] ---[ end trace f0a24c697c627871 ]---

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1940482

Title:
  [thunderx2] Synchronous external abort: 96000610 [#1] SMP

Status in linux package in Ubuntu:
  Incomplete
Status in linux source package in Focal:
  Incomplete

Bug description:
  [Impact]:
  ThunderX2 will not deploy Focal, Arm64 Cloud Image - 20210811
  focal": {"stable": {"content_id": "maas:v2:download", "kflavor": "generic", 
"path": "ubuntu/arm64/ga-20.04/focal/20210811/boot-initrd", "product_name": 
"maas:boot:ubuntu:arm64:ga-20.04:focal"

  [  286.968817] Internal error: synchronous external abort: 96000610 [#1] SMP
  [  286.975594] Modules linked in: nls_iso8859_1 bcache crc64 zfs(PO) 
zunicode(PO) zlua(PO) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) 
dm_multipath scsi_dh_rdac scsi_dh_emc scsi_dh_alua overlay btrfs zstd_compress 
raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor 
xor_neon raid6_pq libcrc32c raid1 raid0 multipath linear i2c_smbus hid_generic 
ast drm_vram_helper ttm usbhid drm_kms_helper crct10dif_ce hid syscopyarea 
ghash_ce sysfillrect sha2_ce qede mpt3sas sha256_arm64 ipmi_ssif sysimgblt uas 
sha1_ce fb_sys_fops qed ipmi_devintf igb raid_class drm ipmi_msghandler 
scsi_transport_sas ahci i2c_algo_bit crc8 gpio_xlp i2c_xlp9xx usb_storage 
aes_neon_bs aes_neon_blk aes_ce_blk crypto_simd cryptd aes_ce_cipher
  [  287.040312] CPU: 1 PID: 1 Comm: shutdown Tainted: P           O      
5.4.0-80-generic #90-Ubuntu
  [  287.049083] Hardware name: To be filled by O.E.M. Saber/Saber, BIOS 
0ACKL030 06/04/2020
  [  287.057072] pstate: 60400009 (nZCv daif +PAN -UAO)
  [  287.061864] pc : igb_rd32+0x30/0xd8 [igb]
  [  287.065865] lr : __igb_shutdown+0x84/0x1d8 [igb]
  [  287.070468] sp : ffff80001255bb90
  [  287.073769] x29: ffff80001255bb90 x28: ffff00bf5434e900 
  [  287.079067] x27: 0000000000000000 x26: ffff009eef029130 
  [  287.084365] x25: 0000000000000000 x24: ffff009ed603ce08 
  [  287.089663] x23: ffff80001255bc37 x22: ffff009eef029000 
  [  287.094960] x21: ffff009ed603ce08 x20: 0000000000000008 
  [  287.100258] x19: ffff8000301c0008 x18: 0000000000000000 
  [  287.105555] x17: 0000000000000000 x16: 0000000000000032 
  [  287.110853] x15: 0000000000000004 x14: 0000000000000003 
  [  287.116150] x13: 0000000000000000 x12: ffff009ed50f3530 
  [  287.121448] x11: ffff009ed50f3478 x10: 0000000000000000 
  [  287.126745] x9 : 0000000000000001 x8 : 0000000000210d00 
  [  287.132043] x7 : 0000000000000000 x6 : 0000000000000001 
  [  287.137340] x5 : 0000000000000000 x4 : fffffe027b2d5c20 
  [  287.142638] x3 : ffff00bf5434e900 x2 : 0000000000000000 
  [  287.147935] x1 : ffff8000301c0000 x0 : ffff8000090491c4 
  [  287.153234] Call trace:
  [  287.155673]  igb_rd32+0x30/0xd8 [igb]
  [  287.159326]  __igb_shutdown+0x84/0x1d8 [igb]
  [  287.163586]  igb_shutdown+0x38/0x90 [igb]
  [  287.167585]  pci_device_shutdown+0x48/0x88
  [  287.171670]  device_shutdown+0x14c/0x298
  [  287.175582]  kernel_restart_prepare+0x48/0x58
  [  287.179925]  kernel_restart+0x24/0x80
  [  287.183573]  __do_sys_reboot+0x100/0x228
  [  287.187482]  __arm64_sys_reboot+0x30/0x40
  [  287.191480]  el0_svc_common.constprop.0+0xe4/0x1f0
  [  287.196256]  el0_svc_handler+0x38/0xa8
  [  287.199993]  el0_svc+0x10/0x2c8
  [  287.203124] Code: d503201f f94006a1 b40002c1 8b344033 (b9400273) 
  [  287.209320] ---[ end trace b2addffb79e92219 ]---
  [  287.214039] Kernel panic - not syncing: Attempted to kill init! 
exitcode=0x0000000b
  [  287.221755] Kernel Offset: disabled
  [  287.225231] CPU features: 0x6002,62000c38
  [  287.229226] Memory Limit: none
  [  287.232296] ---[ end Kernel panic - not syncing: Attempted to kill init! 
exitcode=0x0000000b ]---
  Rom...
  CRC: len=0xf080, cal=0x27ff5de9, img=0x27ff5de9, match!

  
  [Test Case]:
  Deploy Focal/Arm64-Generic to a ThunderX2 in the MAAS (Metal As a Service) 
provisioner. Using MAAS version: 2.9.3~beta1 (9197-g.afe92bb63) via a snap,  
the daily focal image appears to be 20210811

  From the kernel teams standpoint this kernel in the initrd, did pass
  SRU testing before its release.

  [Fix]:
  N/A
  [Regression]:
  Probably No (From Kernel Viewpoint) this could possibly be caused by 
something other than kernel.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1940482/+subscriptions


-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to     : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp

Reply via email to