Seeing on customer site. subscribed ~field-critical

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1850284

Title:
  Failure when creating multiple VMs with sr-iov port

Status in linux package in Ubuntu:
  New

Bug description:
  When creating a multiple in the row KVM instances with an SR-IOV interface 
this way:
  manually
  - openstack port create --vnic-type direct --network sriov-net sriov-portN
  (2 sec pause)
  - openstack server create --port sriov-portN --image bionic-sriov 
--availability-zone nova:hostname --flavor m1.small --key-name maaskey 
test-sriovN
  (2 sec pause)

  and x 5 times.

  The host hangs, stops being accessible via juju ssh, ssh attempt to bondm 
address gets connection refused.
  Icmp to host gets response though.
  If I type password manually in ilo console - there is no bash prompt after it.

  After rebooting I found the following in journalctl :

  Oct 29 08:26:23 hostname kernel: general protection fault: 0000 [#1] SMP PTI
  Oct 29 08:26:23 hostname kernel: CPU: 8 PID: 7405 Comm: libvirtd Not tainted 
5.0.0-32-generic #34~18.04.2-Ubuntu
  Oct 29 08:26:23 hostname kernel: Hardware name: HPE ProLiant DL380 
Gen10/ProLiant DL380 Gen10, BIOS U30 05/21/2019
  Oct 29 08:26:23 hostname kernel: RIP: 0010:i40e_sync_vsi_filters+0xaa/0xca0 
[i40e]
  Oct 29 08:26:23 hostname kernel: Code: 00 00 00 48 89 85 78 ff ff ff 48 8b 83 
10 02 00 00 48 c1 e8 03 48 89 85 70 ff ff ff 83 e0 01 88 45 8b 48 8b 03 48 85 
c0 74 17 <8b> 80 38 02 00 00 8b b3 0c 02 00 00 31 c6 89 83 0c 02 00 00 89 75
  Oct 29 08:26:23 hostname kernel: RSP: 0018:ffffb91a77ac7708 EFLAGS: 00010286
  Oct 29 08:26:23 hostname kernel: RAX: 8287194a20ac1de7 RBX: ffff9c5594638000 
RCX: 0000000000000000
  Oct 29 08:26:23 hostname kernel: RDX: 0000000000000001 RSI: 00000000fffffe01 
RDI: ffff9c5594638000
  Oct 29 08:26:23 hostname kernel: RBP: ffffb91a77ac77b0 R08: 0000000000000000 
R09: 00000000000024f8
  Oct 29 08:26:23 hostname kernel: R10: 00000000000024f8 R11: 0000000000003e25 
R12: ffff9c57670e2580
  Oct 29 08:26:23 hostname kernel: R13: ffff9c5594638000 R14: ffff9c5763896000 
R15: ffff9c5594638a28
  Oct 29 08:26:23 hostname kernel: FS:  00007f386be92700(0000) 
GS:ffff9c077f800000(0000) knlGS:0000000000000000
  Oct 29 08:26:23 hostname kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 
0000000080050033
  Oct 29 08:26:23 hostname kernel: CR2: 00007f3851d53e17 CR3: 0000004d76f4e003 
CR4: 00000000007626e0
  Oct 29 08:26:23 hostname kernel: DR0: 0000000000000000 DR1: 0000000000000000 
DR2: 0000000000000000
  Oct 29 08:26:23 hostname kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 
DR7: 0000000000000400
  Oct 29 08:26:23 hostname kernel: PKRU: 55555554
  Oct 29 08:26:23 hostname kernel: Call Trace:
  Oct 29 08:26:23 hostname kernel:  ? del_timer_sync+0x45/0x50
  Oct 29 08:26:23 hostname kernel:  ? __next_timer_interrupt+0xe0/0xe0
  Oct 29 08:26:23 hostname kernel:  i40e_ndo_set_vf_mac+0x11c/0x2b0 [i40e]
  Oct 29 08:26:23 hostname kernel:  do_setlink+0x4fd/0xed0
  Oct 29 08:26:23 hostname kernel:  ? find_busiest_group+0x49/0x560
  Oct 29 08:26:23 hostname kernel:  rtnl_setlink+0x111/0x150
  Oct 29 08:26:23 hostname kernel:  rtnetlink_rcv_msg+0x296/0x340
  Oct 29 08:26:23 hostname kernel:  ? aa_label_sk_perm.part.4+0x10f/0x160
  Oct 29 08:26:23 hostname kernel:  ? _cond_resched+0x19/0x40
  Oct 29 08:26:23 hostname kernel:  ? rtnl_calcit.isra.28+0x120/0x120
  Oct 29 08:26:23 hostname kernel:  netlink_rcv_skb+0x51/0x120
  Oct 29 08:26:23 hostname kernel:  rtnetlink_rcv+0x15/0x20
  Oct 29 08:26:23 hostname kernel:  netlink_unicast+0x1a4/0x250
  Oct 29 08:26:23 hostname kernel:  netlink_sendmsg+0x2d1/0x3d0
  Oct 29 08:26:23 hostname kernel:  sock_sendmsg+0x3e/0x50
  Oct 29 08:26:23 hostname kernel:  ___sys_sendmsg+0x2a0/0x2f0
  Oct 29 08:26:23 hostname kernel:  ? aa_label_sk_perm.part.4+0x10f/0x160
  Oct 29 08:26:23 hostname kernel:  ? _raw_spin_unlock_bh+0x1e/0x20
  Oct 29 08:26:23 hostname kernel:  ? release_sock+0x8f/0xa0
  Oct 29 08:26:23 hostname kernel:  __sys_sendmsg+0x63/0xa0
  Oct 29 08:26:23 hostname kernel:  ? __sys_sendmsg+0x63/0xa0
  Oct 29 08:26:23 hostname kernel:  __x64_sys_sendmsg+0x1f/0x30
  Oct 29 08:26:23 hostname kernel:  do_syscall_64+0x5a/0x120
  Oct 29 08:26:23 hostname kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
  Oct 29 08:26:23 hostname kernel: RIP: 0033:0x7f3878c16607
  Oct 29 08:26:23 hostname kernel: Code: 44 00 00 41 54 55 41 89 d4 53 48 89 f5 
89 fb 48 83 ec 10 e8 0b ea ff ff 44 89 e2 41 89 c0 48 89 ee 89 df b8 2e 00 00 
00 0f 05 <48> 3d 00 f0 ff ff 77 35 44 89 c7 48 89 44 24 08 e8 44 ea ff ff 48
  Oct 29 08:26:23 hostname kernel: RSP: 002b:00007f386be913d0 EFLAGS: 00000293 
ORIG_RAX: 000000000000002e
  Oct 29 08:26:23 hostname kernel: RAX: ffffffffffffffda RBX: 0000000000000014 
RCX: 00007f3878c16607
  Oct 29 08:26:23 hostname kernel: RDX: 0000000000000000 RSI: 00007f386be91430 
RDI: 0000000000000014
  Oct 29 08:26:23 hostname kernel: RBP: 00007f386be91430 R08: 0000000000000000 
R09: 0000000000000000
  Oct 29 08:26:23 hostname kernel: R10: 00007f386be914bc R11: 0000000000000293 
R12: 0000000000000000
  Oct 29 08:26:23 hostname kernel: R13: 00007f386be91430 R14: 00007f38580d71d0 
R15: 0000000000000014
  Oct 29 08:26:23 hostname kernel: Modules linked in: nfnetlink_queue 
nfnetlink_log nfnetlink bluetooth ecdh_generic ip6table_raw ip6table_mangle 
iptable_raw xt_comment iptable_nat xt_CHECKSUM xt_tcpudp iptable_mangle veth 
vfio_pci vfio_virqfd vfio_iommu_type1 vfio br_netfilter bridge devlink 
ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter bpfilter 
openvswitch nsh nf_nat_ipv6 nf_nat_ipv4 nf_conncount nf_nat nf_conntrack 
nf_defrag_ipv6 nf_defrag_ipv4 iavf 8021q garp mrp stp llc bonding ipmi_ssif 
intel_rapl xfs nls_iso8859_1 nfit x86_pkg_temp_thermal intel_powerclamp 
coretemp kvm_intel kvm irqbypass intel_cstate intel_rapl_perf hpilo mei_me 
lpc_ich mei ioatdma ipmi_si dca ipmi_devintf acpi_tad ipmi_msghandler 
acpi_power_meter mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core 
iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi sunrpc ip_tables x_tables 
autofs4 btrfs zstd_compress raid10 raid456 async_raid6_recov async_memcpy 
async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0
  Oct 29 08:26:23 hostname kernel:  multipath linear bcache crc64 ses enclosure 
crct10dif_pclmul mgag200 crc32_pclmul i2c_algo_bit ghash_clmulni_intel ttm 
aesni_intel drm_kms_helper aes_x86_64 syscopyarea nvme sysfillrect crypto_simd 
smartpqi sysimgblt cryptd fb_sys_fops uas scsi_transport_sas glue_helper 
nvme_core drm i40e tg3 usb_storage wmi
  Oct 29 08:26:23 hostname kernel: ---[ end trace fdf63a9d9c7877f3 ]---
  Oct 29 08:26:23 hostname kernel: RIP: 0010:i40e_sync_vsi_filters+0xaa/0xca0 
[i40e]
  Oct 29 08:26:23 hostname kernel: Code: 00 00 00 48 89 85 78 ff ff ff 48 8b 83 
10 02 00 00 48 c1 e8 03 48 89 85 70 ff ff ff 83 e0 01 88 45 8b 48 8b 03 48 85 
c0 74 17 <8b> 80 38 02 00 00 8b b3 0c 02 00 00 31 c6 89 83 0c 02 00 00 89 75
  Oct 29 08:26:23 hostname kernel: RSP: 0018:ffffb91a77ac7708 EFLAGS: 00010286
  Oct 29 08:26:24 hostname kernel: RAX: 8287194a20ac1de7 RBX: ffff9c5594638000 
RCX: 0000000000000000
  Oct 29 08:26:24 hostname kernel: RDX: 0000000000000001 RSI: 00000000fffffe01 
RDI: ffff9c5594638000
  Oct 29 08:26:24 hostname kernel: RBP: ffffb91a77ac77b0 R08: 0000000000000000 
R09: 00000000000024f8
  Oct 29 08:26:24 hostname kernel: R10: 00000000000024f8 R11: 0000000000003e25 
R12: ffff9c57670e2580
  Oct 29 08:26:24 hostname kernel: R13: ffff9c5594638000 R14: ffff9c5763896000 
R15: ffff9c5594638a28
  Oct 29 08:26:24 hostname kernel: FS:  00007f386be92700(0000) 
GS:ffff9c077f800000(0000) knlGS:0000000000000000
  Oct 29 08:26:24 hostname kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 
0000000080050033
  Oct 29 08:26:24 hostname kernel: CR2: 00007f3851d53e17 CR3: 0000004d76f4e003 
CR4: 00000000007626e0
  Oct 29 08:26:24 hostname kernel: DR0: 0000000000000000 DR1: 0000000000000000 
DR2: 0000000000000000
  Oct 29 08:26:24 hostname kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 
DR7: 0000000000000400
  Oct 29 08:26:24 hostname kernel: PKRU: 55555554

  
  environment:
  OpenStack Queens on Ubuntu Bionic
  Description:  Ubuntu 18.04.3 LTS
  Release:      18.04
  Linux 5.0.0-32-generic #34~18.04.2-Ubuntu SMP Thu Oct 10 10:36:02 UTC 2019 
x86_64
  NIC: Intel X710 10GbE SFP+
  driver: i40e 2.7.6-k

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1850284/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to     : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp

Reply via email to