After a reboot with the configuration from the test case on Mellanox CX6, the system comes up in a half broken state (not all VFs created, "legacy" eswitch mode, LAG disabled):
ubuntu@romano:~$ sudo lshw -c network -businfo Bus info Device Class Description ============================================================ pci@0000:21:00.0 ens13f0np0 network BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller pci@0000:21:00.1 ens13f1np1 network BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller pci@0000:61:00.0 ens7f0 network MT2892 Family [ConnectX-6 Dx] pci@0000:61:00.1 ens7f1 network MT2892 Family [ConnectX-6 Dx] pci@0000:61:00.2 ens7f0v0 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:00.3 ens7f0v1 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:00.4 ens7f0v2 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:00.5 ens7f0v3 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:00.6 ens7f0v4 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:00.7 ens7f0v5 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:01.0 ens7f0v6 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:01.1 ens7f0v7 network ConnectX Family mlx5Gen Virtual Function ubuntu@romano:~$ sudo devlink dev eswitch show pci/0000:61:00.0 pci/0000:61:00.0: mode legacy inline-mode none encap-mode basic ubuntu@romano:~$ sudo devlink dev eswitch show pci/0000:61:00.1 pci/0000:61:00.1: mode legacy inline-mode none encap-mode basic ubuntu@romano:~$ sudo cat /sys/kernel/debug/mlx5/0000:61:00.0/lag/state disabled ubuntu@romano:~$ sudo cat /sys/kernel/debug/mlx5/0000:61:00.1/lag/state disabled Interestingly, after running "netplan apply" after the reboot, the system seems to transition into the desired state: ubuntu@romano:~$ sudo netplan apply [] Cannot find unique matching interface for ens7f0 [] Cannot find unique matching interface for ens7f1 ubuntu@romano:~$ sudo lshw -c network -businfo Bus info Device Class Description ============================================================ pci@0000:21:00.0 ens13f0np0 network BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller pci@0000:21:00.1 ens13f1np1 network BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller pci@0000:61:00.0 ens7f0 network MT2892 Family [ConnectX-6 Dx] pci@0000:61:00.1 ens7f1 network MT2892 Family [ConnectX-6 Dx] pci@0000:61:00.2 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:00.3 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:00.4 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:00.5 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:00.6 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:00.7 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:01.0 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:01.1 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:01.2 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:01.3 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:01.4 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:01.5 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:01.6 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:01.7 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:02.0 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:02.1 network ConnectX Family mlx5Gen Virtual Function pci@0000:61:00.0 ens7f0npf0vf0 network Ethernet interface pci@0000:61:00.0 ens7f0npf0vf1 network Ethernet interface pci@0000:61:00.0 ens7f0npf0vf2 network Ethernet interface pci@0000:61:00.0 ens7f0npf0vf3 network Ethernet interface pci@0000:61:00.0 ens7f0npf0vf4 network Ethernet interface pci@0000:61:00.0 ens7f0npf0vf5 network Ethernet interface pci@0000:61:00.0 ens7f0npf0vf6 network Ethernet interface pci@0000:61:00.0 ens7f0npf0vf7 network Ethernet interface pci@0000:61:00.1 ens7f1npf1vf0 network Ethernet interface pci@0000:61:00.1 ens7f1npf1vf1 network Ethernet interface pci@0000:61:00.1 ens7f1npf1vf2 network Ethernet interface pci@0000:61:00.1 ens7f1npf1vf3 network Ethernet interface pci@0000:61:00.1 ens7f1npf1vf4 network Ethernet interface pci@0000:61:00.1 ens7f1npf1vf5 network Ethernet interface pci@0000:61:00.1 ens7f1npf1vf6 network Ethernet interface pci@0000:61:00.1 ens7f1npf1vf7 network Ethernet interface ubuntu@romano:~$ sudo devlink dev eswitch show pci/0000:61:00.1 pci/0000:61:00.1: mode switchdev inline-mode none encap-mode basic ubuntu@romano:~$ sudo devlink dev eswitch show pci/0000:61:00.0 pci/0000:61:00.0: mode switchdev inline-mode none encap-mode basic ubuntu@romano:~$ sudo cat /sys/kernel/debug/mlx5/0000:61:00.1/lag/state active ubuntu@romano:~$ sudo cat /sys/kernel/debug/mlx5/0000:61:00.0/lag/state active This isn't quite as it should be, but might be an easy workaround for Mellanox CX6.. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1988018 Title: [SRU][mlx5] Intermittent VF-LAG activation failure To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1988018/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
