Hi Daniel,
On Fri, 24 Feb 2023, Daniel Baumann wrote:
Can you rule out that you were hit by the "interface names
changed"-problem (here, enp* changed to ens*)? Between 5.x and 6.x this
cought us a couple of times by surprise too..
yes, the enp*/ens* interfaces are handled by driver igc.
They are "normal" 1 Gigabit interfaces and are working fine, independent
of the kernel version.
The problem is related to the 10GB interfaces that are handled by module
ixgbe. They are called eno*.
The first log shows the not working kernel 6.x and the second part shows
the working kernel 5.x. "ip a" shows in the first case "no-carrier" and
all LEDs of that interface remain off.
Thorsten
root@tor-tc:~# uname -a
Linux tor-tc 6.1.0-3-rt-amd64 #1 SMP PREEMPT_RT Debian 6.1.8-1 (2023-01-29)
x86_64 GNU/Linux
[ 1.742034] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver
[ 1.742039] ixgbe: Copyright (c) 1999-2016 Intel Corporation.
[ 2.390796] ixgbe 0000:0a:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx
Queue count = 8 XDP Queue count = 0
[ 2.525760] ixgbe 0000:0a:00.0: MAC: 6, PHY: 0, PBA No: 000700-000
[ 2.525766] ixgbe 0000:0a:00.0: 00:f0:cb:ee:aa:49
[ 2.793547] ixgbe 0000:0a:00.0: Intel(R) 10 Gigabit Network Connection
[ 3.194989] ixgbe 0000:0a:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx
Queue count = 8 XDP Queue count = 0
[ 3.324206] ixgbe 0000:0a:00.1: MAC: 6, PHY: 17, SFP+: 6, PBA No: 000700-000
[ 3.324211] ixgbe 0000:0a:00.1: 00:f0:cb:ee:aa:4a
[ 3.458876] ixgbe 0000:0a:00.1: Intel(R) 10 Gigabit Network Connection
[ 4.108945] ixgbe 0000:0b:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx
Queue count = 8 XDP Queue count = 0
[ 4.238135] ixgbe 0000:0b:00.0: MAC: 6, PHY: 0, PBA No: 000700-000
[ 4.238140] ixgbe 0000:0b:00.0: 00:f0:cb:ee:aa:4b
[ 4.505385] ixgbe 0000:0b:00.0: Intel(R) 10 Gigabit Network Connection
[ 4.909029] ixgbe 0000:0b:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx
Queue count = 8 XDP Queue count = 0
[ 5.038230] ixgbe 0000:0b:00.1: MAC: 6, PHY: 17, SFP+: 6, PBA No: 000700-000
[ 5.038235] ixgbe 0000:0b:00.1: 00:f0:cb:ee:aa:4c
[ 5.172833] ixgbe 0000:0b:00.1: Intel(R) 10 Gigabit Network Connection
[ 5.175251] ixgbe 0000:0a:00.1 eno2: renamed from eth1
[ 5.219307] ixgbe 0000:0a:00.0 eno1: renamed from eth0
[ 5.243600] ixgbe 0000:0b:00.1 eno4: renamed from eth3
[ 5.263641] ixgbe 0000:0b:00.0 eno3: renamed from eth2
[ 7.714775] ixgbe 0000:0a:00.1: registered PHC device on eno2
[ 7.787883] ixgbe 0000:0b:00.1: registered PHC device on eno4
[ 7.821476] ixgbe 0000:0a:00.1 eno2: detected SFP+: 6
[ 8.851220] ixgbe 0000:0b:00.1 eno4: detected SFP+: 6
root@tor-tc:~# uname -a
Linux tor-tc 5.19.0-2-amd64 #1 SMP PREEMPT_DYNAMIC Debian 5.19.11-1
(2022-09-24) x86_64 GNU/Linux
[ 1.565523] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver
[ 1.565531] ixgbe: Copyright (c) 1999-2016 Intel Corporation.
[ 2.209787] ixgbe 0000:0a:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx
Queue count = 8 XDP Queue count = 0
[ 2.337322] ixgbe 0000:0a:00.0: MAC: 6, PHY: 0, PBA No: 000700-000
[ 2.337327] ixgbe 0000:0a:00.0: 00:f0:cb:ee:aa:49
[ 2.606593] ixgbe 0000:0a:00.0: Intel(R) 10 Gigabit Network Connection
[ 3.001721] ixgbe 0000:0a:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx
Queue count = 8 XDP Queue count = 0
[ 3.131202] ixgbe 0000:0a:00.1: MAC: 6, PHY: 17, SFP+: 6, PBA No: 000700-000
[ 3.131207] ixgbe 0000:0a:00.1: 00:f0:cb:ee:aa:4a
[ 3.264814] ixgbe 0000:0a:00.1: Intel(R) 10 Gigabit Network Connection
[ 3.909727] ixgbe 0000:0b:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx
Queue count = 8 XDP Queue count = 0
[ 4.039202] ixgbe 0000:0b:00.0: MAC: 6, PHY: 0, PBA No: 000700-000
[ 4.039207] ixgbe 0000:0b:00.0: 00:f0:cb:ee:aa:4b
[ 4.306556] ixgbe 0000:0b:00.0: Intel(R) 10 Gigabit Network Connection
[ 4.705443] ixgbe 0000:0b:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx
Queue count = 8 XDP Queue count = 0
[ 4.833320] ixgbe 0000:0b:00.1: MAC: 6, PHY: 17, SFP+: 6, PBA No: 000700-000
[ 4.833325] ixgbe 0000:0b:00.1: 00:f0:cb:ee:aa:4c
[ 4.966519] ixgbe 0000:0b:00.1: Intel(R) 10 Gigabit Network Connection
[ 4.968319] ixgbe 0000:0a:00.1 eno2: renamed from eth1
[ 4.968319] ixgbe 0000:0a:00.1 eno2: renamed from eth1
[ 4.981671] ixgbe 0000:0b:00.1 eno4: renamed from eth3
[ 5.017351] ixgbe 0000:0b:00.0 eno3: renamed from eth2
[ 5.033434] ixgbe 0000:0a:00.0 eno1: renamed from eth0
[ 7.492177] ixgbe 0000:0a:00.1: registered PHC device on eno2
[ 7.595273] ixgbe 0000:0a:00.1 eno2: detected SFP+: 6
[ 7.604203] ixgbe 0000:0b:00.1: registered PHC device on eno4
[ 8.241189] ixgbe 0000:0a:00.1 eno2: NIC Link is Up 10 Gbps, Flow Control:
RX/TX
[ 8.343194] ixgbe 0000:0b:00.1 eno4: detected SFP+: 6
[ 8.997172] ixgbe 0000:0b:00.1 eno4: NIC Link is Up 10 Gbps, Flow Control:
RX/TX
