Public bug reported:
Summary:
========
Customer is reporting performance degradation from Bluefield Focal 5.4.0-1087
to 5.4.0-1088
They run iperf3 based performance test, and see performance drop around 10-15%.
Test scenarios:
===============
1. Baseline: BF - BFB 3.9.8 (OFED Driver 5.8, FW 35.4030) and CX6 HOST (Driver
5.8, FW 35.4030)
2. Promote HOST driver: BF - BFB 3.9.8, CX6 HOST (Driver 23.10, FW 39.3560)
3. Promote ARM driver: BF - BFB 3.9.8 + Driver 23.10, FW 39.3560, CX6 HOST
(Driver 5.8, FW 35.4030)
4. Promote ARM BFB: BF - BFB 4.5.2 (Driver 23.10, FW 39.3560, kernel
5.4.0-1088,...), CX6 HOST (Driver 5.8, FW 35.4040)
We observed similar results (no degradation) when changing only Driver
and FW (comparing scenarios 2 & 3 to 1).
We observed degradation when changing BFB completely (3.9.8->4.5.2)
while HOST side is the same (same as baseline)
Performance Result
==================
BlueField-2 is sender
MTU SIZE SPP Mean MAX MIN STD Diff from Baseline
1500 256K 1 20.001 23.63 19.17 5% -13%
1500 256K 2 32.22033 34.95 30.7 3% -12%
1500 256K 4 52.894 54.88 49.42 3% -10%
1500 128K 1 21.15533 25.2 19.96 6% -13%
1500 128K 2 33.82267 37.09 31.27 4% -12%
1500 128K 4 59.529 62.88 57.15 2% -9%
1500 8K 1 11.98933 15.41 7.87 14% -13%
1500 8K 2 21.97667 25.75 20.07 6% -12%
1500 8K 4 40.46467 44.96 34.71 5% -13%
BlueField-2 is receiver
MTU SIZE SPP
1500 256K 1 8.912667 10.1 7.95 8% -1%
1500 256K 2 14.89267 15.25 14.41 1% -5%
1500 256K 4 18.56533 18.83 18.2 1% -15%
1500 128K 1 8.129 8.35 7.94 1% -16%
1500 128K 2 14.23333 14.46 14.03 1% -10%
1500 128K 4 20.65133 20.88 20.42 1% -5%
1500 8K 1 6.434667 6.9 5.86 4% -4%
1500 8K 2 11.399 12.13 10.21 4% -4%
1500 8K 4 18.35033 19.01 17.57 2% -3%
Solutions
=========
trying to bisect between the two (1087 and 1088)
Feng Liu is leading the efforts
** Affects: linux-bluefield (Ubuntu)
Importance: Undecided
Status: New
** Summary changed:
- Performance degradation from 3.9.8 to 4.5.2
+ Performance degradation from Focal kernel 5.4.0-1087 to 5.4.0-1088
--
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux-bluefield in Ubuntu.
https://bugs.launchpad.net/bugs/2091053
Title:
Performance degradation from Focal kernel 5.4.0-1087 to 5.4.0-1088
Status in linux-bluefield package in Ubuntu:
New
Bug description:
Summary:
========
Customer is reporting performance degradation from Bluefield Focal 5.4.0-1087
to 5.4.0-1088
They run iperf3 based performance test, and see performance drop around
10-15%.
Test scenarios:
===============
1. Baseline: BF - BFB 3.9.8 (OFED Driver 5.8, FW 35.4030) and CX6 HOST
(Driver 5.8, FW 35.4030)
2. Promote HOST driver: BF - BFB 3.9.8, CX6 HOST (Driver 23.10, FW 39.3560)
3. Promote ARM driver: BF - BFB 3.9.8 + Driver 23.10, FW 39.3560, CX6 HOST
(Driver 5.8, FW 35.4030)
4. Promote ARM BFB: BF - BFB 4.5.2 (Driver 23.10, FW 39.3560, kernel
5.4.0-1088,...), CX6 HOST (Driver 5.8, FW 35.4040)
We observed similar results (no degradation) when changing only Driver
and FW (comparing scenarios 2 & 3 to 1).
We observed degradation when changing BFB completely (3.9.8->4.5.2)
while HOST side is the same (same as baseline)
Performance Result
==================
BlueField-2 is sender
MTU SIZE SPP Mean MAX MIN STD Diff from Baseline
1500 256K 1 20.001 23.63 19.17 5% -13%
1500 256K 2 32.22033 34.95 30.7 3% -12%
1500 256K 4 52.894 54.88 49.42 3% -10%
1500 128K 1 21.15533 25.2 19.96 6% -13%
1500 128K 2 33.82267 37.09 31.27 4% -12%
1500 128K 4 59.529 62.88 57.15 2% -9%
1500 8K 1 11.98933 15.41 7.87 14% -13%
1500 8K 2 21.97667 25.75 20.07 6% -12%
1500 8K 4 40.46467 44.96 34.71 5% -13%
BlueField-2 is receiver
MTU SIZE SPP
1500 256K 1 8.912667 10.1 7.95 8% -1%
1500 256K 2 14.89267 15.25 14.41 1% -5%
1500 256K 4 18.56533 18.83 18.2 1% -15%
1500 128K 1 8.129 8.35 7.94 1% -16%
1500 128K 2 14.23333 14.46 14.03 1% -10%
1500 128K 4 20.65133 20.88 20.42 1% -5%
1500 8K 1 6.434667 6.9 5.86 4% -4%
1500 8K 2 11.399 12.13 10.21 4% -4%
1500 8K 4 18.35033 19.01 17.57 2% -3%
Solutions
=========
trying to bisect between the two (1087 and 1088)
Feng Liu is leading the efforts
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux-bluefield/+bug/2091053/+subscriptions
--
Mailing list: https://launchpad.net/~kernel-packages
Post to : [email protected]
Unsubscribe : https://launchpad.net/~kernel-packages
More help : https://help.launchpad.net/ListHelp
