I'm also seeing a lot of these msgs on s390x still with kinetic, when
server certification runs are done:

Oct 31 11:33:57 s1lp10 kernel: [592067.859684] request_module: 
kmod_concurrent_max (0) close to 0 (max_modprobes: 50), for module 
crypto-rmd320, throttling...
Oct 31 11:33:57 s1lp10 kernel: [592067.872844] request_module: 
kmod_concurrent_max (0) close to 0 (max_modprobes: 50), for module 
crypto-rmd128, throttling...
Oct 31 11:33:57 s1lp10 kernel: [592067.883019] request_module: 
kmod_concurrent_max (0) close to 0 (max_modprobes: 50), for module 
crypto-rmd128, throttling...
Oct 31 11:33:57 s1lp10 kernel: [592068.050389] request_module: 
kmod_concurrent_max (0) close to 0 (max_modprobes: 50), for module 
crypto-aegis128l, throttling...
Oct 31 11:33:57 s1lp10 kernel: [592068.103120] request_module: 
kmod_concurrent_max (0) close to 0 (max_modprobes: 50), for module 
crypto-rmd128, throttling...
Oct 31 11:33:57 s1lp10 kernel: [592068.104379] request_module: 
kmod_concurrent_max (0) close to 0 (max_modprobes: 50), for module 
crypto-rmd128, throttling...
Oct 31 11:33:57 s1lp10 kernel: [592068.105161] request_module: 
kmod_concurrent_max (0) close to 0 (max_modprobes: 50), for module 
crypto-rmd128, throttling...
Oct 31 11:33:57 s1lp10 kernel: [592068.105896] request_module: 
kmod_concurrent_max (0) close to 0 (max_modprobes: 50), for module 
crypto-rmd128, throttling...
Oct 31 11:33:57 s1lp10 kernel: [592068.297550] request_module: 
kmod_concurrent_max (0) close to 0 (max_modprobes: 50), for module 
crypto-rmd128, throttling...
Oct 31 11:33:58 s1lp10 kernel: [592068.305050] request_module: 
kmod_concurrent_max (0) close to 0 (max_modprobes: 50), for module 
crypto-rmd128, throttling...
Oct 31 11:34:13 s1lp10 kernel: [592069.189683] request_module: modprobe 
crypto-rmd128 cannot be processed, kmod busy with 50 threads for more than 5 
seconds now
Oct 31 11:34:13 s1lp10 kernel: [592083.809924] __request_module: 266 callbacks 
suppressed

(s390x has a lot of add. crypto modules)

Or:

stress-ng: info:  [2822111] defaulting to a 86400 second (1 day, 0.00 secs) run 
per stressor
stress-ng: info:  [2822111] dispatching hogs: 282 af-alg
stress-ng: info:  [2822112] stress-ng-af-alg: 90 cryptographic algorithms found 
in /proc/crypto
stress-ng: info:  [2822112] stress-ng-af-alg: 113 cryptographic algorithms in 
total (with defconfigs)
stress-ng: info:  [2822111] successful run completed in 23.38s
[594523.200917] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-tgr160, throttling...
[758066.621778] __request_module: 483 callbacks suppressed
[758066.621782] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-blowfish, throttling...
[758066.621801] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-blowfish, throttling...
[758066.622950] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-blowfish, throttling...
[758066.622970] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-blowfish, throttling...
[758066.623279] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-aegis128l, throttling...
[758066.750379] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-rsa, throttling...
[758066.769680] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-sm4, throttling...
[758066.769694] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-sm4, throttling...
[758066.769706] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-sm4, throttling...
[758066.769717] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-sm4, throttling...
[758073.883098] __request_module: 208 callbacks suppressed
[758073.883104] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-aegis128l, throttling...
[758073.883122] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-aegis128l, throttling...
[758073.883133] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-aegis128l, throttling...
[758073.883411] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-aegis128l, throttling...
[758073.883584] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-aegis128l, throttling...
[758073.883596] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-aegis128l, throttling...
[758073.883609] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-aegis128l, throttling...
[758073.885190] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-aegis128l, throttling...
[758073.885405] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-aegis128l, throttling...
[758073.885546] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-aegis128l, throttling...
[758082.651065] __request_module: 2226 callbacks suppressed
[758082.651072] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-rmd256, throttling...
[758082.651123] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-rmd256, throttling...
[758082.652433] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-rmd256, throttling...
[758082.655814] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-rmd256, throttling...
[758082.657548] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-rmd128, throttling...
[758082.658510] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-rmd128, throttling...
[758082.659684] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-serpent, throttling...
[758082.659703] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-serpent, throttling...
[758082.659780] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-des, throttling...

The stress-ng version that's used is from kinetic universe (and not the one 
from the checkbox-dev ppa.
$  apt-cache policy stress-ng
stress-ng:
  Installed: 0.14.06-1
  Candidate: 0.14.06-1
  Version table:
 *** 0.14.06-1 500
        500 http://ports.ubuntu.com/ubuntu-ports kinetic/universe s390x Packages
        100 /var/lib/dpkg/status
     0.14.06-0~202210311420~ubuntu22.10.1 500
        500 https://ppa.launchpadcontent.net/checkbox-dev/ppa/ubuntu 
kinetic/main s390x Packages
I believe that even if the above commit is in (which I guess is not the case 
yet, since I couldn't find it), whould not be sufficient due to add. set of 
modules.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1813847

Title:
  af-alg stressor triggers modprobe throttling

Status in Stress-ng:
  Fix Released
Status in linux package in Ubuntu:
  Incomplete

Bug description:
  Due to the combination of high core counts and perhaps a lack of
  available hash/crypto hardware acceleration drivers, arm64 server
  platforms generate a lot of noisy modprobe throttling messages when
  running the af-alg stressor. This appears to be partially mitigated in
  master by disabling hashes/ciphers once they are found to be not
  present. But, w/ 96 cores/hogs, we presumably still hit the kernel
  with 96 * (nr_hashes + nr_ciphers) before that mitigation takes
  effect, and that is sufficient to cause the kernel to emit throttling
  messages.

  
  $ sudo dmesg -c > /dev/null ; ./stress-ng --af-alg 0 --af-alg-ops=200000; 
sudo dmesg -c
  stress-ng: info:  [76141] defaulting to a 86400 second (1 day, 0.00 secs) run 
per stressor
  stress-ng: info:  [76141] dispatching hogs: 96 af-alg
  stress-ng: info:  [76141] successful run completed in 0.40s
  [ 5808.489046] __request_module: 25 callbacks suppressed
  [ 5808.489050] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-ghash, throttling...
  [ 5808.489503] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-ghash, throttling...
  [ 5808.489724] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-ghash, throttling...
  [ 5808.489731] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-ghash, throttling...
  [ 5808.490092] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-xor-all, throttling...
  [ 5808.490235] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-ghash-all, throttling...
  [ 5808.490308] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-ghash, throttling...
  [ 5808.490367] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-ghash, throttling...
  [ 5808.490597] request_module: kmod_concurrent_max (0) close to 0 
(max_modprobes: 50), for module crypto-ghash, throttling...

To manage notifications about this bug go to:
https://bugs.launchpad.net/stress-ng/+bug/1813847/+subscriptions


-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to     : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp

Reply via email to