Check /var/log/dirsrv/slapd-EXAMPLE-COM/access for MOD and DEL operations. Also check /var/log/pki/pki-tomcat/ca/debug.YYYY-MM-DD.log for activity if you happen to be impacted by buggy certmonger client(s) that get stuck in a certificate renewal loop.
See https://lists.fedorahosted.org/archives/list/[email protected]/thread/RPP26VVE7OKAGHPRKMTLAHN2UOL653MC/ On Thu, 12 Dec 2024 10:14:36 -0500 "Brian J. Murrell via FreeIPA-users" <[email protected]> wrote: > Hi. > > I am running FreeIPA on (fully up-to-date) EL8 and am experiencing > really heavy constant writes to the (/var/lib/)dirsrv database disk: > > 12:00:01 AM tps rkB/s wkB/s dkB/s areq-sz aqu-sz > await %util DEV > > 01:00:01 AM 774.16 401.09 7371.63 0.00 10.04 0.78 > 1.01 39.59 var_lib_dirsrv > > 02:00:00 AM 511.07 0.14 4896.57 0.00 9.58 0.51 > 1.00 26.06 var_lib_dirsrv > > 03:00:00 AM 501.74 0.50 4807.00 0.00 9.58 0.50 > 1.00 25.54 var_lib_dirsrv > 04:00:00 AM 497.64 0.07 4771.83 0.00 9.59 0.50 > 1.00 25.43 var_lib_dirsrv > 05:00:00 AM 442.64 0.14 4241.13 0.00 9.58 0.44 > 0.98 22.34 var_lib_dirsrv > 06:00:00 AM 487.64 0.96 4676.10 0.00 9.59 0.48 > 0.99 24.92 var_lib_dirsrv > 07:00:00 AM 474.65 0.14 4558.98 0.00 9.61 0.48 > 1.00 24.32 var_lib_dirsrv > 08:00:00 AM 534.18 0.81 5137.36 0.00 9.62 0.54 > 1.01 27.59 var_lib_dirsrv > 09:00:00 AM 574.34 0.43 5537.93 0.00 9.64 0.58 > 1.00 29.52 var_lib_dirsrv > 10:00:00 AM 672.95 0.43 6501.68 0.00 9.66 0.67 > 0.99 34.12 var_lib_dirsrv > 11:00:00 AM 749.18 0.82 7250.97 0.00 9.68 0.75 > 1.00 38.38 var_lib_dirsrv > 12:00:00 PM 958.57 1.05 9296.95 0.00 9.70 0.95 > 0.99 48.60 var_lib_dirsrv > 01:00:00 PM 1003.80 0.80 9743.29 0.00 9.71 0.99 > 0.99 51.09 var_lib_dirsrv > 02:00:01 PM 567.52 1.34 5508.37 0.00 9.71 0.57 > 1.01 29.40 var_lib_dirsrv > 03:00:01 PM 514.13 0.16 5006.66 0.00 9.74 0.52 > 1.01 26.71 var_lib_dirsrv > 04:00:00 PM 515.12 0.34 5025.29 0.00 9.76 0.51 > 1.00 26.49 var_lib_dirsrv > 05:00:01 PM 514.74 0.03 5034.02 0.00 9.78 0.52 > 1.00 26.56 var_lib_dirsrv > 06:00:01 PM 490.61 0.04 4809.68 0.00 9.80 0.49 > 1.00 25.29 var_lib_dirsrv > 07:00:00 PM 513.17 0.02 5034.52 0.00 9.81 0.52 > 1.00 26.81 var_lib_dirsrv > 08:00:00 PM 506.14 0.00 4964.79 0.00 9.81 0.50 > 1.00 25.99 var_lib_dirsrv > 09:00:01 PM 503.88 0.05 4943.89 0.00 9.81 0.50 > 1.00 25.89 var_lib_dirsrv > > 10:00:01 PM 509.54 0.02 5004.35 0.00 9.82 0.51 > 1.00 26.35 var_lib_dirsrv > > 11:00:01 PM 498.23 0.02 4893.29 0.00 9.82 0.50 > 1.00 25.78 var_lib_dirsrv > > Average: 578.94 17.80 5609.40 0.00 9.72 0.58 > 1.00 29.68 var_lib_dirsrv > > > As you can see it's a pretty constant 5MB/s write bandwidth. That disk > is just the database, no log files, etc. The files most frequently > being written to are: > > -rw-------. 1 dirsrv dirsrv 37347328 Dec 12 09:54 > /var/lib/dirsrv/slapd-EXAMPLE-COM/db/userRoot/id2entry.db > -rw-------. 1 dirsrv dirsrv 2744320 Dec 12 09:54 > /var/lib/dirsrv/slapd-EXAMPLE-COM/db/userRoot/entryusn.db > -rw-------. 1 dirsrv dirsrv 2646016 Dec 12 09:54 > /var/lib/dirsrv/slapd-EXAMPLE-COM/db/ipaca/id2entry.db > -rw-------. 1 dirsrv dirsrv 16384 Dec 12 09:54 > /var/lib/dirsrv/slapd-EXAMPLE-COM/db/ipaca/entryusn.db > -rw-------. 1 dirsrv dirsrv 1109262336 Dec 12 09:54 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 14745600 Dec 12 09:54 > /var/lib/dirsrv/slapd-EXAMPLE-COM/db/__db.001 > -rw-------. 1 dirsrv dirsrv 104949064 Dec 12 09:54 > /var/lib/dirsrv/slapd-EXAMPLE-COM/db/__db.003 > -rw-------. 1 dirsrv dirsrv 10485760 Dec 12 09:54 > /var/lib/dirsrv/slapd-EXAMPLE-COM/db/log.0000005162 > -rw-------. 1 dirsrv dirsrv 57999360 Dec 12 09:54 > /var/lib/dirsrv/slapd-EXAMPLE-COM/db/__db.002 > > And the main database files themselves have just continually grown over > time: > > -rw-------. 1 dirsrv dirsrv 121634816 Aug 27 2022 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 144097280 Nov 3 2022 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 166150144 Dec 3 2022 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 174202880 Dec 17 2022 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 187965440 Jan 20 2023 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 202571776 Feb 17 2023 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 247570432 May 12 2023 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 262955008 Jun 10 2023 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 279224320 Jul 8 2023 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 293167104 Aug 5 2023 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 304029696 Aug 26 2023 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 318144512 Sep 30 2023 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 337469440 Nov 4 2023 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 364732416 Dec 8 2023 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 396328960 Jan 12 2024 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 410517504 Feb 8 2024 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 418586624 Feb 22 2024 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 456179712 Mar 15 2024 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 485425152 Apr 7 2024 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 562569216 May 28 2024 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 612147200 Aug 18 02:42 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 639762432 Aug 31 01:53 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 662282240 Sep 6 01:51 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 695541760 Sep 14 04:18 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 715882496 Sep 21 02:33 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 731496448 Sep 28 02:10 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 761552896 Oct 13 02:18 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 778076160 Oct 20 01:18 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 794820608 Oct 27 01:46 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 809304064 Nov 2 03:36 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 822583296 Nov 7 08:36 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 844079104 Nov 10 01:21 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 848076800 Nov 11 01:40 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 857710592 Nov 12 01:53 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 867352576 Nov 13 01:58 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 876568576 Nov 14 01:11 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 888070144 Nov 15 03:31 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 898465792 Nov 16 04:08 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 907616256 Nov 17 02:07 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 916480000 Nov 18 01:46 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 926220288 Nov 19 01:50 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 935952384 Nov 20 01:38 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 945872896 Nov 21 01:44 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 955441152 Nov 22 01:31 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 963747840 Nov 23 01:59 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 972324864 Nov 24 01:27 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 980189184 Nov 25 00:57 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 988086272 Nov 26 00:58 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 995680256 Nov 27 01:26 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 1003315200 Nov 28 01:25 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 1010884608 Nov 29 01:53 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 1021444096 Nov 30 01:47 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 1027997696 Dec 1 01:58 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 1036558336 Dec 2 02:10 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 1068269568 Dec 6 03:23 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 1073307648 Dec 7 01:33 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 1082449920 Dec 8 11:02 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 1088061440 Dec 9 09:06 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 1092091904 Dec 10 01:01 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 1098244096 Dec 11 00:50 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > -rw-------. 1 dirsrv dirsrv 1105944576 Dec 12 00:44 > /var/lib/dirsrv/slapd-EXAMPLE-COM/cldb/1e5e4f8c-82ed11ec-88b1dfba-ae19c7b5_61e5b9dd000000040000.db > > Should the directory server really need to sustain 5MB/s of write 24/7? > > Should the database file(s) have this kind of constant growth model or > is there some pruning that should be getting done? > > Could these two issues be related? > > Cheers, > b. >
pgpCcO2Cy5d1V.pgp
Description: OpenPGP digital signature
-- _______________________________________________ FreeIPA-users mailing list -- [email protected] To unsubscribe send an email to [email protected] Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedorahosted.org/archives/list/[email protected] Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
