Hi Quanah,
thanks for the feedback.
So, as you can see in the logs, i reduced the scope for replication to a single
group to see more clearly what is happening.
The behaviour which a really dont`t get:
1. After the initial sync is done for the single usergroup, the Provider is
restarted.
2. The provider wants to check the Status of elements (CSN,UUID,et)
3. The provider *can see* the UUIDs of the Elements within the group, which was
configured for replication via filter scope.
4. Until this point i think this is the expected behavior
5. But now the provider continues to check *all* other entries for the UUID on
rid=44, which are *not* part of the replication config
6. For all other entries (for sure) there is no correct UUID and the entries
are added to the non-present list and finally deleted
7. I assume that the deletion in step 6 also includes then the deletion of the
configured and first properly synced group and the replication user, etc
Do you think my observations are correct and do you have an additional hint
where to go ?
Is it a question of the correct syncrepl config ?
BR&thanks,
michael
Here the additional logs which shows the described behaviour:
[root@xxxxxxxv01 ~]# /usr/sbin/slapd -u ldap -h "ldap:/// ldaps:/// ldapi:///"
-d Sync
[695/6895]
6548fcee.2ccc4a2f 0x7f69dac0d840 @(#) $OpenLDAP: slapd 2.6.2 (Sep 21 2022
00:00:00) $
openldap
6548fcee.2e097ebb 0x7f69dac0d840 syncprov_db_open: starting syncprov for suffix
dc=xxx,dc=xxx,dc=xxx
6548fcee.2e0a1613 0x7f69dac0d840 slapd starting
6548fcee.300cc09f 0x7f69ca9fe640 do_syncrep1: rid=044 starting refresh (sending
cookie=rid=044,sid=000,csn=20231106144450.454190Z#000000#000#000000;20231106143057.977465Z#000000#007#000000)
6548fcee.304fb117 0x7f69ca9fe640 do_syncrep2: rid=044 LDAP_RES_xxxERMEDIATE -
SYNC_ID_SET
6548fcee.30517b94 0x7f69ca9fe640 syncrepl_message_to_entry: rid=044 DN:
cn=xxx-adm,ou=xxxxxxUserGroups,ou=groups,dc=xxx,dc=xxx,dc=xxx, UUID:
259d9584-0364-103e-839c-fb52f2a7ef64
6548fcee.30555d96 0x7f69ca9fe640 syncrepl_entry: rid=044
LDAP_RES_SEARCH_ENTRY(LDAP_SYNC_ADD) csn=(none) tid 0x7f69ca9fe640
6548fcee.305f79c6 0x7f69ca9fe640 syncrepl_entry: rid=044 be_search (0)
6548fcee.305fe834 0x7f69ca9fe640 syncrepl_entry: rid=044
cn=xxx-adm,ou=xxxxxxUserGroups,ou=groups,dc=xxx,dc=xxx,dc=xxx
6548fcee.306052e1 0x7f69ca9fe640 conn=-1 op=0 syncprov_matchops: recording uuid
for dn=cn=xxx-adm,ou=xxxxxxUserGroups,ou=groups,dc=xxx,dc=xxx,dc=xxx on
opc=0x7f69bc0017f0
6548fcee.3079b8f9 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: adding
csn=20231106144914.714573Z#000000#007#000000 to sessionlog,
uuid=259d9584-0364-103e-839c-fb52f2a7ef64
6548fcee.307a8953 0x7f69ca9fe640 syncrepl_entry: rid=044 be_modify
cn=xxx-adm,ou=xxxxxxUserGroups,ou=groups,dc=xxx,dc=xxx,dc=xxx (0)
6548fcee.307bfc41 0x7f69ca9fe640 do_syncrep2: rid=044 LDAP_RES_xxxERMEDIATE -
REFRESH_PRESENT
6548fcee.307c5218 0x7f69ca9fe640 do_syncrep2: rid=044
cookie=rid=044,sid=007,csn=20231106144450.454190Z#000000#000#000000;20231106144914.714573Z#000000#007#000000
6548fcee.307e1c30 0x7f69ca9fe640 nonpresent_callback: rid=044 nonpresent UUID
259c6bb4-0364-103e-8397-fb52f2a7ef64, dn dc=xxx,dc=xxx,dc=xxx
6548fcee.307e7390 0x7f69ca9fe640 nonpresent_callback: rid=044 adding entry
dc=xxx,dc=xxx,dc=xxx to non-present list
6548fcee.307ea801 0x7f69ca9fe640 nonpresent_callback: rid=044 nonpresent UUID
259cce74-0364-103e-8398-fb52f2a7ef64, dn ou=groups,dc=xxx,dc=xxx,dc=xxx
6548fcee.307ef198 0x7f69ca9fe640 nonpresent_callback: rid=044 adding entry
ou=groups,dc=xxx,dc=xxx,dc=xxx to non-present list
6548fcee.307f20c8 0x7f69ca9fe640 nonpresent_callback: rid=044 nonpresent UUID
259d0650-0364-103e-8399-fb52f2a7ef64, dn
ou=xxxxxxUserGroups,ou=groups,dc=xxx,dc=xxx,dc=xxx
6548fcee.307f6a47 0x7f69ca9fe640 nonpresent_callback: rid=044 adding entry
ou=xxxxxxUserGroups,ou=groups,dc=xxx,dc=xxx,dc=xxx to non-present list
6548fcee.307f99a1 0x7f69ca9fe640 nonpresent_callback: rid=044 present UUID
259d347c-0364-103e-839a-fb52f2a7ef64, dn
cn=xxx-usr,ou=xxxxxxUserGroups,ou=groups,dc=xxx,dc=xxx,dc=xxx
6548fcee.30801aae 0x7f69ca9fe640 nonpresent_callback: rid=044 present UUID
259d67e4-0364-103e-839b-fb52f2a7ef64, dn
cn=xxx-op,ou=xxxxxxUserGroups,ou=groups,dc=xxx,dc=xxx,dc=xxx
6548fcee.308079ff 0x7f69ca9fe640 nonpresent_callback: rid=044 present UUID
259d9584-0364-103e-839c-fb52f2a7ef64, dn
cn=xxx-adm,ou=xxxxxxUserGroups,ou=groups,dc=xxx,dc=xxx,dc=xxx
6548fcee.3080ed51 0x7f69ca9fe640 nonpresent_callback: rid=044 present UUID
259dc72a-0364-103e-839d-fb52f2a7ef64, dn
cn=xxx-mtnce,ou=xxxxxxUserGroups,ou=groups,dc=xxx,dc=xxx,dc=xxx
6548fcee.30814bc6 0x7f69ca9fe640 nonpresent_callback: rid=044 present UUID
259df452-0364-103e-839e-fb52f2a7ef64, dn
cn=xxx-itsec,ou=xxxxxxUserGroups,ou=groups,dc=xxx,dc=xxx,dc=xxx
6548fcee.3081a443 0x7f69ca9fe640 nonpresent_callback: rid=044 present UUID
259e1e64-0364-103e-839f-fb52f2a7ef64, dn
cn=xxx-trainer,ou=xxxxxxUserGroups,ou=groups,dc=xxx,dc=xxx,dc=xxx
6548fcee.3081f975 0x7f69ca9fe640 nonpresent_callback: rid=044 nonpresent UUID
259e4bfa-0364-103e-83a0-fb52f2a7ef64, dn
ou=xxxernal,ou=groups,dc=xxx,dc=xxx,dc=xxx
6548fcee.30821262 0x7f69ca9fe640 nonpresent_callback: rid=044 adding entry
ou=xxxernal,ou=groups,dc=xxx,dc=xxx,dc=xxx to non-present list
6548fcee.308236e0 0x7f69ca9fe640 nonpresent_callback: rid=044 nonpresent UUID
259e6c3e-0364-103e-83a1-fb52f2a7ef64, dn
cn=bumblebee,ou=xxxernal,ou=groups,dc=xxx,dc=xxx,dc=xxx
6548fcee.30827cd8 0x7f69ca9fe640 nonpresent_callback: rid=044 adding entry
cn=bumblebee,ou=xxxernal,ou=groups,dc=xxx,dc=xxx,dc=xxx to non-present list
6548fcee.3082f851 0x7f69ca9fe640 nonpresent_callback: rid=044 nonpresent UUID
259ea208-0364-103e-83a2-fb52f2a7ef64, dn
cn=xxx-stdlog,ou=xxxernal,ou=groups,dc=xxx,dc=xxx,dc=xxx
6548fcee.30834ac6 0x7f69ca9fe640 nonpresent_callback: rid=044 adding entry
cn=xxx-stdlog,ou=xxxernal,ou=groups,dc=xxx,dc=xxx,dc=xxx to non-present list
6548fcee.308378a3 0x7f69ca9fe640 nonpresent_callback: rid=044 nonpresent UUID
259ee39e-0364-103e-83a3-fb52f2a7ef64, dn
cn=xxx-satlog,ou=xxxernal,ou=groups,dc=xxx,dc=xxx,dc=xxx
6548fcee.3083c5f0 0x7f69ca9fe640 nonpresent_callback: rid=044 adding entry
cn=xxx-satlog,ou=xxxernal,ou=groups,dc=xxx,dc=xxx,dc=xxx to non-present list
6548fcee.3084211a 0x7f69ca9fe640 nonpresent_callback: rid=044 nonpresent UUID
259f19cc-0364-103e-83a4-fb52f2a7ef64, dn ou=people,dc=xxx,dc=xxx,dc=xxx
6548fcee.3084d927 0x7f69ca9fe640 nonpresent_callback: rid=044 adding entry
ou=people,dc=xxx,dc=xxx,dc=xxx to non-present list
6548fcee.3084fdc6 0x7f69ca9fe640 nonpresent_callback: rid=044 nonpresent UUID
259f3a9c-0364-103e-83a5-fb52f2a7ef64, dn ou=policies,dc=xxx,dc=xxx,dc=xxx
6548fcee.30854d9d 0x7f69ca9fe640 nonpresent_callback: rid=044 adding entry
ou=policies,dc=xxx,dc=xxx,dc=xxx to non-present list
6548fcee.3085ada2 0x7f69ca9fe640 nonpresent_callback: rid=044 nonpresent UUID
259f5fe0-0364-103e-83a6-fb52f2a7ef64, dn cn=xxx,ou=policies,dc=xxx,dc=xxx,dc=xxx
6548fcee.308609b0 0x7f69ca9fe640 nonpresent_callback: rid=044 adding entry
cn=xxx,ou=policies,dc=xxx,dc=xxx,dc=xxx to non-present list
6548fcee.308667fe 0x7f69ca9fe640 nonpresent_callback: rid=044 nonpresent UUID
259f8ace-0364-103e-83a7-fb52f2a7ef64, dn
cn=service,ou=policies,dc=xxx,dc=xxx,dc=xxx
6548fcee.3086b9c3 0x7f69ca9fe640 nonpresent_callback: rid=044 adding entry
cn=service,ou=policies,dc=xxx,dc=xxx,dc=xxx to non-present list
6548fcee.308757a7 0x7f69ca9fe640 nonpresent_callback: rid=044 nonpresent UUID
259fbb34-0364-103e-83a8-fb52f2a7ef64, dn ou=services,dc=xxx,dc=xxx,dc=xxx
6548fcee.3087a519 0x7f69ca9fe640 nonpresent_callback: rid=044 adding entry
ou=services,dc=xxx,dc=xxx,dc=xxx to non-present list
###cut because of repeating
6548fcee.30c9f182 0x7f69ca9fe640 nonpresent_callback: rid=044 nonpresent UUID
268b64c6-0364-103e-841c-fb52f2a7ef64, dn
uid=ini.t.xxx1,ou=people,dc=xxx,dc=xxx,dc=xxx
6548fcee.30ca3e0b 0x7f69ca9fe640 nonpresent_callback: rid=044 adding entry
uid=ini.t.xxx1,ou=people,dc=xxx,dc=xxx,dc=xxx to non-present list
6548fcee.30ca98b3 0x7f69ca9fe640 nonpresent_callback: rid=044 nonpresent UUID
268b7e70-0364-103e-841d-fb52f2a7ef64, dn
uid=ini.t.xxx2,ou=people,dc=xxx,dc=xxx,dc=xxx
6548fcee.30cab5ff 0x7f69ca9fe640 nonpresent_callback: rid=044 adding entry
uid=ini.t.xxx2,ou=people,dc=xxx,dc=xxx,dc=xxx to non-present list
6548fcee.30d168a7 0x7f69ca9fe640 nonpresent_callback: rid=044 had 0 items left
in the list
6548fcee.30d1ca8a 0x7f69ca9fe640 slap_queue_csn: queueing 0x7f69bc130cd0
20231106144914.714573Z#000000#007#000000
6548fcee.30d24de6 0x7f69ca9fe640 conn=-1 op=0 syncprov_matchops: recording uuid
for dn=uid=ini.t.xxx2,ou=people,dc=xxx,dc=xxx,dc=xxx on opc=0x7f69bc000c38
6548fcee.310467fd 0x7f69ca9fe640 conn=-1 op=0 syncprov_checkpoxxx: running
checkpoxxx
6548fcee.310e6382 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: adding
csn=20231106144914.714573Z#000000#007#000000 to sessionlog,
uuid=268b7e70-0364-103e-841d-fb52f2a7ef64
6548fcee.310ee876 0x7f69ca9fe640 slap_graduate_commit_csn: removing
0x7f69bc130cd0 20231106144914.714573Z#000000#007#000000
6548fcee.310f47fc 0x7f69ca9fe640 syncrepl_del_nonpresent: rid=044 be_delete
uid=ini.t.xxx2,ou=people,dc=xxx,dc=xxx,dc=xxx (0)
6548fcee.310fcb77 0x7f69ca9fe640 conn=-1 op=0 syncprov_matchops: recording uuid
for dn=uid=ini.t.xxx1,ou=people,dc=xxx,dc=xxx,dc=xxx on opc=0x7f69bc000c38
6548fcee.310467fd 0x7f69ca9fe640 conn=-1 op=0 syncprov_checkpoxxx: running
checkpoxxx
6548fcee.310e6382 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: adding
csn=20231106144914.714573Z#000000#007#000000 to sessionlog,
uuid=268b7e70-0364-103e-841d-fb52f2a7ef64
6548fcee.310ee876 0x7f69ca9fe640 slap_graduate_commit_csn: removing
0x7f69bc130cd0 20231106144914.714573Z#000000#007#000000
6548fcee.310f47fc 0x7f69ca9fe640 syncrepl_del_nonpresent: rid=044 be_delete
uid=ini.t.xxx2,ou=people,dc=xxx,dc=xxx,dc=xxx (0)
6548fcee.310fcb77 0x7f69ca9fe640 conn=-1 op=0 syncprov_matchops: recording uuid
for dn=uid=ini.t.xxx1,ou=people,dc=xxx,dc=xxx,dc=xxx on opc=0x7f69bc000c38
6548fcee.31392839 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: adding
csn=20231106144914.714573Z#000000#007#000000 to sessionlog,
uuid=268b64c6-0364-103e-841c-fb52f2a7ef64
6548fcee.3139a930 0x7f69ca9fe640 syncrepl_del_nonpresent: rid=044 be_delete
uid=ini.t.xxx1,ou=people,dc=xxx,dc=xxx,dc=xxx (0)
6548fcee.313a283f 0x7f69ca9fe640 conn=-1 op=0 syncprov_matchops: recording uuid
for dn=uid=xxx3,ou=people,dc=xxx,dc=xxx,dc=xxx on opc=0x7f69bc000c38
###cut because of repeating
6548fcee.365d5fb3 0x7f69ca9fe640 syncrepl_del_nonpresent: rid=044 be_delete
cn=bumblebee,ou=xxxernal,ou=groups,dc=xxx,dc=xxx,dc=xxx (0)
6548fcee.365d8037 0x7f69ca9fe640 conn=-1 op=0 syncprov_matchops: recording uuid
for dn=ou=xxxernal,ou=groups,dc=xxx,dc=xxx,dc=xxx on opc=0x7f69bc000c38
6548fcee.3661fe56 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: adding
csn=20231106144914.714573Z#000000#007#000000 to sessionlog,
uuid=259e4bfa-0364-103e-83a0-fb52f2a7ef64
6548fcee.366222ad 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: expiring
csn=20231106144914.714573Z#000000#007#000000 from sessionlog (sessionlog
size=101)
6548fcee.36622bec 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: updating
mincsn for sid=7 csn=20231106144914.714573Z#000000#007#000000 to
20231106144914.714573Z#000000#007#000000
6548fcee.36623955 0x7f69ca9fe640 syncrepl_del_nonpresent: rid=044 be_delete
ou=xxxernal,ou=groups,dc=xxx,dc=xxx,dc=xxx (0)
6548fcee.36624ea1 0x7f69ca9fe640 conn=-1 op=0 syncprov_matchops: recording uuid
for dn=ou=xxxxxxUserGroups,ou=groups,dc=xxx,dc=xxx,dc=xxx on opc=0x7f69bc000c38
6548fcee.36627f95 0x7f69ca9fe640 syncrepl_del_nonpresent: rid=044 be_delete
ou=xxxxxxUserGroups,ou=groups,dc=xxx,dc=xxx,dc=xxx (66)
6548fcee.3662a31c 0x7f69ca9fe640 conn=-1 op=0 syncprov_matchops: recording uuid
for dn=ou=xxxxxxUserGroups,ou=groups,dc=xxx,dc=xxx,dc=xxx on opc=0x7f69bc000c38
6548fcee.36666420 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: adding
csn=20231106144914.714573Z#000000#007#000000 to sessionlog,
uuid=259d0650-0364-103e-8399-fb52f2a7ef64
6548fcee.36668ab1 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: expiring
csn=20231106144914.714573Z#000000#007#000000 from sessionlog (sessionlog
size=101)
6548fcee.366692cf 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: updating
mincsn for sid=7 csn=20231106144914.714573Z#000000#007#000000 to
20231106144914.714573Z#000000#007#000000
6548fcee.3666ae46 0x7f69ca9fe640 conn=-1 op=0 syncprov_matchops: recording uuid
for dn=ou=groups,dc=xxx,dc=xxx,dc=xxx on opc=0x7f69bc000c38
6548fcee.3666e8b5 0x7f69ca9fe640 syncrepl_del_nonpresent: rid=044 be_delete
ou=groups,dc=xxx,dc=xxx,dc=xxx (66)
6548fcee.36670ac5 0x7f69ca9fe640 conn=-1 op=0 syncprov_matchops: recording uuid
for dn=ou=groups,dc=xxx,dc=xxx,dc=xxx on opc=0x7f69bc000c38
6548fcee.366a7dd6 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: adding
csn=20231106144914.714573Z#000000#007#000000 to sessionlog,
uuid=259cce74-0364-103e-8398-fb52f2a7ef64
6548fcee.366aa472 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: expiring
csn=20231106144914.714573Z#000000#007#000000 from sessionlog (sessionlog
size=101)
6548fcee.366aacd4 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: updating
mincsn for sid=7 csn=20231106144914.714573Z#000000#007#000000 to
20231106144914.714573Z#000000#007#000000
6548fcee.366aed0f 0x7f69ca9fe640 conn=-1 op=0 syncprov_matchops: recording uuid
for dn=dc=xxx,dc=xxx,dc=xxx on opc=0x7f69bc000c38
6548fcee.366b2cfa 0x7f69ca9fe640 syncrepl_del_nonpresent: rid=044 be_delete
dc=xxx,dc=xxx,dc=xxx (66)
6548fcee.366b4e27 0x7f69ca9fe640 conn=-1 op=0 syncprov_matchops: recording uuid
for dn=dc=xxx,dc=xxx,dc=xxx on opc=0x7f69bc000c38
6548fcee.366f3661 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: adding
csn=20231106144914.714573Z#000000#007#000000 to sessionlog,
uuid=259c6bb4-0364-103e-8397-fb52f2a7ef64
6548fcee.366f5cb9 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: expiring
csn=20231106144914.714573Z#000000#007#000000 from sessionlog (sessionlog
size=101)
6548fcee.366f64a8 0x7f69ca9fe640 conn=-1 op=0 syncprov_add_slog: updating
mincsn for sid=7 csn=20231106144914.714573Z#000000#007#000000 to
20231106144914.714573Z#000000#007#000000
6548fcee.366f7b02 0x7f69ca9fe640 slap_queue_csn: queueing 0x7f69bc1b4e60
20231106144914.714573Z#000000#007#000000
6548fcee.366f9ece 0x7f69ca9fe640 conn=-1 op=0 syncprov_matchops: recording uuid
for dn=dc=xxx,dc=xxx,dc=xxx on opc=0x7f69bc000c38
6548fcee.3672ce75 0x7f69ca9fe640 slap_graduate_commit_csn: removing
0x7f69bc1b4e60 20231106144914.714573Z#000000#007#000000
6548fe03.03528bfa 0x7f69ca9fe640 slap_get_csn: conn=1008 op=14 generated new
csn=20231106145355.055733Z#000000#000#000000 manage=1
6548fe03.0352dab9 0x7f69ca9fe640 slap_queue_csn: queueing 0x7f69bc1b4320
20231106145355.055733Z#000000#000#000000
6548fe03.0366310a 0x7f69ca9fe640 slap_graduate_commit_csn: removing
0x7f69bc1b4320 20231106145355.055733Z#000000#000#000000
6548fe13.20ba4071 0x7f69ca9fe640 do_syncrepl: rid=044 rc -1 retrying
6548fe4f.03f4287a 0x7f69ca9fe640 do_syncrep1: rid=044 starting refresh (sending
cookie=rid=044,sid=000,csn=20231106144450.454190Z#000000#000#000000;20231106144914.714573Z#000000#007#000000)
6548fe4f.04080138 0x7f69ca9fe640 do_syncrep2: rid=044 LDAP_RES_xxxERMEDIATE -
REFRESH_DELETE
