Hi,
Am 8/7/25 um 16:18 schrieb Robert Sander:
sdm
8:192 0 18T 0 disk
├─ceph--846e1a59--aff6--4ef8--9b71--de7241531677-osd--block--026e8cef--123d--47d9--9b30--211f94edf96c
252:16 0 17.9T 0 lvm
└─ceph--846e1a59--aff6--4ef8--9b71--de7241531677-osd--db--88c47d0b--f5c6--4cec--8909--c5f8036ca459
252:17 0 100G 0 lvm
The same happens when I remove an existing OSD with
ceph orch osd rm 34 --zap
and let the orchestrator recreate it immediately.
# ceph osd df tree $(hostname)
ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META
AVAIL %USE VAR PGS STATUS TYPE NAME
-5 108.48843 - 108 TiB 601 GiB 950 MiB 17 KiB 840 MiB 108
TiB 0.54 1.00 - host $(hostname)
0 hdd 18.09769 1.00000 18 TiB 100 GiB 158 MiB 1 KiB 241 MiB 18
TiB 0.54 1.00 46 up osd.0
8 hdd 18.09769 1.00000 18 TiB 100 GiB 158 MiB 1 KiB 246 MiB 18
TiB 0.54 1.00 49 up osd.8
16 hdd 18.09769 1.00000 18 TiB 100 GiB 158 MiB 4 KiB 45 MiB 18
TiB 0.54 1.00 41 up osd.16
21 hdd 18.09769 1.00000 18 TiB 100 GiB 158 MiB 5 KiB 46 MiB 18
TiB 0.54 1.00 41 up osd.21
27 hdd 18.09769 1.00000 18 TiB 100 GiB 158 MiB 5 KiB 46 MiB 18
TiB 0.54 1.00 46 up osd.27
34 hdd 18.00000 1.00000 18 TiB 100 GiB 158 MiB 1 KiB 216 MiB 18
TiB 0.54 1.00 51 up osd.34
TOTAL 108 TiB 601 GiB 950 MiB 21 KiB 840 MiB 108
TiB 0.54
MIN/MAX VAR: 1.00/1.00 STDDEV: 0.00
No I have a new OSD on the existing 18TB HDD which is smaller
because a 100G DB volume has been created on it.
And the SSD now has 100G more space:
# pvs
PV VG Fmt Attr PSize PFree
/dev/sda3 system lvm2 a-- <56.95g 0
/dev/sdb ceph-70008fd1-08b8-4cbc-b8eb-6c5d7168147f lvm2 a-- <605.00g
<405.00g
/dev/sdc ceph-46b31f42-bd39-48c7-a855-6ca7e722ffe2 lvm2 a-- <605.00g
<305.00g
/dev/sdf ceph-dc6876b6-ec6b-4486-bf94-f11fe5c6151b lvm2 a-- <18.00t 0
/dev/sdg ceph-3e9d0706-14b9-4344-be98-8d3ba157887b lvm2 a-- <18.00t 0
/dev/sdh ceph-cc6094f5-cd8a-47d9-ab94-d5cc45321cc7 lvm2 a-- <18.00t 0
/dev/sdi ceph-74101368-5145-44c0-8b72-b90160633ac4 lvm2 a-- <18.00t 0
/dev/sdj ceph-aa6188ef-630a-4471-bdd9-71f0ab3228de lvm2 a-- <18.00t 0
/dev/sdk ceph-c5359b20-222a-42eb-924f-3c776d5cd913 lvm2 a-- <18.00t 0
/dev/sdm ceph-846e1a59-aff6-4ef8-9b71-de7241531677 lvm2 a-- <18.00t 0
# lvs
LV VG
Attr LSize
osd-block-1b8e2d04-2664-4c4d-8ef5-db7b3eae70a3
ceph-3e9d0706-14b9-4344-be98-8d3ba157887b -wi-ao---- <18.00t
osd-db-2783958b-1663-46dc-8f2a-43d5ed2d756f
ceph-46b31f42-bd39-48c7-a855-6ca7e722ffe2 -wi-ao---- 100.00g
osd-db-53753101-acda-421b-ac53-8def95f0b92d
ceph-46b31f42-bd39-48c7-a855-6ca7e722ffe2 -wi-ao---- 100.00g
osd-db-958f9106-1931-4fc8-98cc-a64f29a78ddd
ceph-46b31f42-bd39-48c7-a855-6ca7e722ffe2 -wi-ao---- 100.00g
osd-db-82ced9d1-aab3-4c9f-b98f-9dd03691334d
ceph-70008fd1-08b8-4cbc-b8eb-6c5d7168147f -wi-ao---- 100.00g
osd-db-bf25cca1-37b1-4af2-b87b-afeb0296edb1
ceph-70008fd1-08b8-4cbc-b8eb-6c5d7168147f -wi-ao---- 100.00g
osd-block-266fbe77-4512-48c1-b80e-28596ffbfc76
ceph-74101368-5145-44c0-8b72-b90160633ac4 -wi-ao---- <18.00t
osd-block-71e2bd64-0545-4bd6-86eb-11b4d7d9dde1
ceph-aa6188ef-630a-4471-bdd9-71f0ab3228de -wi-ao---- <18.00t
osd-block-5a0af8ec-5dc2-4ad8-8f9d-fdaf7108434b
ceph-c5359b20-222a-42eb-924f-3c776d5cd913 -wi-ao---- 17.90t
osd-db-e51a1c62-4efa-42ac-818f-33afeda5cc61
ceph-c5359b20-222a-42eb-924f-3c776d5cd913 -wi-ao---- 100.00g
osd-block-ccbbcf09-6aa7-4499-94e1-fc00cad41904
ceph-cc6094f5-cd8a-47d9-ab94-d5cc45321cc7 -wi-ao---- <18.00t
osd-block-ba721825-178a-4c30-b39b-d71e3611398f
ceph-dc6876b6-ec6b-4486-bf94-f11fe5c6151b -wi-ao---- <18.00t
This did work better in version 18.2.7
Regards
--
Robert Sander
Linux Consultant
Heinlein Consulting GmbH
Schwedter Str. 8/9b, 10119 Berlin
https://www.heinlein-support.de
Tel: +49 30 405051 - 0
Fax: +49 30 405051 - 19
Amtsgericht Berlin-Charlottenburg - HRB 220009 B
Geschäftsführer: Peer Heinlein - Sitz: Berlin
_______________________________________________
ceph-users mailing list -- [email protected]
To unsubscribe send an email to [email protected]
