Hi,
I am chasing a substantial memory leak in latest Hammer code base in the write
path since yesterday and wanted to know if anybody else is also observing this
or not. This is as simple as running a fio-rbd random_write workload in my
single OSD server with say block size 16K and num_jobs = 8. I am seeing memory
is increasing very substantially and eventually OSD stopped responding.
I tried it on two different servers (just to make sure since I was playing with
lot of kernel param of late), but results are similar.
Digging down the code and short circuiting different layers, I got the
following.
1. Seeing the nature of leak, it seems the entire transaction is leaking.
2. Code is deleting the transaction with a help of C_DeleteTransaction context
and commenting out the following line and deleting the transaction (op_t) from
submit_transaction(), seems resolved the leak.
/*op_t->register_on_applied(
new ObjectStore::C_DeleteTransaction(op_t));*/
3. In my case, I short circuited the queue_transaction and that's why it is
working, but in reality, we can't delete the transaction from
submit_transaction(). Code seems to be doing proper way , but I am not able to
find out yet why it is leaking memory during deleting it async way.
Appreciate if anybody try out latest hammer building from source and confirm
the behavior.
Thanks & Regards
Somnath
________________________________
PLEASE NOTE: The information contained in this electronic mail message is
intended only for the use of the designated recipient(s) named above. If the
reader of this message is not the intended recipient, you are hereby notified
that you have received this message in error and that any review,
dissemination, distribution, or copying of this message is strictly prohibited.
If you have received this communication in error, please notify the sender by
telephone or e-mail (as shown above) immediately and destroy any and all copies
of this message in your possession (whether hard copies or electronically
stored copies).
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
