I don't know if I had the same bug, but I've also had problems with
xfce4-notifyd lately in Debian sid: xfce4-notifyd wouldn't start,
causing some programs (e.g. Thunderbird on startup and Thunar when
unmounting an USB device) to stall for a while.
I *think* the problem in my case was that I had two Notifications
services installed: xfce4-notifyd and plasma-workspace. I guess it just
picked the first one of these (alphabetically?), and the one in
plasma-workspace did not play nice with Xfce.
My first workaround was to install dunst, which perhaps worked because
it was even earlier in the alphabet. My second was to remove
/usr/share/dbus-1/services/org.kde.plasma.Notifications.service
But I'm hoping there is a better way...
Torbjörn Andersson