Hi! Had a similar problem some years ago. Many mail servers sent me a "could not deliver" rejectmails (about 50-100 mails, which could be easily ruled by spamassassin).
Someone misused my e-mail address, so I get all the stuff back. I guess, it will also be easy to fake the senders ip address. My problem disappeared after 2 days. Best Hans