I sometimes wish you'd just disappear.
Do you not like something about me?
Yes, I'm tired of you hanging around here like some useless baggage.
Do you have a reason to be so angry towards me? Let's talk this out and come to a mutual understanding.
I'll accuse you of not caring about me and we can just end this if you want.
It's better to just tell people why you don't like them. Making comments about them wanting them gone is just petty and delays the truth. be honest and upfront.