I'm not going to trade shifts with a co-worker, is that what you want to hear from me?
Oh for real now? Isn't that rude?
I'm just fine with kicking him out of his work area in general.
If you don't feel like taking over someones shift then you don't have to. There is no reason why you would have to work that someone else was assigned to do.
He switched with me and canceled last minute.
You can just decline if you have to. Kicking them out of the work place isn't going to be of help to anyone, just make sure he knows you mean no is all. Being rude won't solve any problems.