He was frustrated because I was still in bed.
Why were you still in bed?
He had to take a bath and I'm still in bed and he got worried about why I wasn't up yet
It is understandable to worry about others but you shouldn't let it bother you so much that it makes you upset with them. It would be better to talk about your concerns with them instead.
I really need to talk with that loner idiot.
If you talk to them, please don't call them a loner. That is mean, just talk to him about how you feel without being cruel.