I'm going to kick foreign people out of my house for not speaking english
Why would you do that to them?
I only say this because I'm fed up with listening to them dumb language
If they're your guests, you should treat them as such.  Be kinder to them, as it's difficult to learn a foreign language so quickly.  If you invited them to stay there then it's your responsibility to let them stay!
They are not my guest.
How are they in your house if they are not your guest?  That's basically the definition of a guest.  You should be more accommodating!