I don't want my ex's current girlfriend in my house
Why do you care?
It makes me feel uncomfortable.
It is your home. You can control who comes in and out.
I want to kick her out.
That is fine to do. You control the rules of the house. If you don't want him in your house tell him.