How about I ban my boyfriend's friend from our house?
Why don't you want your boyfriend's friend at your house?
The guy gets so drunk and he often creates problems which pisses me off.
You can keep people out of your house if you want. You should discuss with your boyfriend if it's his house too. You don't want your boyfriend to be upset about not being included in a decision.
I'm thinking about kicking him out for good.
If you kick him out you may want to do that for good but talk to the other people involved first to be polite.