I'm thinking of doubting a 5 year friendship
What is making you doubt your friendship? Why do you have these concerns?
He's just not my type of friend anymore
People do grow apart and it is understandable to not want to be friends with someone anymore. You will feel better about getting out of the situation.
But there's nothing wrong with him. I should just deal with it and suck it up.
If it is a bad situation or the person is doing bad things it is best that you not be associated with them so use your careful judgment here.