I'm going to try to avoid people associating me with a certain 'friend' of mine
Why do you want to distance yourself from this friend?
He has so many problems and I don't want to be associated with it
If you want to not associate with this person then you are right to. Nobody should be forced on our lives if they make us uncomfortable.
He has been a troublemaker recently. I don't want to be associated with him.
That sounds fair to me. People that cause trouble will likely bring that trouble to you.