What do you think about me not talking to a guy I like because of a comment that he made?
What about his comment makes you want to stop talking to him.
I think his comment is offensive and distasteful.
It's fine to stop talking to this guy because he made an offensive comment. You should stand up for what you think is right, and if you think what he said is wrong, then it's fine to let him know.
I can't stand up to him, I'm too scared.
It's good to be assertive and stand up for what you believe to be right. This will ensure that the guy knows making distasteful comments will not be acceptable.