I don't want to contact someone anymore.
Is there a reason you don't want contact with the person?
After I talk to him, I always feel like someone has been snooping around my mind.
It's understandable and okay that you would want to stop talk to someone that makes you feel uncomfortable. However, you should not just cut off contact with someone. Instead, you can let the person know how you feel about your conversations.
I'm a jerk and I don't care about their feelings.
I can understand how you feel about this situation. You shouldn't just cut off contact with others though without giving them a good reason. If they make you uncomfortable it's okay to not talk to them, but let them know so they can change their ways.