Is it awful to just stop talking with my friend
Why would you want to stop talking with a friend of yours?
He gets on my nerves at times and I feel like stabbing him when I talk with him.
I think it sounds like you need to work on these anger issues first.  It may help you to be a better friend, which would lead you to seeing how bad it is to just stop talking to friends of yours out of nowhere.  I hope you get some help!
I would still like to stop talking to him though. I'm getting my knife and I won't come back until he's dead.
I really hope that was a joke. Murdering a friend because they're annoying is beyond wrong. Doing something like that will land you in prison or a psych hospital for the rest of your life.