You scare me so I can't be friends anymore.
I don't understand. Why are you afraid of me?
I'm not kidding. You just scared me off.
It's wrong for anyone to frighten anyone else, so I would like to know how I have done this to you.  I did not want to damage our friendship, and would like to make it better.
I don't want to explain it. I'm just going to walk away from you instead of your life.
But if we are friends you should explain it to me. You should give me a chance before damaging our friendship so completely.