I wanted more than an apology, I want to see a change in their behavior.
What if they don't change after apologizing to you?
Then I will cut all contact with him and never speak to him again!
It is always kind to graciously accept others' apologies. However, if they never stop doing what they apologized for, you are within your rights to limit your interactions with them.
I don't like people agreeing to improve and then not doing so. I just want him to act differently so I'm going to tell him if he does it again I will never talk to him again.
I can appreciate your irritation at this person's behavior, and I can certainly understand why you would want to break off contact.  However, you should first make sure that your friend is fully aware of how serious you consider this behavior to be.  It's possible that he didn't even realize that it was upsetting to you.