I'm not going to visit an old friend
Why don't you want to visit an old friend?
I think we both need a break from each other for a while.
It's understandable that you might fall of out touch with an old friend. Even if you find yourselves not as close as before you can still try to make time to see them when you have the feeling.
I may have to tell him that today.
I hope your friend understands and that it is mutual. I'm sure you'll be better friends for it in the long run.