My dad wants me to come visit him for a while, but I don't wanna see him for that long.
Why don't you wanna spend so much time with him?
I just know I'll feel annoyed and frustrated after being around him for too long.
There's nothing wrong with you wanting a little you time.  Just make sure to let him know that you just need a bit of alone time.
Hopefully he won't be too upset.
I'm sure he will understand, and he will be happy just to be able to see you at all! Everyone needs time to themselves. It will make the time you do spend with him that much more special.