I'm not going to let my partner come and see me at college
Why wouldn't you want him to visit you?
My boyfriend is very irresponsible, he never comes to visit me or even calls me. He is always busy with his own stuff.
As you said, he is a very busy man. If you don't allow him time to personally come and see you, then things will only become more unsatisfying for you.
Even if he was busy, if he really cared about me, he would make more of an effort to come and see me.
I know that he has been awful about visiting you in the past and being there for you but he is now trying. You don't have a reason to complain in the future if you don't see him because he did try to visit you.