I'm thinking of keeping PS500 of my college fund which is meant for paying off my debt
What are you going to do with the money if you keep it?
I have other things to pay off.
That sucks you are struggling elsewhere, but you need to respect what that money is meant for. Later on you'll regret you spent that money when you want to continue your education. So, instead you need to get a loan or borrow money from someone to pay that off.
It's my money so, I can do whatever I like with it.
You will delay your educational progress if you do not apply the money towards what it is meant for.  It may be helpful for you to reach out to your school counselor for resources that can help you with food and other bills.