I'm considering it my husbands fault that our finances are a mess
Have you told him that you are having these feelings?
No, but that won't last long.
I know that money is a tough situation to deal with, but you can't place all of the blame on him. Finances should be watched closely by both of you.
What if I simply said that I'm pissed off, who cares what the reason was.
That wouldn't help things much.  People like to know why those they care about are upset.  Simply stating you're angry without saying why isn't going to do anything to resolve the situation.