He said I was crazy even though I told him I was fine.
If you thought you were fine, you were probably the best judge of that.
I agree. I'm glad everyone else thought so too.
If you think you are fine, even if others are calling you crazy, then you are probably the best judge of our own feelings. Unless others can give you a valid reason for calling you crazy, then you should ignore them.
I think I'm being punished because I treat others like trash and I deserve it
If you are not treating other well then that might be why he was calling you names. If you feel like you deserve to be punished because of how you treat people maybe you should change your behavior.