I don't want to spend time with my son.
I'm sad by this. Why wouldn't want to spend time with your son?
I can't handle my son any longer, he completely drains my energy
I know there are times you feel exhausted. However, as a parent, it is your responsible to spend time with your child as he may have no one else who would take care of him that time. No one else loves their son but their parents and you should show that.
Sorry, I'm not going to do it.
You shouldn't say sorry to me but your son, as you're letting him down. If you continue to not spend time with him he may end up being neglected and won't be equipped to be a productive member of society and it will be partly your fault.