I hate my boyfriend
That's terrible you feel that way. What has your boyfriend done for you to hate him?
He doesn't spend time with me and he's not affectionate!
It sounds like the two of you have a lot of problems.  It would be wrong for you to stay in the relationship if you hate your boyfriend so much.
But we have a two-year-old together!
I see why it would be difficult for you two to break up but even if you two have a child together, it doesn't mean you have to be together.