I would like to say that I'm not going to spend time with my husband, is it going to last?
This leaves me flabbergasted to say the least. What's wrong with spending time with him?
I have better things to do
You need to spend time together and build your relationship. You and your husband need to be closer.
I'm keeping myself away from him. Since he is not doing anything with me.
If you don't want to spend time with him and vice versa then I suggest you just divorce each other. Things need to change if you think you can build on a marriage that way.