I don't like the way my husband decorates the house.
Did you allow him to take care of the decorating?
Yeah, I know it's my own fault.  I didn't want to be so hard on him but now I can't do anything to change it.
It seems like your taste in decor is very different. It is okay that his preferences do not meet yours, it is a normal part of every relationship.
It's not about the taste, I just want him to stop decorating since he's doing it so badly.
If this is a problem for you, and if he is still trying to decorate the house, then maybe you can take over.  Just let him know that you want to try something different for the rest of the house, and then fix it up to fit your own style.