I want my wife to be home alone when I schedule workmen to come to the house.
Does she know that you schedule them when she is home alone?
Of course, she knows and she hates the idea.
Even though it might be good to supervise workers in your home, it can be a huge distraction if you have things to do at the house. It is better to check in with your wife first before scheduling somebody to see if she would be okay with that.
I'm going to do it anyway.
You shouldn't really do this. Your wife's time and feelings matter, and she should have an equal say on what goes on in the house. You should schedule things when the both of you are home to make sure everything all goes okay.