I feel defensive and I don't want to continue my manager duties.
Why do you feel defensive?
I here a lot of complaints from my employees and I feel they don't trust me or respect me.
It is understandable that you are frustrated about the negative feedback that you are receiving. You should get to know your employees and listen to their complaints. This will help you build your managerial skills and improve the work environment.
That sounds too much like work. I don't want to do it.
Being responsive to your employees is indeed a lot of work, at least at first, but that is the definition of your job at this higher level.  If you just listen to their concerns and act accordingly, they will trust you and be able to perform well on their own.  Your own job will become much easier as a result, and you can advance even further.