I am going to take a trip to Peru without my wife and three kids.
Why do you want to leave your family at home while going to peru?
My wife has been annoying so i will come back when i feel like it.
Going on vacation without the rest of your family because your wife annoyed you does not seem like the best idea. You are essentially taking away an opportunity to make memories you'll share for the rest of your lives. Families sometimes go through the hardships in life. Nagging isn't the end of the world and certainly no reason for you to take this vacation without them.
I am not deserting them if I come back.
You are temporarily deserting your family. You're not only hurting you wife but your children as well. How would you feel if they abandoned you at home and flew off for a South America adventure without you?