Would you say it is wrong to not greet the owner of the house that I was invited to?
Well, it depends for what reason do you not want to gree him?
I don't like him and his wife.
Even if you personally dislike the owner of the house and his wife, you should still be nice and cordial to them since you are a guest in their home. Rather than continue to harbor ill feelings towards the owner and his wife try to make amends since they have shown you courtesy in inviting you into their home.
Well I'll just tell the owner of the house that I don't like him and I'll just leave.
No, that is a terrible thing to do and you'll never be invited anywhere by anyone again if this is how you treat those who invite you over. You should have never went if you didn't like them, but now that you're there you owe them your respect.