I'm not going to have any contact with my father's family
Oh no. Why do you not want to have contact with his family?
You want to show love to people who aren't interested in you back? What a dumb idea
I understand that your father's family doesn't show much interest in you, but you shouldn't just cut them out of your life for no reason. Try talking to them about how you feel instead.
They are trash, I'm not engaged with them.
There may be an underlying family issue that I do not know about here, so I couldn't really tell you what to do but just to communicate with them. His family may have a very nice history and culture and you may find a lot of your relatives really interesting to talk to, and it's only you who is depriving yourself that opportunity to get to know them if you don't have any contact with them.