I don't care about holidays and don't want to make an extra trip to go see family on the day of
Why wouldn't you want to make a trip to see you family?
The holidays are not fun and there is nothing to do.
It's okay to not be a fan of the holidays. Sometimes people just want to have a small holiday celebration. Have you thought about talking to your family about making the gathers smaller?
I can't tell them that, I don't want to disappoint anyone and don't have many relatives to begin with.
Well maybe you can tell them that you have to work for the holidays. You should force yourself to like the holidays if you don't like them.