I'm annoyed with white elephant parties
Why are you annoyed by them?
Not enough people show up to them.
Maybe next time, you can invite more people next time, so more can show up. It is good to try and get more people involved.
There needs to be more than 7 people for it to be fun.
One thing you can try is to ask your friends to invite their friends. You can reach more people in this way.