I don't want to play smash with my friends
Why don't you want to play smash with your friends?
They always borrow my games and don't return them for a long time
While I understand you concern about getting your games back, it is good manners to share your games with your friends, if you are having fun together. Should you stop doing that, they might not want to hang out with you anymore and you might end up alone. You should try talking to them about returning your games sooner, that will hopefully help.
Well they aren't really great friends anyway so I might just ditch them.
That seems very extreme. You should talk with your friend about how you feel rather than just cutting them off.