Should I stop ignoring my friend who wants to visit me?
Probably. Why do you want to ignore her?
She annoys me with the way she talks to others
You should not ignore your friend. If you have a problem with them, you should just tell her directly.
I don't have time to talk to her directly, I'm too busy.
She probably wants to visit because you never seem to have time for her and she misses you. Maybe you should see about making time for that visit. Friends are important and you need to stay connected.