Lately I have been pretending to "accidentally" run into my crush. It kind of makes me feel like a stalker.
Why do you want to pretend to accidentally run into your crush?
Because now I feel like I'm following her but I don't want to creep her out!
It is understandable to like a person and have a crush on them, but you should be honest with them and not lie to them. Thus you should not pretend to accidentally run into them because it looks like you are stalking them.
I think i feel a little creeped out. Don't do it again.
Yeah, you're right that you shouldn't do it again. Just tell your crush that you like them and stop trying to follow them around, if they ever find out what you're doing then you'll have completely blown your chance.