I'm scared now that I kicked out someone who wasn't supposed to be at my place
You kicked her out for a good reason though, right?
I feel bad for now kicking her out
If they don't belong in your home, you have every right to kick them out. Don't second guess yourself.
I feel it is my problem she is homeless on the street now.
Look, you have the right to be comfortable in your own home. Someone who shows up is not entitled to staying in your home, right? If you really feel bad you can try to help her find a new place to stay.