They have been passing by my house which is a hot spot.
Have you been watching the house because you're bored?
No, I'm just bored and a little negative.
Looking out for the security of your home is a good thing to do whether you're bored or not.  You should always keep an eye out for suspicious people in your neighborhood.  If you think they're dangerous, tell the authorities!
I just know that my neighbor is an asshole, he's always knocking on my door and I'm not home. I don't know what he's walking around for.
I think the best way to move forward is to talk to them. You have your suspicions and that's okay but be more proactive in trying to solve this problem.