I want to sometimes drive to random towns, knock on somebody's door, and claim it is my childhood home. Some people call my bs and some let me walk around and I pretend to reminisce old times in random rooms.
Why do you want to act out this fantasy?
I've always had this dream of living as a mysterious stranger, and some people even help me live that dream that I've never had.
That's certainly a strange pastime, but you're not hurting anyone, so you do you.  Be careful you don't somehow go into the wrong home and wind up in trouble.
It almost happened but luckily I wasn't discovered.
As long as you aren't bothering someone or creating problems for others, you are free to do what you want.