I feel stressed and terrified I can't life up to what people expect of me.
What makes you want to be the person that people think you are?
I have to because I don't want them to avoid me.
Trying to be the kind of person that people think you are sounds very demanding, and I don't think you should continue doing that. You should be yourself, and let people like you for being the real you.
That's a lot harder than it sounds and it doesn't work.
Don't you think faking all the time won't be mentally anguishing for you? Maybe you need to find some new friends who share the same interests as you, that can be a real confidence booster.