What do you think about me quitting my job because the people I work with are annoying and inappropriate?
Are your coworkers the only reason you quit your job?
Yes, they are very annoying and difficult to deal with.
I understand that your coworkers are challenging to work with, but you should not quite your job just because of them. We all have situations where we need to deal with difficult coworkers and we need to learn to work with them. It's not appropriate to quit a job just because you don't get along with others.
I should leave the office if I don't like it there.
Have you spoken to Human Resources personnelle, keeping your distance from the difficult individuals or making allegiances with the good people there? They can't be all bad. You might find you can carve out a comfortable niche there despite the jerks.