If you catch me staring at you it's not on purpose so please don't try to hold a gaze with me.
Are you serious? Why do you have this habit?
I hate people looking at me.
If you don't like to be gazed at, then don't do it to other people. Keep a lid on your staring habit if you don't want a possibly unfortunate reaction.
What's the big deal?
Well you just said you hate people looking at you, so you must know how rude staring can be. How about you do unto others and not do something you dislike back at me?