I never wash my hands after using the restroom.
Why did you stop washing your hands?
I don't think it matters.
You could get somebody else sick when touching them or touching things that they will touch.
It's a hassle to wash my hands every time.
That's pretty disgusting and you are contributing to the spread of germs. It's a normal expectation that you wash your hands after using the restroom.