I'm worried that getting married or having a family will slow my career
Do you think your family is a barrier to your career?
My family is more of a barrier to my career progression
While having a career is important, it's necessary to consider all of your priorities in life. Having a family can be a wonder source of love and support, something that is difficult to get from a career.
I don't care what the majority says. I will do what I want.
It's fine to live a life that makes you happy. However, if you already have a family, you have an obligation to them as well.  It's important to remember that you want your family to consider you when they make decisions as well.