What do you think of me not helping with the family business?
Do you think you are not up to helping with the family business?
I never liked the idea of sharing a company with my brother
Not wanting to help with a family business is something that is up to you, but the family might beg to differ. You should want to help them in their times of need. Then later when they are more of a success you can take some time away to pursue your own goals.
That seems like a lot of work and a waste of time. I just want to stay away. Not my problem.
You shouldn't force yourself then if you really don't want to. A business takes a lot of effort that would require motivation and time so if you're not into running the business then you should tell your family that.