I've been feeling upset by the fact that other women can get pregnant and I cannot.
Why would you feel the need to be with someone who can't get you pregnant?
I love him for his love, kindness and care.
It is very natural to be feeling what you are feeling in this situation. You need to make the decision on whether it is worth it for you to stay in the relationship you are in. Is this something you are willing to live without for the love you have already?
I am not willing to leave him but now I feel at peace since I accepted that baby is not meant to be in my life.
It's good you came to terms with that, especially since you're in love with him. If you're able overcome that, you most likely be able to overcome a lot more issues that may come up in the relationship.