I have what I thought was a harmless fetish but I fear it's becoming an obsession.
Why do you think that it's becoming an obsession?
I mention it too much to potential dates and they get turned off.
It's not good to let something become an obsession, especially when it's negatively affect your personal life. I think you should talk to a professional about this before it really gets out of hand.
So I should just try to ignore it, when it's part of who I am and I will always have these feelings?
Well there is a healthy limit. If you can't handle you feelings you can talk with a sex therapist about the problems, they can help you more than I can.