Yours is an unusual cross. You very definitely have a place in the Church. All you can do is make the best of your situation. If others are dissatisfied, that is their problem. As long as any of us remain chaste and faithful to the Lord, this is what matters most. You are in my prayers.