You are a treasure for accepting your husband’s femme side. That being said, YOUR happiness is just as important as your partner’s happiness. Marriage isn’t a one way street. It takes both to make a marriage work.
IMHO–toss this selfish person aside and look for happiness elsewhere. You will find it.