Only if you think that.
I don’t bother feminising my voice half the time – I’m not a real woman, so why pretend I am when it’s obvious?
People take me as I am or not at all.
No-one comments on my voice, only my appearance. The appearance is what draws them in, it’s up to you how far you want to stretch the illusion – but people like that we cross dress (or they don’t, or are indifferent) – so no big deal.
Do what feels like you!