If I had to go with just one, it would be a skirt and blouse/top. Way more flexible and versatile – you can do so much mixing and matching. And I’ll buy a cute top at the drop of a hat… dresses I am more critical of when buying.
Exception: anything formal or fancy that I would dress for, I would be in a dress. They can be soooo elegant 🙂