I have the same problem. My willy hardly reaches my scrotum 🙂
If I’m wearing a tight fitting skirt I wear control panties. These are thick and firm enough to remove most of the problem.
The other solution is to wear skirts and dresses that are not tight over “that” area.