I think men are sweatier than women on the whole (say that out loud without smirking).
So they appreciate the cool air.
A chum who dresses as a Roman Legionary in his spare time also reckons when carrying lots of kit and wearing a helmet he gets very hot round the head and shoulders, but the cooler areas below counter-balance the experience and render it bearable.