The way I've heard it phrased:
Note that failing to wear socks can cause damage to the skin around your feet and ankles, depending on the style of shoe or boot, and that wearing thick pants in hot weather can cause dehydration and heat stroke. Physical comfort is near the bottom of the list for fashion. Any use of the word 'comfortable' is only to define a stance or personality. There are 'no-show' or 'ankle' socks which are often used to protect the feet when a sockless look is desired, and lightweight pants to match weather requirements.
Yesterday I attended a meetup where the discussion turned to fashion for a time (because apparently the mini-camp participants were given some instructions on fashion as a useful part of instrumental rationality). (Unfortunately none of us knew much about the topic so the discussion turned into "how can we find an expert to advise us for minimal cost?") It was mentioned that dressing "badly" can be a useful signalling device, and some examples were given. Here's an attempt at a more complete list of possible signals one might be sending by dressing "badly".
The idea here is, if you do decide to start dressing "well", know what you're giving up first. (Of course you're also giving up possibly implying that nobody taught you how to dress and you're not sufficiently strategic to have thought of learning it yourself. Or implying that you don't have the mental, financial, and/or social resources to keep up with fashion. A lot of signaling depends on what your audience already knows about you, or can infer from your other signals.) See also Yvain's related post, Why Real Men Wear Pink and comments there.