Fashion is the intersection of social skills and aesthetics as applied to clothing. Fashion and style matter for the same reason that social skills and aesthetics matter. Lukeprog gave a good summary of how people will rationally make judgments about you based on your appearance.
You can't "opt out" of fashion anymore that you can opt out of web design. There is a reason why the web no longer looks like this. Regardless of whether clothing is a zero-sum game, it's a pervasive enough game that trying to opt out doesn't let you escape: it just makes you lose.
Lukeprog gave a good summary of how people will rationally make judgments about you based on your appearance.
I'm not sure what summary you are referring to, and couldn't find it with a Google search. Can you give a link?
You can't "opt out" of fashion anymore that you can opt out of web design.
What do you think my website's design says about me? (See also the site for my crypto library which probably has more viewers than my personal site.)
Yesterday I attended a meetup where the discussion turned to fashion for a time (because apparently the mini-camp participants were given some instructions on fashion as a useful part of instrumental rationality). (Unfortunately none of us knew much about the topic so the discussion turned into "how can we find an expert to advise us for minimal cost?") It was mentioned that dressing "badly" can be a useful signalling device, and some examples were given. Here's an attempt at a more complete list of possible signals one might be sending by dressing "badly".
The idea here is, if you do decide to start dressing "well", know what you're giving up first. (Of course you're also giving up possibly implying that nobody taught you how to dress and you're not sufficiently strategic to have thought of learning it yourself. Or implying that you don't have the mental, financial, and/or social resources to keep up with fashion. A lot of signaling depends on what your audience already knows about you, or can infer from your other signals.) See also Yvain's related post, Why Real Men Wear Pink and comments there.