My vague impression is that it's closely related to distrust of authority. If one trusts authority, any change takes you farther away from a trusted safe state and thus carries a large hidden cost.
On the other hand, unless you have the enormously rare constellation of talent and circumstances to give you a realistic chance to rise to the very top, too little trust in authority leads to a state of frightened paralysis or downright self-destruction. What you need for success is the instinct to recognize when you should obey the powers-that-be with your heart and your mind, and when to ignore, defy, or subvert them.
The ability to conform to the official norms and trust the official dogma with full honesty when it's optimal to do so is just as important as the ability to ignore, defy, and subvert them in other cases. Otherwise your distrust of authority will lead you either to cower in fear of it or to provoke its wrath and be destroyed. A well-calibrated unconscious strategic instinct to switch between conformity and non-conformity is, in my opinion, one of the main things that sets apart greatly successful people from others.
It seems to me that the decision theory generally favors acting as if one has rare talent and circumstances, as opposed to the alternative, more likely hypothesis, which is probably the contrarian hypothesis of being a simulation in any event. Attempts to justify common sense, treated honestly, generally end up as justifications of novel contrarian hypotheses instead.
Also, one who tries to conform to official norms rather than to ubiquitous surrounding behavioral patterns will rapidly find oneself under attack, nominally for violating official norms. ...
LW doesn't seem to have a discussion of the article Epiphany Addiction, by Chris at succeedsocially. First paragraph:
I like that article because it describes a dangerous failure mode of smart people. One example was the self-help blog of Phillip Eby (pjeby), where each new post seemed to bring new amazing insights, and after a while you became jaded. An even better, though controversial, example could be Eliezer's Sequences, if you view them as a series of epiphanies about AI research that didn't lead to much tangible progress. (Please don't make that statement the sole focus of discussion!)
The underlying problem seems to be that people get a rush of power from neat-sounding realizations, and mistake that feeling for actual power. I don't know any good remedy for that, but being aware of the problem could help.