MichaelVassar comments on Making your explicit reasoning trustworthy - Less Wrong

82 Post author: AnnaSalamon 29 October 2010 12:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (93)

You are viewing a single comment's thread. Show more comments above.

Comment author: Vladimir_M 29 October 2010 09:15:16PM *  5 points [-]

The main problem I see with this post is that it assumes that it's always advantageous to find out the truth and update one's beliefs towards greater factual and logical accuracy. Supposedly, the only danger of questioning things too much is that attempts to do so might malfunction and instead move one towards potentially dangerous false beliefs (which I assume is meant by the epithets such as "nutty" and "crazy").

Yet I find this assumption entirely unwarranted. The benefits of holding false beliefs can be greater than the costs. This typically happens when certain false beliefs have high positive signaling value, but don't imply any highly costly or dangerous behavior. Questioning and correcting such beliefs can incur far more cost than benefit; one can try to continue feigning them, but for most people it will be at least somewhat difficult and unpleasant. There are also many situations where the discovery of truth can make one's life miserable for purely personal reasons, and it's in the best interest of one's happiness to avoid snooping and questioning things too much.

It seems to me that the problem for uncompromising truth-seekers is not just how to avoid invalid reasoning leading to crazy false beliefs, but also how to avoid forming true beliefs that will have negative signaling consequences or drastically reduce one's happiness. Now, maybe you would argue that one should always strive for truth no matter what, but this requires a separate argument in addition to what's presented in the above post -- which is by itself insufficient to address the reasons for why people are "afraid to think fully about certain subjects."

Comment author: MichaelVassar 03 November 2010 10:43:40PM 1 point [-]

In my experience, practically speaking though not theoretically, true beliefs are literally always beneficial relative to false ones, though not always worth the cost of acquiring them.