Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Rings_of_Saturn comments on Raising the Sanity Waterline - Less Wrong

114 Post author: Eliezer_Yudkowsky 12 March 2009 04:28AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (207)

You are viewing a single comment's thread. Show more comments above.

Comment author: Rings_of_Saturn 12 March 2009 08:46:28PM *  5 points [-]

I think this is a good answer to Eliezer's thought experiment. Teach those budding rationalists about the human desire to conform even in the face of the prima facie ridiculousness of the prevailing beliefs.

Teach them about greens and blues; teach them about Easter Islanders building statues with their last failing stock of resources (or is that too close to teaching about religion?). Teach them how common the pattern is: when something is all around you, you are less likely to doubt its wisdom.

Human rationality (at least for now) is still built on the blocks and modules provided to us by evolution. They can lead us astray, like the "posit agency" module firing when no agent is there. But they can also be powerful correctives. A pattern-recognizing module is a dangerous thing when we create imaginary patterns... but, oh boy, when there actually is a pattern there, let that module rip!