Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Recovering_irrationalist comments on An Alien God - Less Wrong

80 Post author: Eliezer_Yudkowsky 02 November 2007 06:57AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (137)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Recovering_irrationalist 02 November 2007 03:41:38PM 6 points [-]

Eliezer...

It really bothers you that a mindless, unthinking process is smarter than you, doesn't it.

I wouldn't go that far! But I do think you bias towards Faith in Flawlessness and against anything that involves randomness.

Foxes seem well-designed to catch rabbits. Rabbits seem well-designed to evade foxes... When I design a toaster oven, I don't design one part that tries to get electricity to the coils and a second part that tries to prevent electricity from getting to the coils.

Toasters are designed for simpler problems. When you need to survive overwhelming complexity/unknown unknowns/fog of war, designs relying on Feedback/Checks and Balances often survive where designs without it fail spectacularly. Examples: US founding father's design for a government; various engineering control systems; successful economic systems; protocol about feedback in science.

Human beings fake their justifications, figure out what they want using one method, and then justify it using another method.

Hmm...