Ben_Jones comments on Rationality Quotes 5 - Less Wrong

6 Post author: Eliezer_Yudkowsky 23 January 2008 06:00PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (15)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Ben_Jones 25 January 2008 01:35:47PM 1 point [-]

Gutz, I think the idea is that if you set your goal any lower than perfection, you are creating a glass ceiling for yourself. Yahl doesn't need or expect you to attain perfection, and you won't have failed if you don't. You just can't settle for anything less.

Especially important to bear in mind when building an AGI. Setting terminal goals lower than what might be possible is the ultimate millennium bug. Except this time planes might actually fall out of the sky.