ata comments on The Importance of Self-Doubt - Less Wrong

23 Post author: multifoliaterose 19 August 2010 10:47PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (726)

You are viewing a single comment's thread. Show more comments above.

Comment author: ata 21 August 2010 12:12:11AM *  0 points [-]

Implementing CEV does not necessarily mean taking over the world or solving all our problems. Indeed, the whole point of CEV is that we don't know what it'll turn out to be; if we could know what its output would look like, we wouldn't need a superintelligence to figure it out for us. There was (and still is, as far as I can tell) a strong expectation that CEV will significantly remake the world, but that is a conjectured probable implication (and debating it doesn't matter too much anyway), not a definitional quality or a deductive implication.

Comment author: Vladimir_Nesov 21 August 2010 12:32:50AM 3 points [-]

That FAI will significantly change things is a pretty conclusive antiprediction. Status quo hath no moral power.

Comment author: rwallace 21 August 2010 12:55:44AM 1 point [-]

Agreed. We aren't working on new technology with the intent of letting it gather dust while people continue to suffer and die.