katydee comments on The Importance of Self-Doubt - Less Wrong

23 Post author: multifoliaterose 19 August 2010 10:47PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (726)

You are viewing a single comment's thread. Show more comments above.

Comment author: rwallace 20 August 2010 09:04:57AM 0 points [-]

Appealing though the belief is, the Singularity unfortunately isn't real. Nothing is going to come along and solve our problems for us, and AI is not going to be a magical exception to the rule that developing technology is hard.

Comment author: katydee 20 August 2010 10:28:13AM 2 points [-]

I'm wondering where people said AI development was going to be easy.

Comment author: wedrifid 20 August 2010 12:11:22PM 2 points [-]

I'm wondering where people said AI development was going to be easy.

Indeed. There was a post "shut up and do the impossible" for a reason!

Comment author: NancyLebovitz 20 August 2010 12:09:44PM 2 points [-]

And I'm wondering where it was said that superintelligent AI will solve all our problems.

Comment author: rwallace 21 August 2010 12:06:41AM 1 point [-]

The original idea of the SIAI was that when they (or someone else) implement superintelligent AI, it takes over the world and implements CEV (or turns everyone into paperclips or whatever). Is their current position on that also more moderate?

Comment author: ata 21 August 2010 12:12:11AM *  0 points [-]

Implementing CEV does not necessarily mean taking over the world or solving all our problems. Indeed, the whole point of CEV is that we don't know what it'll turn out to be; if we could know what its output would look like, we wouldn't need a superintelligence to figure it out for us. There was (and still is, as far as I can tell) a strong expectation that CEV will significantly remake the world, but that is a conjectured probable implication (and debating it doesn't matter too much anyway), not a definitional quality or a deductive implication.

Comment author: Vladimir_Nesov 21 August 2010 12:32:50AM 3 points [-]

That FAI will significantly change things is a pretty conclusive antiprediction. Status quo hath no moral power.

Comment author: rwallace 21 August 2010 12:55:44AM 1 point [-]

Agreed. We aren't working on new technology with the intent of letting it gather dust while people continue to suffer and die.