You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Risto_Saarelma comments on Article about LW: Faith, Hope, and Singularity: Entering the Matrix with New York’s Futurist Set - Less Wrong Discussion

31 Post author: malo 25 July 2012 07:28PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (231)

You are viewing a single comment's thread. Show more comments above.

Comment author: Risto_Saarelma 28 July 2012 03:21:59PM 1 point [-]

If the sufficiently advanced technology is indistinguishable from magic, the arguments about "sufficiently advanced AI system" in absence of actual definition what it is, are indistinguishable from magical thinking.

Ok, then, so the actual problem is that the people who worry about AIs that behave psychopatically have such a capable definition for AI that you consider them basically speaking nonsense?

Comment author: private_messaging 28 July 2012 03:52:04PM *  0 points [-]

The "sufficiently advanced" in their argumentations means "sufficiently advanced in the direction of making my argument true" and nothing more.

If I adopt pragmatic version of "advancedness", then the software (algorithms) that are somehow magically made to* self identify with it's computing substrate, is less advanced, unless it is also friendly or something.

  • we don't know how to do that yet. edit: and some believe that it would just fall out of general smartness somehow, but i'm quite dubious about that.