wedrifid comments on Attention Lurkers: Please say hi - Less Wrong

35 Post author: Kevin 16 April 2010 08:46PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (617)

You are viewing a single comment's thread. Show more comments above.

Comment author: wedrifid 02 September 2010 08:59:33PM -2 points [-]

Surely that depends on exactly what you define "friendly" to mean.

It certainly seems to. Somewhere on my list of "ways to stop an AI from torturing me for 10 million years" is "find anyone who is in the process of creating an AI that will torture me and kill them". I'm not overly concerned what name they give it.

Comment author: RichardKennaway 02 September 2010 09:35:26PM *  0 points [-]

Since Eliezer considers it rational to prefer TORTURE to SPECKS, an FAI to his specification would presumably do the same. In either case, too bad if you're the one who gets TORTUREd. Maybe 3^^^3 people to SPECK will never be created, but what is one person compared with even the mere bazillions that FAI-assisted humanity might produce in mere billions of years? You need to make very sure you're one of the elect before creating God.

The parallels with Christian theology just keep coming. Thanks to Timeless Decision Theory, you were either saved or damned from the beginning. When you attain to the correct dispositions to be immune to counterfactual blackmail, you do not become saved, but discover that you always were. And do not delay, for "Every day brings you nearer to everlasting torments or felicity." "Your transgressions have sent up to heaven a cry for vengeance. You are actually under the curse of the Almighty." The Bible makes a lot of sense read as a garbled account of an AI that played around with the human race for a while and then went away.

Comment author: wedrifid 03 September 2010 03:45:13AM *  0 points [-]

an FAI to his specification would presumably do the same. In either case, too bad if you're the one who gets TORTUREd.

Which brings us back to... who is creating this unfriendly AI that is going to torture me and where do they live?

Comment author: RichardKennaway 03 September 2010 09:48:43AM 0 points [-]

Probably the same people who push fat people under trolleys. I wonder what sort of AI Peter Singer would want to create?