lavalamp comments on The Backup Plan - Less Wrong

1 Post author: Luke_A_Somers 13 October 2011 07:53PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (35)

You are viewing a single comment's thread.

Comment author: lavalamp 13 October 2011 09:07:15PM 7 points [-]

Or the uFAI might just decide to pretend to be Friendly for the whole three or four days it takes to do all the things it needs our help with, and it reading stuff written by us about Friendliness will just make it more convincing. Or it could not bother and just fool us into doing that stuff via easier methods.

Could a chimp give you reasons to self-modify to implement Chimp CEV? What would they be, "if you let lots of us chimps exist, we'll help you do something you want to do!"

Comment author: Luke_A_Somers 13 October 2011 11:05:56PM *  0 points [-]

Alice may be unstable to paperclippery, but isn't out to kill all humans (yet). This obviously won't help with actively malicious AIs.

And if chimps had all the advantages - my only means of reproduction, say, and also all of the tools and a substantial body of knowledge that it would be annoying to have to replicate, and also I'm bound hand and feet - then that sounds like a pretty good deal. Actually, if they were to offer me that right now, I'd do it freely (though I don't really have any tasks I'd need them for). I have nothing against chimps.

Comment author: pedanterrific 14 October 2011 12:21:47AM *  9 points [-]

I have nothing against cows, either. It's not their fault they're delicious.

Comment author: lavalamp 14 October 2011 04:36:19AM 2 points [-]

And if chimps had all the advantages - my only means of reproduction, say, and also all of the tools and a substantial body of knowledge that it would be annoying to have to replicate, and also I'm bound hand and feet - then that sounds like a pretty good deal.

But there's no reason for you to respect that after you had gotten whatever you need from them, unless that sort of respect is built into you.

Actually, if they were to offer me that right now, I'd do it freely

There's no reason to believe arbitrary AIs would have a similar cognitive algorithm.

Comment author: Luke_A_Somers 14 October 2011 03:34:08PM 0 points [-]

You did ask about me, specifically…