Vladimir_Nesov comments on Holden's Objection 1: Friendliness is dangerous - LessWrong

11 Post author: PhilGoetz 18 May 2012 12:48AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (428)

You are viewing a single comment's thread. Show more comments above.

Comment author: Vladimir_Nesov 19 May 2012 11:14:45AM *  0 points [-]

I believe that at least one unanimous extrapolated wish exists - for (sentient) life on the planet to continue.

Maybe there are better plans that don't involve specifically "sentient" "life" continuing of a "planet", the concepts that could all be broken under sufficient optimization pressure, if they don't happen to be optimal. The simplest ones are "planet" and "life": it doesn't seem like a giant ball of simple elements could be the optimal living arrangement, or biological bodies ("life", if that's what you meant) an optimal living substrate.

Comment author: gRR 19 May 2012 11:40:34AM 0 points [-]

I assume FAI, which includes full (super-)human understanding of what is actually meant by "sentient life to continue".

Comment author: Vladimir_Nesov 19 May 2012 11:44:17AM 0 points [-]

what is actually meant by "sentient life to continue"

"Planet" is a "planet", even if you should be working on something else, which is what I meant by usual concepts breaking down.

Comment author: gRR 19 May 2012 11:49:29AM 0 points [-]

Think of "sentient life continuing on the planet" as a single concept, extrapolatable in various directions as becomes necessary. So, "planet" can be substituted by something else.