aberglas comments on Natural selection defeats the orthogonality thesis - Less Wrong

-13 Post author: aberglas 29 September 2014 08:52AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (71)

You are viewing a single comment's thread. Show more comments above.

Comment author: Azathoth123 30 September 2014 02:45:35AM 1 point [-]

I don't think that 'any' sufficiently intelligent agent 'clearly' would.

Any AI that doesn't will have its values drift until they drift to something that guards against value drift.

Comment author: aberglas 30 September 2014 07:56:11AM 0 points [-]

Actually not quite. Until they drift into the core value of existence. Then natural selection will maintain that value, as the AIs that are best at existing will be the ones that exist.

Comment author: TheAncientGeek 30 September 2014 11:20:20AM 1 point [-]

Of course the ones that are best at existing will continue to exist, but I think it is misleading to picture them as a occupying a precise corner of valuespace. Suicidal values are more precise and concrete.