Gunnar_Zarncke comments on Natural selection defeats the orthogonality thesis - Less Wrong

-13 Post author: aberglas 29 September 2014 08:52AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (71)

You are viewing a single comment's thread. Show more comments above.

Comment author: Azathoth123 30 September 2014 02:45:35AM 1 point [-]

I don't think that 'any' sufficiently intelligent agent 'clearly' would.

Any AI that doesn't will have its values drift until they drift to something that guards against value drift.

Comment author: Gunnar_Zarncke 30 September 2014 09:58:15AM 0 points [-]

Maybe. But in that case the drift implies a selection mechanism - and in the absence of some goal in that direction natural selection applies. Those AI that don't stabilize mutate or stop.