Gunnar_Zarncke comments on Natural selection defeats the orthogonality thesis - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (71)
I don't think that 'any' sufficiently intelligent agent 'clearly' would. It requires at least a solution to the cartesianism problem which is currently unsolved and not every self-optimizing process neccessarily solves this.
Any AI that doesn't will have its values drift until they drift to something that guards against value drift.
Maybe. But in that case the drift implies a selection mechanism - and in the absence of some goal in that direction natural selection applies. Those AI that don't stabilize mutate or stop.