Dolores1984 comments on General purpose intelligence: arguing the Orthogonality thesis - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (156)
Such an agent would also not change its decision theory as a result of philosophical consideration, which potentially limits its power.
I wouldn't argue against this as written, but Stuart was claiming that convergence is "very unlikely" which I think is too strong.
Not strictly. If strongly goal'd agent determines that a different decision theory (or any change to itself) better maximizes its goal, it would adopt that new decision theory or change.