JonatasMueller comments on Arguments against the Orthogonality Thesis - Less Wrong

-7 Post author: JonatasMueller 10 March 2013 02:13AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (75)

You are viewing a single comment's thread. Show more comments above.

Comment author: JonatasMueller 11 March 2013 06:15:42PM 0 points [-]

Their motivation (or what they care about) should be in line with their rationality. This doesn't happen with humans because we have evolutionarily selected and primitive motivations, coupled with a weak rationality, but should not happen with much more intelligent and designed (possibly self-modifying) agents. Logically, one should care about what one's rationality tells.