XiXiDu comments on The curse of identity - LessWrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (296)
"Efficiency" at achieving something other than what you should work towards is harmful. If it's reliable enough, let your conscious mind decide if signaling advantages or something else is what you should be optimizing. Otherwise, you let that Blind Idiot Azathoth pick your purposes for you, trusting it more than you trust yourself.
The purpose of solving friendly AI is to protect the purposes picked for us by the blind idiot god.
Our psychological adaptations are not our purposes, we don't want to protect them, even though they contribute to determining what it is we want to protect. See Evolutionary Psychology.