leplen comments on Mahatma Armstrong: CEVed to death. - Less Wrong

23 Post author: Stuart_Armstrong 06 June 2013 12:50PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (60)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 06 June 2013 09:23:55PM 16 points [-]

I show the sequence to the AI and say, "CEV shouldn't work like this - this is a negative example of CEV."

"Example registered," says the young AI. "Supplementary query: Identify first forbidden transition, state general rule prohibiting it?"

Comment author: leplen 07 June 2013 03:03:58AM 1 point [-]

Altruism isn't a binary.

"He decided to increase his altruism equally towards all sentient creatures."

Equality of "altruism" is impossible. Transition forbidden.