You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Desrtopa comments on SMBC comic: poorly programmed average-utility-maximizing AI - Less Wrong Discussion

9 Post author: Jonathan_Graehl 06 April 2012 07:18AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (113)

You are viewing a single comment's thread. Show more comments above.

Comment author: Desrtopa 06 April 2012 06:33:35PM 1 point [-]

At any rate, anyone whose death would go unnoticed by the monster, or whose death does not sufficiently distress the monster, would die, if the AI is to focus on average pleasure.

The AI explicitly wasn't focused on average pleasure, but on total pleasure, as measured by average pleasure times the population.

Comment author: Dmytry 06 April 2012 08:33:56PM 1 point [-]

Yep. I was just posting on what average pleasure maximizing AI would do, that isn't part of the story.