Dmytry comments on SMBC comic: poorly programmed average-utility-maximizing AI - Less Wrong

9 Post author: Jonathan_Graehl 06 April 2012 07:18AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (113)

You are viewing a single comment's thread. Show more comments above.

Comment author: Dmytry 06 April 2012 04:03:14PM *  0 points [-]

There's no clear line between 'hiding' and 'not showing'. You can leave just a million people or so, to be put around the monster, and simply not show him the rest. It is not like the AI is making every wall into the screen displaying the suffering on the construction of pyramids. Or you can kill those people and show it in such a way that the monster derives pleasure from it. At any rate, anyone whose death would go unnoticed by the monster, or whose death does not sufficiently distress the monster, would die, if the AI is to focus on average pleasure.

edit: I think those solutions really easily come to mind when you know of what a soviet factory would do to exceed the five year plan.

Comment author: Desrtopa 06 April 2012 06:33:35PM 1 point [-]

At any rate, anyone whose death would go unnoticed by the monster, or whose death does not sufficiently distress the monster, would die, if the AI is to focus on average pleasure.

The AI explicitly wasn't focused on average pleasure, but on total pleasure, as measured by average pleasure times the population.

Comment author: Dmytry 06 April 2012 08:33:56PM 1 point [-]

Yep. I was just posting on what average pleasure maximizing AI would do, that isn't part of the story.