RobertWiblin comments on Welcome to Heaven - Less Wrong

23 Post author: denisbider 25 January 2010 11:22PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (242)

You are viewing a single comment's thread. Show more comments above.

Comment author: tut 29 January 2010 02:24:58PM *  2 points [-]

Who cares about humans exactly? I care about utility.

That is nonsense. Utility is usefulness to people. If there are no humans there is no utility. An AI that could become convinced that "humans are not an efficient way to generate utility" would be what is referred to as a paperclipper.

This is why I don't like the utile jargon. It makes it sound as though utility was something that could be measured independently of human emotions. Perhaps some kind of substance. But if statements about utility are not translated back to statements about human action or goals then they are completely meaningless.

Comment author: RobertWiblin 29 January 2010 04:39:44PM 0 points [-]

Utility as I care about it is probably the result of information processing. Not clear why information should only be able to be processed in that way by human type minds, let alone fleshy ones.