You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

skilesare comments on In what language should we define the utility function of a friendly AI? - Less Wrong Discussion

3 Post author: Val 05 April 2015 10:14PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (22)

You are viewing a single comment's thread. Show more comments above.

Comment author: skilesare 07 April 2015 02:35:15PM 0 points [-]

Lets think about it as information theory. If there are 5 different types of 'information' that different people are listening for, then we need to reduce the entropy in 5 different channels to get the right information signals. This is much more complicated than trying to just reduce the entropy around 1 thing.

Maybe language isn't the best term, but all 5 of the information sets are important in different amounts to different human beings. So your utility function is going to get messy.