skilesare comments on In what language should we define the utility function of a friendly AI? - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (22)
Lets think about it as information theory. If there are 5 different types of 'information' that different people are listening for, then we need to reduce the entropy in 5 different channels to get the right information signals. This is much more complicated than trying to just reduce the entropy around 1 thing.
Maybe language isn't the best term, but all 5 of the information sets are important in different amounts to different human beings. So your utility function is going to get messy.