Qiaochu_Yuan comments on A Difficulty in the Concept of CEV - Less Wrong

5 [deleted] 27 March 2013 01:20AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (23)

You are viewing a single comment's thread. Show more comments above.

Comment author: Qiaochu_Yuan 27 March 2013 02:10:51AM 2 points [-]

I gather a group of people, brainwash them to have some arbitrary collection of values, then somehow turn them into utility monsters?

Comment author: hairyfigment 29 March 2013 07:14:45PM -1 points [-]

I was thinking, 'Find the person with the desires you can most easily satisfy - or whose desires allow the construction of the most easily-satisfied successor to the throne - and declare that person the utility monster by a trick of measurement.' But I don't think I quite understand the problem at hand. Eliezer sounds like he has in mind measurement-scheme criteria that would rule this out (as extrapolating the people who exist before the AI hopefully rules out brainwashing).