ata comments on Human values differ as much as values can differ - Less Wrong

13 Post author: PhilGoetz 03 May 2010 07:35PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (205)

You are viewing a single comment's thread. Show more comments above.

Comment author: ata 06 May 2010 08:06:09AM *  1 point [-]

I wonder if, under the current plan, CEV would take into account people's volition about how CEV should work — i.e. if the extrapolated human race would want CEV to exclude the preferences of sociopaths/psychopaths/other moral mutants, would it do so, or does it only take into account people's first-order volition about the properties of the FAI it will build?

Comment author: Vladimir_Nesov 06 May 2010 11:11:34AM 1 point [-]

Ultimately, preference is about properties of the world, and AI with all its properties is part of the world.