Vladimir_Nesov comments on How to get that Friendly Singularity: a minority view - Less Wrong

12 Post author: Mitchell_Porter 10 October 2009 10:56AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (69)

You are viewing a single comment's thread. Show more comments above.

Comment author: Vladimir_Nesov 10 October 2009 09:11:46PM *  1 point [-]

A significant part of the past discussion here and in other singularity-related forums has been about verifying that our values are in fact compatible in this way. This is a necessary condition for community efforts.

Not so much. Multiple FAIs of different values (cooperating in one world) are equivalent to one FAI of amalgamated values, so a community effort can be predicated on everyone getting their share (and, of course, that includes altruistic aspects of each person's preference). See also Bayesians vs. Barbarians for an idea of when it would make sense to do something CEV-ish without an explicitly enforced contract.

Comment author: wedrifid 11 October 2009 03:24:09PM 0 points [-]

You describe one form of compatibility.

Comment author: Vladimir_Nesov 11 October 2009 03:38:38PM 0 points [-]

How so? I don't place restrictions on values, more than what's obvious in normal human interaction.