You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

ShardPhoenix comments on In favour of a selective CEV initial dynamic - Less Wrong Discussion

12 [deleted] 21 October 2011 05:33PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (110)

You are viewing a single comment's thread.

Comment author: ShardPhoenix 22 October 2011 01:02:17PM *  3 points [-]

I don't see why the FAI creators would base the CEV on anyone other than themselves except to the extent that they need to do so for political reasons. The result of this would by definition be optimal for the creators.

Comment author: [deleted] 22 October 2011 04:59:46PM *  2 points [-]

I don't see why the FAI creators would base the CEV on anyone other than themselves except to the extent that they need to do so for political reasons. The result of this would by definition be optimal for the creators.

No, not "by definition". I advised against that idea specifically in the penultimate paragraph of my essay. One reason for this is that the programmers are not infallible, therefore if they face more challenges in programming a dynamic that can cope with one specific group of people in comparison to another group of people, then there's no reason why the output of from a CEV dynamic including the second group should not be closer to the output of an ideal CEV including the first group.

Another reason: we generally consider individual humans to have interests - not groups of humans. To take the extreme case as a sufficient disproof, an FAI programmer would prefer the CEV to include 1000 kind people not including himself, rather than himself and 999 psychopaths.

The FAI programming group or any other group should not be reified as having interests of its own (as in "optimal for the creators").

In any case, "if my Auntie had..." - political reasons do exist!

Comment author: ShardPhoenix 22 October 2011 11:17:26PM *  1 point [-]

Your first paragraph seems like a technical issue that may or may not apply in practice, not something that really gets at the heart of CEV. For the second paragraph, I guess I was thinking of the limiting case of there being a single creator of the FAI. With groups, it presumably depends on the extent to which you believe (or can measure) that the average individual from some other group is a better match for your CEV than your FAI co-workers are. But if that's the case then those co-workers will want to include different groups of their own!

I do agree that political issues may be very important in practice though - for example, "we'll fund you only if you include such-and-such people's CEV".

Comment author: lessdazed 22 October 2011 01:33:38PM 1 point [-]

Considering your other comments, I'm confident you can answer this for yourself with a few hundred seconds worth of thought.

Comment author: ShardPhoenix 22 October 2011 02:26:28PM *  0 points [-]

What is that supposed to mean? (It sounds like an oblique insult but I don't want to jump to negative conclusions).

Comment author: lessdazed 22 October 2011 04:38:44PM 2 points [-]

It was intended as the opposite.