Tyrrell_McAllister comments on Hacking the CEV for Fun and Profit - Less Wrong

52 Post author: Wei_Dai 03 June 2010 08:30PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (194)

You are viewing a single comment's thread.

Comment author: Tyrrell_McAllister 03 June 2010 09:04:46PM *  2 points [-]

Insofar as the Evil clones are distinct individuals, they seem to be almost entirely potentially distinct. They will need to receive more computing resources before they can really diverge into distinct agents.

I would expect CEV to give the clones votes only to the extent that CEV gives votes to potential individuals. But the number of potential clones of normal humans is even greater than Evil's trillion, even accounting for their slightly greater actuality. So, I think that they would still be outvoted.

Comment author: JoshuaZ 03 June 2010 09:43:54PM 5 points [-]

Does a pair of identical twins raised in the same environment get marginally less weight for the CEV than two unrelated individuals raised apart? If not, how do you draw the line for what degree of distinction matters?

Comment author: Baughn 03 June 2010 09:32:50PM 0 points [-]

This depends on how the AI counts humans.

I agree that it should discount similar individuals in this way, but I am not entirely sure on the exact algorithm. What should happen if, for example, there are two almost identical individuals on opposite sides of the world - by accident?