Patrick_(orthonormal) comments on You Provably Can't Trust Yourself - Less Wrong

18 Post author: Eliezer_Yudkowsky 19 August 2008 08:35PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (18)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Patrick_(orthonormal) 19 August 2008 11:54:11PM 0 points [-]

I agree— and I balk at the concept of "the" Coherent Extrapolated Volition precisely because I suspect there are many distinct attractors for a moral framework like ours. Since our most basic moral impulses come from the blind idiot god, there's no reason for them to converge under extrapolation; we have areas of agreement today on certain extrapolations, but the convergence seems to be more a matter of cultural communication. It's not at all inconceivable that other Everett branches of Earth have made very different forms of moral progress from us, no less consistent with reason or consequences or our moral intuitions.

I'd be very interested, of course, to hear Eliezer's reasons for believing the contrary.