TheOtherDave comments on Open Thread: July 2010, Part 2 - Less Wrong

6 Post author: Alicorn 09 July 2010 06:54AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (770)

You are viewing a single comment's thread. Show more comments above.

Comment author: TheOtherDave 25 March 2012 04:24:45PM 0 points [-]

Doesn't CEV implicitly assert that there exists a set of moral assertions M that is more reliably moral than anything humans assert today, and that it's possible for a sufficiently intelligent system to derive M?

That sure sounds like a belief in moral progress to me.

Granted, it doesn't imply that humans left to their own devices will achieve moral progress. But the same is true of technological progress.

Comment author: wedrifid 25 March 2012 04:28:19PM 1 point [-]

Doesn't CEV implicitly assert that there exists a set of moral assertions M that is more reliably moral than anything humans assert today, and that it's possible for a sufficiently intelligent system to derive M?

The implicit assertion is "Greater or Equal", not "Greater".

Run on a True Conservative it will return the morals that the conservative currently has.

Comment author: TheOtherDave 25 March 2012 07:01:52PM 0 points [-]

Mm.
I'll certainly agree that anyone for whom that's true deserves the title "True Conservative."

I don't think I've ever met anyone who meets that description, though I've met people who would probably describe themselves that way.

Presumably, someone who believes this is true of themselves would consider the whole notion of extrapolating the target definition for a superhumanly powerful optimization process to be silly, though, and consider the label CEV to be technically accurate, in the same sense that I'm currently extrapolating the presence of my laptop, but to imply falsehoods.