army1987 comments on Rationality Quotes November 2012 - Less Wrong

6 [deleted] 06 November 2012 10:38PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (898)

You are viewing a single comment's thread. Show more comments above.

Comment author: [deleted] 12 November 2012 09:26:15PM 2 points [-]

Is my CEV the set of things I would want given all the correct moral arguments and all the information? As opposed (probably) to be the set of things I want now?

Yes. This needn't be the same for all agents: a rock would still not want anything no matter how many correct moral arguments and how much information you gave it, so CEV<rock> is indifferent to everything. Now you and Homer are much more similar than you and a rock, so your CEVs will be much more similar, but it's not obvious to me that they are necessarily exactly identical just because you're individuals of the same species.

Comment author: Kindly 12 November 2012 10:55:55PM 1 point [-]

Technically this is just EV (extrapolated volition); then CEV is just some way of compromising between your EV and everyone else's (possibly including Homer, but presumably not including rocks).

Comment author: [deleted] 12 November 2012 09:36:23PM 0 points [-]

Thanks, I think I get it. Do you have any thoughts on my last two questions:

If so, does that mean I have to agree to disagree with an ancient greek person on moral matters? Or that, on some level, I can no longer reasonably ask whether my wanting something is good or bad?

Comment author: [deleted] 13 November 2012 08:46:00AM 0 points [-]

I'd say that would just mean that the two of you mean different things by the word good (see also TimS's comment), but for some reason I feel that would just amount to dodging the question, so I'm going to say "I don't know" instead.