Will_Newsome comments on Is Rationality Maximization of Expected Value? - Less Wrong

-23 Post author: AnlamK 22 September 2010 11:16PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (64)

You are viewing a single comment's thread. Show more comments above.

Comment author: Will_Newsome 23 September 2010 12:33:06AM 1 point [-]

What does that mean for coming to a reflective equilibrium about ethics?

Are you talking about CEV? Civilization as we know it will end long before people agree about metaethics.

Comment author: Will_Sawin 25 September 2010 12:17:42AM 1 point [-]

Before CEV, we have to do a rough estimate of our personal extrapolated volition so we know what to do. One way to do this is to extrapolate our volition as far as we can see by, e.g., thinking about ethics.

I intuitively feels that X is good and Y is bad. I believe morality will mostly fit my intuitions. I believe morality will be simple. I know my intuitions, in this case, are pretty stupid. I can't find a simple system that fits my intuitions here. What should I do? How much should I suck up and take the counterintuitiveness? How much should I suck up and take complex morality?

These are difficult questions.