MichaelAnissimov comments on Open Thread, January 1-15, 2013 - Less Wrong

5 Post author: OpenThreadGuy 01 January 2013 06:09AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (333)

You are viewing a single comment's thread. Show more comments above.

Comment author: MichaelAnissimov 03 January 2013 11:58:20PM 1 point [-]

Part of the point of CEV is to make the extrapolation process good enough that future beings X won't hate the extrapolation of arbitrary past group Y. The extrapolation should be effective and broad enough that extrapolating from humans in different parts of history would not appreciably change the outcome. My guess would be that the extrapolation process itself would provide most of the content, the starting reference class being a minor variable.

Comment author: TimS 04 January 2013 12:06:16AM 1 point [-]

It would be convenient if such a process could be proven to exist and rigorously described.

Resolving that issue would do a lot to address the OPs concerns. Separately, it would be a strong reason for me to reject moral anti-realism.

What evidence do we have that such convenient extrapolation is actually possible?

Comment author: MichaelAnissimov 04 January 2013 12:32:04AM 2 points [-]

Resolving that issue is part of the overall goal of the SI, and a huge project. I'm also a moral anti-realist, by the way. CEV should be starter-insensitive w/ respect to humans from different time periods. My reasons for why I think that this is achievable in principle would be a whole post.

Comment author: TimS 04 January 2013 01:31:00AM 0 points [-]

I'd be very interested in a theory that harmonized CEV with moral anti-realism.

And you seem to believe in a very strong form of extrapolation. I'm personally skeptical that CEV(modern-humanity) would output anything, while you assert CEV(modern-humanity) = CEV(ancient Greece). Surely you don't think CEV(Clippy) = CEV(humanity).


minor terminology note: I've always used CEV and (moral) extrapolation interchangeably. If there's a reason I shouldn't do that, I'd appreciate an explanatory pointer.

Comment author: Kaj_Sotala 04 January 2013 06:06:12AM *  1 point [-]

Well, moral extrapolation is a broader category than CEV. CEV suggests, for instance, that we should also take into account the social dynamics that would influence the development of morality ("grown up farther together"), while you could conceivably also have a moral extrapolation approach which considered that irrelevant.

(One could also argue that it is the addition of social dynamics which helps justify the notion of CEV(modern-humanity) = CEV(ancient Greece), given that it was technological and social dynamics which got us from the values-of-ancient-Greece to values-of-today. Of course, that presupposes a deterministic view of history, which seems to me highly implausible. It also opens the door for all kinds of nasty social dynamics.)