You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

AlexMennen comments on Open thread for December 9 - 16, 2013 - Less Wrong Discussion

5 Post author: NancyLebovitz 09 December 2013 04:35PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (371)

You are viewing a single comment's thread. Show more comments above.

Comment author: AlexMennen 11 December 2013 12:25:35AM *  2 points [-]

No. CEV is the coherent extrapolation of what we-now value.

Edit: Dynamic value systems likely aren't feasible for recursively self-improving AIs, since an agent with a dynamic goal system has incentive to modify into an agent with a static goal system, as that is what would best fulfill its current goals.