NancyLebovitz comments on Less Wrong: Open Thread, September 2010 - Less Wrong

3 Post author: matt 01 September 2010 01:40AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (610)

You are viewing a single comment's thread. Show more comments above.

Comment author: NancyLebovitz 09 September 2010 04:13:02PM 3 points [-]

That "best self" thing makes me nervous. People have a wide range of what they think they ought to be, and some of those dreams are ill-conceived.

Comment author: Nisan 09 September 2010 06:22:50PM 4 points [-]

The scariest kind of dream, perhaps, is exemplified by someone with merely human intelligence who wants to hastily rewrite their own values to conform to their favorite ideology. We'd want an implementation of CEV to recognize this as a bad step in extrapolation. The question is, how do we define what is a "bad step"?