Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Vladimir_Nesov comments on The Fun Theory Sequence - Less Wrong

28 Post author: Eliezer_Yudkowsky 25 January 2009 11:18AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (23)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Vladimir_Nesov 25 January 2009 03:31:23PM 0 points [-]

Roko, preferences are not flat, they depend and act on the state of the world in general and on themselves in particular. They can grow very detailed, and include a state quite remote from current world as desirable. The problem with derailed aspect of transhumanism in not in remoteness from currently human, but in mistaken preferences arrived at mostly by blind leaps of imagination. We define the preferences over remote future implicitly, without being able to imagine it, only gradually becoming able to actually implement them, preserving or refining the preference through growth.