You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

steven0461 comments on CEV-inspired models - Less Wrong Discussion

7 Post author: Stuart_Armstrong 07 December 2011 06:35PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (41)

You are viewing a single comment's thread. Show more comments above.

Comment author: steven0461 07 December 2011 08:19:55PM *  1 point [-]

What do you mean by "actually want"? You seem to be coming dangerously close to the vomit fallacy: "Humans sometimes vomit. By golly, the future must be full of vomit!"

Comment author: Kaj_Sotala 07 December 2011 08:36:18PM *  0 points [-]

What do you mean by "actually want"?

Would not actually want X = would not endorse X after finding out the actual consequences of X; would not have X as a preference after reaching reflective equilibrium.

Comment author: steven0461 07 December 2011 08:45:29PM *  0 points [-]

Oh I see, by "approved ideal self" you meant something different than "self after reaching reflective equilibrium". So instead of fiddling around with revealed preferences, why not just simulate the person reaching reflective equilibrium and then ask the person what preferences he or she endorses?

Comment author: torekp 11 December 2011 02:49:49AM 1 point [-]

That was my first thought on reading the "revealed preferences" part of the post. Extrapolation first - then volition.

Comment author: Stuart_Armstrong 08 December 2011 01:22:13PM 0 points [-]

Could be done - but is harder to define (what counts as a reflective equilibrium?) and harder to model (what do you expect your reflective equilibrium?)