Nick_Tarleton comments on How Not to be Stupid: Know What You Want, What You Really Really Want - Less Wrong

0 Post author: Psy-Kosh 28 April 2009 01:11AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (39)

You are viewing a single comment's thread. Show more comments above.

Comment author: Nick_Tarleton 29 April 2009 11:36:07PM *  1 point [-]

Yes, the question only applies to final, stable preferences – but AFAIK not everyone agrees that final, stable preferences should be totally ordered.

Comment author: MendelSchmiedekamp 30 April 2009 02:33:45AM 0 points [-]

How do you conclude that a preference is final and stable?

That seems an extremely strong statement to be making about the inner workings of your own mind.

Comment author: Nick_Tarleton 30 April 2009 06:29:53PM 1 point [-]

I don't believe any of my own preferences are final and stable. The intent is to characterize the structure that (I believe) an idealized agent would have / that the output of my morality has / that I aim at (without necessarily ever reaching).