DSimon comments on Rationally Irrational - Less Wrong

-11 Post author: HungryTurtle 07 March 2012 07:21PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (414)

You are viewing a single comment's thread. Show more comments above.

Comment author: DSimon 16 April 2012 03:57:53AM *  0 points [-]

In regards to why it's possible, I'll just echo what TheOtherDaveSaid.

The reason it's helpful to try for a single top-level utility function is because otherwise, whenever there's a conflict among the many many things we value, we'd have no good way to consistently resolve it. If one aspect of your mind wants excitement, and another wants security, what should you do when you have to choose between the two?

Is quitting your job a good idea or not? Is going rock climbing instead of staying at home reading this weekend a good idea or not? Different parts of your mind will have different opinions on these subjects. Without a final arbiter to weigh their suggestions and consider how important comfort and security are relative to each other, how do you do decide in a non-arbitrary way?

So I guess it comes down to: how important is it to you that your values are self-consistent?

More discussion (and a lot of controversy on whether the whole notion actually is a good idea) here.

Comment author: TheOtherDave 16 April 2012 01:01:21PM 1 point [-]

Without a final arbiter to weigh their suggestions and consider how important comfort and security are relative to each other, how do you do decide in a non-arbitrary way?

Well, there's always the approach of letting all of me influence my actions and seeing what I do.

Comment author: HungryTurtle 18 April 2012 12:44:35PM 0 points [-]

Thanks for the link. I'll respond back when I get a chance to read it.