timtyler comments on Post Your Utility Function - Less Wrong

28 Post author: taw 04 June 2009 05:05AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (273)

You are viewing a single comment's thread.

Comment author: timtyler 05 June 2009 05:17:53PM *  1 point [-]

For a thread entitled "Post Your Utility Function" remarkably few people have actually posted what they think their utility function is.

Are people naturally secreteve about what they value? If so, why might that be?

Do people not know what their utility function is? That seems strange for such a basic issue.

Do people find their utility function hard to express? Why might that be?

Comment author: ShardPhoenix 06 June 2009 05:14:04PM *  0 points [-]

I assume that specifying your utility function is difficult for the same reasons that specifying the precise behaviour of any other aspect of your brain is difficult.

If you're talking about a conscious, explicitly evaluated utility function then I doubt even most rationalists have such a thing.

Comment author: timtyler 07 June 2009 08:25:02AM *  0 points [-]

I wasn't expecting the ten significant figures.

To be able to say what a utility function is, you have to be conscious of it. It has to be evaluated - or else it isn't your utility function. However, I am not sure that I know what you mean by "explicitly evaluated".

In many cases, behaviour is produced unconsciously. The idea is more that a utility function should be consistent with most goal-oriented behaviour. If you claim that your goal in life is to convert people to Christianity, then you should show signs of actually trying to do that, as best you are able.