Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

# Jonathan_Graehl comments on Bayesian Utility: Representing Preference by Probability Measures - Less Wrong

10 27 July 2009 02:28PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Sort By: Best

Comment author: 27 July 2009 09:03:34PM 0 points [-]

Prior is an integral part of preference, and it works exactly the same way as shouldness.

Could you demonstrate? I don't understand.

The problem of choosing Bayesian priors is in general the problem of formalizing preference, it can't be solved completely without considering utility

I also don't understand what you mean above.

Comment author: 27 July 2009 09:51:37PM 1 point [-]

What is usually called "prior" is represented by measure P in the post. Together with "shouldness" Q they constitute the recipe for computing preference over events, through expected utility.

If it's not possible to choose prior more or less arbitrarily and then fill in the gaps using utility to get the correct preference, some priors are inherently incorrect for human preference, and finding the priors that admit completion to the correct preference with fitting utility requires knowledge about preference.

Comment author: 28 July 2009 05:46:18AM *  0 points [-]

Regarding your second point; I'm not sure how it's rational to choose your beliefs because of some subjective preference order.

Perhaps you could suggest a case where it makes sense to reason from preferences to "priors which make my preferences consistent", because I'm also fuzzy on the details of when and how you propose to do so.

Comment author: 28 July 2009 05:43:31AM 0 points [-]

I see - by "prior" you mean "current estimate of probability", because P was defined

I've been dealing lately with learning research where "prior" means how likely a given model of probability(outcome) is before any evidence, so maybe I was a little rigid.

In any case, I suggest you consistently use "probability" and drop "prior".