MoreOn comments on Doublethink (Choosing to be Biased) - Less Wrong

33 Post author: Eliezer_Yudkowsky 14 September 2007 08:05PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (161)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: Desrtopa 13 December 2010 01:07:55AM *  0 points [-]

Rather than there being a discrete point above which you will be able to enjoy the party and below which you will not, I would expect the amount you enjoy the party to vary according to the grade you got, unless the cutoff point is due to some additional consequence of scoring below that grade which will be accompanied by an additional utility hit. Your prior expected utility would incorporate the chance of taking that additional hit times the likelihood of it occurring.

Anyway, in any specific case, your utility may go up or down by checking your grade, but if you have a perfectly accurate assessment of the probability distribution for your grade, then on average your expected utility should be the same whether you check or not.

In this case, the fact that we know the actual grade stands to be misleading, since it's liable to make any probability distribution that doesn't provide an average expected grade of 1.7 look wrong, even though that might not be the average predicted by the available data.

Comment author: MoreOn 14 December 2010 05:14:06AM 0 points [-]

I considered your point at length. To address your comment, I could use the ignorance hypothesis on my old model, assigning equal probability values to everything between 1.7 and 4.0. Discrete if need be. I could use a binary output value as "enjoying the party," 1 or 0. I could do lots of other tweaks.

But the problem here is, everything comes down to whether this model (or any other 5-minute model) is good enough to explain my non-rationalist gut feeling, especially without an experiment. And, you know, I'm not about to fail an easy exam in a couple of days just to see what my utility function would do.

Comment author: Desrtopa 14 December 2010 06:58:17AM 1 point [-]

Conservation of expected evidence means that ideally, you can't expect the introduction of new evidence to affect your expected utility. In practice, that's probably not the case, but humans aren't even rough approximations of ideal rationalists.