paulfchristiano comments on [SEQ RERUN] Zut Allais! - Less Wrong

3 Post author: MinibearRex 27 December 2011 05:13AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (26)

You are viewing a single comment's thread. Show more comments above.

Comment author: paulfchristiano 27 December 2011 07:28:14PM *  8 points [-]

We observe two biases simultaneously:

"How silly to treat the difference between 97% and 100% so much differently than the difference between 33% and 34%!"

"How silly to assign 97% probability to things that only happen 70% of the time!"'

You don't get introspective access to the probabilities your brain is implicitly using, so this sort of error is unsurprising. Natural selection isn't going to do anything about it until people start making serious decisions on the basis of explicit expected value calculations.

Comment author: see 27 December 2011 08:09:53PM 4 points [-]

Okay, this explanation works!

Without access to the math, we estimate probability into wide bands ("always", "usually", "sometimes", "never") and evolutionarily favor the "always" band because it is a lot less likely to have us wind up starving, and how could we save the excess from a jackpot win anyway on the savannah? When we then learn math, we learn that 99%, which before math we would count as "always" in our intuitive system, isn't actually always, and now our half-educated intuitive system treats it as a "usually". What we then need to do is ignore the intuitive system in favor of the mathematical learning of payoffs.

Okay, I'm happy with that.