Roko:
So this [that people become more cautious when the stakes are high] actually contradicts the paper that Eliezer cited, or at least seems to, yet it seems to ring true.
There is no contradiction. This paper shows that when stakes increase, people start thinking somewhat more accurately, but not drastically so -- which is exactly what I wrote above.
What these researchers did was not the sort of thing that triggers people's caution/normality/status-quo heuristics that I had in mind. They put people in a situation where they stood only to gain free money, and were forced to choose between several options, each with a guaranteed non-negative outcome. A study that would actually test my claims would observe people in a situation where they could lose a significant amount of their own money by accepting a bad deal based on biased reasoning.
Of course, this actually happens sometimes, for example with people who ruin themselves by compulsive gambling. But these are rare exceptions, not instances of all-pervasive systematic biases.
Feel free to PM me and claim your prize.
I don't have a Paypal account, but you can buy me a beer next time I'm over in the U.K. :-)
I'm prepared to double-or-nothing that $5 on the claim that loss aversion would kick in and they'd go insane and do even worse than in the winnings-only study.
I'm trying to better understand the relationship between incentivization and rationality, and it occurred to me that it is a "folk fact" around here that large financial incentives don't make cognitive biases go away.
However, I can't seem to find any papers that actually say this. It's not easy to google for (I have tried) so I wonder if the Less Wrong collective memory knows how to find the papers?
Is there a pattern to which biases go away with incentivization? Do we have at least 5 examples of biases that go away with incentivization and 5 examples that don't go away with incentivization?
As an incentive, I'll paypal $10 to the commenter whose answer is least biased and most useful.