Nick Beckstead has this to say in his dissertation on decision theory and x-risk:
we never hear about people who get money pumped. Why? One possibility is that people never get offered these trades that would trigger money pumps. A more plausible answer is that people do not act on their preferences in the inexible way this argument assumes. When they get into a situation where they see that their preferences would lead them to get money pumped, they either change their preferences or refuse to continue to act on some of those preferences. Because of this, money pump arguments do not illustrate a practical danger for humans. It is plausible that having preferences which would be theoretically susceptible to a money pump displays a failure of perfect rationality, but, once again, that a certain approach is imperfect does not imply that an improved approach is meaningfully available.
Very interesting! I actually started having similar thoughts about money pumps and utility functions after learning Haskell. Specifically, that you can avoid the intransitivity -> money-pumpable implication if you just assume (quite reasonably) that humans' utility functions are lazily evaluated and have side effects (i.e. are impure functions).
In other words, humans don't instantly know the implication of their utility function for every possible decision (which would imply logical omniscience), but rather, evaluate it only as the need arises; and on...
Intransitive preferences are a demonstrable characteristic of human behaviour. So why am I having such trouble coming up with real-world examples of money-pumping?
"Because I'm not smart or imaginative enough" is a perfectly plausible answer, but I've been mulling this one over on-and-off for a few months now, and I haven't come up with a single example that really captures what I consider to be the salient features of the scenario: a tangled hierarchy of preferences, and exploitation of that tangled hierarchy by an agent who cyclically trades the objects in that hierarchy, generating trade surplus on each transaction.
It's possible that I am in fact thinking about money-pumping all wrong. All the nearly-but-not-quite examples I came up with (amongst which were bank overdraft fees, Weight Watchers, and exploitation of addiction) had the characteristics of looking like swindles or the result of personal failings, but from the inside, money-pumping must presumably feel like a series of gratifying transactions. We would want any cases of money-pumping we were vulnerable to.
At the moment, I have the following hypotheses for the poverty of real-world money-pumping cases:
Does anyone have anything to add, or any good/arguable cases of real-world money-pumping?