Here's the new thread for posting quotes, with the usual rules:
- Please post all quotes separately, so that they can be voted up/down separately. (If they are strongly related, reply to your own comments. If strongly ordered, then go ahead and post them together.)
- Do not quote yourself.
- Do not quote comments/posts on LW/OB.
- No more than 5 quotes per person per monthly thread, please.
"Proving useful in your life" (but not necessarily "proving beneficial") is the core of instrumental rationality, but what's useful is not necessarily what's true, so it's important to refrain from using that metric in epistemic rationality.
Example: cognitive behavioral therapy is often useful "to solve problems concerning dysfunctional emotions", but not useful for pursuing truth. There's also mindfulness-based cognitive therapy for an example more relevant to Buddhism.
I suppose that is a tension between epistemic and instrumental rationality.
Put in terms of a microeconomic trade-off: The marginal value of having correct beliefs diminishes beyond a certain threshold. Eventually, the marginal value of increasing one's epistemic accuracy dips below the marginal value that comes from retaining one's mistaken belief. At that point, an instrumentally rational agent may stop increasing accuracy.
On the other hand, it may be a problem of local-versus-global optima: The marginal value of accuracy may creep up again. Or maybe those who see it as a problem can fix it with the right augmentation.