GuySrinivasan comments on SotW: Avoid Motivated Cognition - Less Wrong

20 Post author: Eliezer_Yudkowsky 28 May 2012 03:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (81)

You are viewing a single comment's thread. Show more comments above.

Comment author: GuySrinivasan 30 May 2012 07:49:51PM *  1 point [-]

I don't always have a problem with motivated cognition, but when I do, my brain usually makes it some or all of the way through the following steps:

  • Notice that I'm becoming more comfortable with (feeling safer about) a decision or action I'm about to make or just made.
  • Notice that the physical cause of my comfort is that I recently had a thought consisting of a reason the decision could have a good outcome.
  • Some brain process that I haven't pinned down yet that feels like and possibly is a mix of noticing optimization by proxy, feeling disdain for non-generalizable reasoning algorithms, and wondering about the true component strength of the reason.
  • Apply my bullshit detector to my comforting thought.
  • If appropriate, begin to legitimately think about the decision or action.

If this is a procedure that will work more generally, then these exercises may help:

Comment author: GuySrinivasan 30 May 2012 07:51:59PM 0 points [-]

Notice Rationalization Directly If you have sufficient skill at noticing rationalization such that you recognize it maybe 1+ times per day, here is an exercise that User:thejash had me do which helped my brain latch on to recognizing rationalization much more regularly: carry a pencil and a bit of paper or notebook. Every time you notice yourself rationalizing, grin and make a mark on the paper. Every time, no exceptions, for an entire week. That's all. If you must, pretend like you'll use the data for something, but it's the noticing practice itself that is useful.