JGWeissman comments on SotW: Avoid Motivated Cognition - Less Wrong

20 Post author: Eliezer_Yudkowsky 28 May 2012 03:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (81)

You are viewing a single comment's thread.

Comment author: JGWeissman 25 May 2012 06:43:00PM 10 points [-]

"Well," says Lucy, "I suppose it could have played a role in suggesting that I eat a whole chocolate cake, but the reason why I decided to do it was to support the sugar industry. Lots of people have jobs in the sugar industry, and they've been having some trouble lately."

The obvious response to Lucy is "Is buying and eating that whole choclate cake really the best way to help the sugar industry? How does it compare to other strategies, like directly giving them money?"

The generalization is that when you say you are taking action A in pursuit of goal G, ask what other actions might be more effective at achieving G.

Comment author: TheOtherDave 25 May 2012 07:14:46PM 5 points [-]

Yeah.

I also find that getting into the habit of imagining my response to the putative cause turning out not to be true can help.

That is, suppose I suddenly discover that the sugar industry is actually doing really well, but the broccoli industry is in deep financial trouble. Does my decision about the cake change in response? If not, it's likely that putative cause isn't actually causal.

Comment author: JGWeissman 25 May 2012 07:27:00PM 1 point [-]

suppose I suddenly discover that the sugar industry is actually doing really well, but the broccoli industry is in deep financial trouble. Does my decision about the cake change in response?

This is also a good response, though outside the pattern I described. It's generalization seems to be that when you are taking an action to help some group of people, ask would you take actions that similarly help some other group of people. So it is a somewhat narrower technique, applying when the goal is helping some group of people. Perhaps you could generalize it further.

Comment author: TheOtherDave 25 May 2012 07:34:14PM 2 points [-]

(nods) I would say, rather, that the generalization is that when I believe I'm taking A in response to condition C, ask whether my desire to do A would vary if C were radically altered. If changes in C don't correspond to changes in A, it's likely that A is not actually a response to C.