wedrifid comments on What I've learned from Less Wrong - Less Wrong

79 Post author: Louie 20 November 2010 12:47PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (232)

Sort By: Controversial

You are viewing a single comment's thread. Show more comments above.

Comment author: wedrifid 30 November 2010 12:12:28AM *  0 points [-]

You of course probably realize all this already from the workshops, but I can imagine what some people here are likely to say about the small bits you've just mentioned, so I'd like to nip that in the bud if possible.

Thankyou. If someone had the gall to moralize at someone who had just broken free from the 'goodness' cage I would have been displeased, to put it mildly.

Comment author: Eugine_Nier 01 December 2010 06:31:01AM 2 points [-]

Thankyou. If someone had the gall to moralize at someone who had just broken free from the 'goodness' cage I would have been displeased, to put it mildly.

On the other hand, without further context "I have the right to feel like a good person no matter what I do" is a dangerous thing to internalize. In fact I suspect that rules, like "If I want to murder someone, I should feel like a bad person" exist in the brain using the same mechanism. Obviously this is one rule you shouldn't get rid of.

Comment author: David_Gerard 01 December 2010 09:00:28AM *  0 points [-]

Yes, it was only with pjeby's explanation that I realised "I have the right to" in this context actually means "I am not denied the right to" - I am not barred by access control list - rather than "I am justified in". Like "pride" meaning "not ashamed".

I have known too many people who do in fact use it to mean "I am automatically justified in feeling great about myself, therefore you should not criticise my behaviour." This suggests the ambiguity in wording may be problematic. (On the other hand, I suspect the process is that the conclusion is assumed and then arguments are found to justify it, so the wording may make little difference.)

Comment author: pjeby 01 December 2010 02:53:42PM 1 point [-]

Like "pride" meaning "not ashamed".

There's that, but there's also the ability to feel pride. "I have the right to feel proud when I make a mistake" means that you can be proud that you tried.

You will notice, though, that this rights stuff tends to be very controversial, in that everybody on first encountering it will tend to start listing the exceptions they think should be made, i.e., the access rights that should never be granted.

Usually (though not always), that list of exceptions is effectively an excerpt from the list of rules that are keeping them from succeeding at whatever prompted them to seek out my help in the first place. ;-)

Comment author: pjeby 01 December 2010 02:49:32PM 3 points [-]

On the other hand, without further context "I have the right to feel like a good person no matter what I do" is a dangerous thing to internalize.

Not really. Our experiences indicate that the brain's ACL system matches rules by specificity. A blanket rule change like this one will only remove the specific generalizations matched during the retrieval process, not any broader or narrower rules. (This is implied by memory reconsolidation theory, btw.)

In fact I suspect that rules, like "If I want to murder someone, I should feel like a bad person" exist in the brain using the same mechanism. Obviously this is one rule you shouldn't get rid of.

Actually, funny you should mention, because that's an ill-specified rule right there, and it's precisely the sort I would say you ought to get rid of!

Why? Because you said "if I want to murder someone". Merely wanting something bad doesn't make you a bad person. Who hasn't wanted to murder somebody, at some point in their life?

If the rule you state ("If I want to murder someone, I should feel like a bad person") were a genuine SASS rule that you'd internalized, then every time you got mad enough at somebody, you'd suppress the anger... and keep right on feeling it. Most likely, you'd have people or situations you'd avoid because you'd feel chronically stressed around them -- vaguely angry and disappointed in yourself at the same time.

Usually, though, unless you actually said you wanted to murder somebody when you were a kid, and shocked an adult into shaming you for being bad, you probably don't have an explicit SASS rule against wanting to murder people, and don't actually need one in order to avoid actually murdering people. ;-)

Negative SASS rules are compulsions that override reflective thinking and outcome anticipation; they hijack logical thought processes and direct them into motivated reasoning. Oddly enough, positive SASS rules don't seem to have the same degree of power... although it occurs to me that perhaps my current model is flawed in this description of "positive" and "negative" -- better words might be "surplus" and "deficit".

(That is, if your brain thinks a desired positive SASS quality is scarce, you can be just as compulsive in acquiring it, as you can be compulsive in avoiding things with negative SASS. However, the rules themselves seem to influence what levels are perceived as surplus or deficit, so there's a bit of recursion involved.)

Comment author: Upset_Nerd 01 December 2010 09:30:32AM *  4 points [-]

This sounds very similar to the argument against atheism where the believer is afraid that he might start to do a whole bunch of horrible things if he'll no longer fear punishment from God.

What I've noticed in my case is that yes, I now do think I could feel like a good person even if I do bad things to others. However, I now genuinely don't want to hurt other people. In a way it feels like this is the first time in my life where I'm actually able to really care for and empathise with other people since I no longer have to be so preoccupied with myself.

Comment author: pjeby 01 December 2010 02:29:06PM *  1 point [-]

What I've noticed in my case is that yes, I now do think I could feel like a good person even if I do bad things to others. However, I now genuinely don't want to hurt other people.

Yep. Motivation is not symmetric.

What used to boggle my mind about this, is how it could be that our brains are built in such a way as to seemingly automatically believe that motivation is symmetric, even though it isn't.

My working hypothesis is that the part of our brain that predicts other minds -- i.e. our built-in Theory Of Mind -- uses a symmetric model for simplicity's sake (i.e., it's easier to evolve, and "good enough" for most purposes), and that we use this model to try to predict our own future behavior when anticipating self-modification.