Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

atucker comments on Strategic ignorance and plausible deniability - Less Wrong

36 Post author: Kaj_Sotala 10 August 2011 09:30AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (55)

You are viewing a single comment's thread.

Comment author: atucker 10 August 2011 02:55:27PM *  11 points [-]

I have two standards of trust.

The first one is trusting that someone's goals are aligned with mine, and that they don't intentionally do anything bad.

The second one is trusting that someone's actions are going to be lined up with their intentions, and that they will take the initiative to ensure this.

The second is much harder to earn, but can be earned without needing to necessarily have my goals.

Comment author: randallsquared 11 August 2011 04:57:44PM 0 points [-]

From the outside, it's not clear that we can do any better than saying that someone's intentions are nearly always lined up with their actions. Or, to do better than that, we have to side with a part of them as their "true self". But the idea that someone else's goals are aligned with yours is nearly always going to be false except for some very limited set of goals.

Comment author: smk 13 August 2011 04:22:43PM 2 points [-]

I kind of thought it went without saying that atucker was talking about a limited set of goals being aligned?

As a shorthand I have always tended to look at trust on two levels, which seem similar to atucker's but perhaps not the same? That is: I trust your intentions (in the relevant area), and I trust your competence (in that area). There's also the issue of diligence, which is a kind of competence and also a kind of intention, so that can complicate things perhaps, but for simplicity I just look at it as two levels.

Comment author: atucker 14 August 2011 02:05:30AM *  -1 points [-]

Well, that was what I meant at least. That it was a limited set of alignment.

Also, I'm pretty sure that most naive morality assumes that people have a true self that is being dealt with. Revealed preferences are a pretty new idea, if I understand correctly, and people tend to get annoyed and defensive when it's brought up.