nerzhin comments on Trying to hide bad signaling? To the Dark Side, lead you it will. - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (51)
If you're classifying the intentional use of human biases as wrong in a terminal moral sense, there's not much more to be said other than that I don't share your moral values, not even when you format them in italics.
If you're instead claiming they are wrong in some instrumental sense -- that is, that they lead to bad results -- I'd like to understand how you derive that.
In other words: suppose I want to convince people to do something, or to stop doing something, or to feel a certain way or stop feeling a certain way, or some other X. Suppose I then convince people to X by using the "dark arts" and "exploiting the biases of others."
For example, suppose I want someone to think that making use of human biases is a bad thing, and so I label that activity using words with negatively weighted denotations like "exploit" and "dark."
What have I made worse, by so doing?
Let's say I'm working with Bob. By exploiting his cognitive biases, I can convince him to do two things that I value. Without such exploitation, I can only convince him to do one. If I do exploit his biases, these bad things happen:
I have less confidence that either of the two things were actually worthwhile.
It is more likely that my enemy will be able to convince Bob to undo the valuable things he did.
I have less trust in Bob in the future, and his total value to me is reduced.
In some cases these effects might outweigh the value of getting two things done rather than one.
I agree that manipulating Bob makes it hard to rely on Bob for "sanity checks" of my motives, and that that's a significant loss if Bob would otherwise have been useful in that capacity.
And I can sorta see how it might be true in some cases that manipulating Bob might render him more manipulable by others, and therefore less valuable to me, than he would have been had I not manipulated him. (I have trouble coming up with a non-contrived example, though, so I'm not convinced.)
So, yes, agreed: in cases like those, it makes things worse.
Nobody doubts that doing stupid or ill-considered things with the dark arts could have undesirable consequences.
Note: the parent is another example of a dark arts persuasion technique.
I think your problem, is you have too broad a notion of what constitutes "dark arts".
I don't accept disagreement with Eugine_Nier as a 'problem'.
There is a time and a place for each of the following:
Further, there are instances in each category where the use of dark arts is pro-social. It seems that the term 'dark arts' has become a hindrance to understanding instead of a help. It does not mean evil!