Michael_Howell comments on The Power of Reinforcement - Less Wrong

96 Post author: lukeprog 21 June 2012 01:42PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (467)

You are viewing a single comment's thread. Show more comments above.

Comment author: [deleted] 21 June 2012 07:36:11PM 3 points [-]

I think it's misguided personally. You're already being manipulated this way by your environment whether or not you realize it.

Comment author: [deleted] 21 June 2012 07:51:48PM 2 points [-]

You're already being manipulated this way by your environment whether or not you realize it.

Well, I'm claiming that this kind of manipulation is often, even characteristically, unethical. Since my environment is not capable of being ethical or unethical (that would be a category mistake, I think) then that's not relevant to my claim.

Comment author: [deleted] 21 June 2012 07:59:07PM 1 point [-]

I was referring though to the case of your friend using reinforcement to alter your behavior in a way that would benefit you. I just have a hard time seeing someone trying to help you as an unethical behavior.

Comment author: AdeleneDawner 21 June 2012 11:42:58PM 1 point [-]

I just have a hard time seeing someone trying to help you as an unethical behavior.

It does depend on whose definition of 'help' they're using.

Comment author: [deleted] 22 June 2012 12:08:15AM 0 points [-]

Good point. Do you think it would be ethical if they were helping to fulfill your preferences?

Comment author: AdeleneDawner 22 June 2012 01:07:58AM 0 points [-]

Usually, yes, though there are several qualifications and corner cases.

Comment author: [deleted] 22 June 2012 06:09:15AM 0 points [-]

Agreed, there probably are.

Comment author: [deleted] 22 June 2012 01:37:57AM 0 points [-]

That's fair. I should tone down my point and say that doing this sort of thing is disrespectful, not evil or anything. Its the sort of thing parents and teachers do with kids. With your peers, unsolicited reinforcement training is seen as disrespectful because it stands in leau of just explaing to the person what you think they should be doing.

Comment author: TheOtherDave 22 June 2012 01:55:32AM 0 points [-]

In my experience, telling other people how I think they should behave is also often seen as disrespectful.

Comment author: [deleted] 22 June 2012 02:03:44AM 0 points [-]

Often it is, we agree. But it's the 'telling' there that's the problem. A respectful way to modify someone's behavior is to convince them to do something different (which may mean convincing them to subject themselves to positive reinforcement training). The difference is often whether we appeal to someone's rationality, or take a run at their emotions.

Comment author: TheOtherDave 22 June 2012 02:28:36AM 1 point [-]

A respectful way to modify someone's behavior is to convince them to do something different

I agree that there are respectful ways to convince me to do something different, thereby respectfully modifying my behavior.
Many of those ways involve appealing to my rationality.
Many of those ways involve appealing to my emotions.

There are also disrespectful ways to convince me to do something different.
Many of those ways involve appealing to my rationality.
Many of those ways involve appealing to my emotions.

Comment author: [deleted] 22 June 2012 02:39:06AM 1 point [-]

There are also disrespectful ways to convince me to do something different. Many of those ways involve appealing to my rationality.

So, by 'appealing to someone's rationality' I mean, at least, arguing honestly. Perhaps I should have specified that. Do you still think there are such examples?

Comment author: TheOtherDave 22 June 2012 03:37:13AM 0 points [-]

Do I think there are disrespectful ways to convince me to do something different that involve arguing honestly? Sure. Do you not?

Comment author: [deleted] 22 June 2012 03:52:08PM *  0 points [-]

Not that I can think of, no. Can you think of an example?

Comment author: [deleted] 22 June 2012 06:08:40AM 1 point [-]

Well this runs into the problem of giving unsolicited advice. Most people don't respond well to that. I think it's probably difficult for most rationalists to remember this since we are probably more open to that.

Comment author: pjeby 22 June 2012 08:53:09PM 0 points [-]

Well this runs into the problem of giving unsolicited advice. Most people don't respond well to that. I think it's probably difficult for most rationalists to remember this since we are probably more open to that.

Not really. Rationalists are just open to different advice. There's lots of advice rationalists will reject out of hand. (Some of which is actually bad advice, and some of which is not.)

Everyone believes themselves to be open-minded; the catch is that we're all open to what we're open to, and not open to what we're not.

Comment author: Dolores1984 22 June 2012 09:38:08PM 0 points [-]

This feels like an equivocating-shades-of-grey argument, of the form 'nobody is perfectly receptive to good arguments, and perfectly unswayed by bad ones, therefore, everyone is equally bad at it.' Which is, of course, unjustified. In truth, if rationalists are not at least somewhat more swayed by good arguments than bad ones (as compared to the general population), we're doing something wrong.

Comment author: pjeby 23 June 2012 01:35:31AM *  1 point [-]

Which is, of course, unjustified. In truth, if rationalists are not at least somewhat more swayed by good arguments than bad ones (as compared to the general population), we're doing something wrong.

Not really, we're just equally susceptible to irrational biases.

Trivial proof for LW rationalists: read any LW thread regarding a controversial self-improvement topic, including nutrition, exercise, dating advice, etc., where people are diametrically opposed in their positions, using every iota of their argumentative reasoning power in order not to open themselves to even understanding their opponents' position, let alone reasoning about it. It is extremely improbable that all divisive advice (including diametrically-opposed divisive advice) is incorrect, and therefore the bulk of LW rationalists are correctly rejecting it.

(Side note: I didn't say anything about receptiveness to good arguments, I said receptiveness to unsolicited advice, as did the comment I was replying to. I actually assumed that we were talking about bad arguments, since most arguments, on average, are bad. My point was more that there are many topics which rationalists will reject out of hand without even bothering to listen to the arguments, good or bad, and that in this, they are just like any other human being. The point isn't to invoke a fallacy of the grey, the point is for rationalists not to pat ourselves on the back in thinking we're demonstrably better at this than other human beings: demonstrably, we're not.)

Comment author: TheOtherDave 22 June 2012 09:05:42PM 0 points [-]

It amuses me how readily my brain offered "I am not neither open-minded!" as a response to that.

Comment author: [deleted] 23 June 2012 01:44:13AM 0 points [-]

Well I agree that none of us is completely rational when it comes to accepting advice. But don't you think rationalists are at least better at that than most people?

Comment author: pjeby 23 June 2012 03:20:01PM 0 points [-]

But don't you think rationalists are at least better at that than most people?

Based on what evidence?

Comment author: adamtpack 23 June 2012 02:17:57AM 0 points [-]

But your environment includes people, dude.

This shouldn't be a puzzle. Reinforcement happens, consciously or subconsciously. Why in the name of FSM would you choose to relinquish the power to actually control what would otherwise happen just subconsciously?

How is that not on the face of it a paragon, a prototype of optimization? Isn't that optimizing is, more or less-consciously changing what is otherwise unconscious?