mapnoterritory comments on The Power of Reinforcement - Less Wrong

96 Post author: lukeprog 21 June 2012 01:42PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (467)

You are viewing a single comment's thread.

Comment author: mapnoterritory 21 June 2012 07:30:51PM *  9 points [-]

Daniel Kahneman in Thinking, Fast and Slow:

I had stumbled onto a significant fact of the human condition: the feedback to which life exposes us is perverse. Because we tend to be nice to other people when they please us and nasty when they do not, we are statistically punished for being nice and rewarded for being nasty.

There reason for that lies in regression to the mean when training (example of flight instructors in the israel airforce):

I pointed out to the instructors that what they saw on the board coincided with what we had heard about the performance of aerobatic maneuvers on successive attempts: poor performance was typically followed by improvement and good performance by deterioration, without any help from either praise or punishment.

Since positive reinforcement is so counterintuitive: don't forget to reward yourself for rewarding somebody for good behaviour! :)

Comment author: faul_sname 22 June 2012 01:47:15AM 9 points [-]

Speaking of regression to the mean, that seems to be one topic that wasn't really covered in the sequences that really should have been.

Comment author: Eugine_Nier 22 June 2012 04:44:33AM 0 points [-]

I had stumbled onto a significant fact of the human condition: the feedback to which life exposes us is perverse. Because we tend to be nice to other people when they please us and nasty when they do not, we are statistically punished for being nice and rewarded for being nasty.

So you (or at least Kahneman) implicitly admit that punishment is effective at changing behavior.

Comment author: mapnoterritory 22 June 2012 06:48:19AM *  1 point [-]

Yes, I think so and apparently so does Kahneman. I don't think this is particularly controversial. Kahneman does say that positive reinforcement is more efficient (both in animals and humans).

Comment author: Vaniver 22 June 2012 05:33:55AM *  1 point [-]

Everyone who's looked at the data thinks that punishment can change behavior. The question is whether punishment makes the changes you want- and people dramatically overestimate the usefulness of punishment and dramatically underestimate the usefulness of positive reinforcement.

Comment author: Viliam_Bur 22 June 2012 10:23:10AM *  4 points [-]

The question is whether punishment makes the changes you want

Also it depends on the definition of what you "want" -- for example if you punish someone for bad behavior, what exactly is your goal?

  • to help them improve their behavior?
  • to signal to other people that you care?
  • to have higher status that the punished person?

All three goals are pleasant, though only the first one is officially desirable. The punishment works in all directions. Perhaps this is the reason why behavior change by punishment is popular more than it deserves; and why people rationalize its usefulness even when the first goal visibly fails.

Comment author: Vaniver 22 June 2012 04:09:11PM 1 point [-]

Agreed. Hopefully, instructors care most about the first- but in general human interaction, the others can easily rise to prominence.

Comment author: Eugine_Nier 23 June 2012 06:18:53AM 1 point [-]

Depends, the current "everyone is special, everyone deserves an A for trying" culture almost certainly overvalues positive reinforcement.

Comment author: Vaniver 23 June 2012 03:26:39PM 1 point [-]

I see a difference between 'niceness' and 'positive reinforcement'. The "everyone deserves an A for trying" approach is 'nice' but it generally isn't skillful positive reinforcement; I think a major problem with it is underestimating how much it rewards behaviors that look like trying but aren't trying.

There's also a basic value question- if you're trying to build self-esteem, it's not clear that an "A for trying" approach overvalues positive reinforcement, though if you're trying to build understanding, it clearly would be a misapplication of positive reinforcement.

Comment author: pnrjulius 05 July 2012 01:26:03AM 0 points [-]

Everyone getting an A isn't reinforcement. Reinforcement has to be conditional on something. If you give everyone who writes a long paper an A, that's reinforcing writing long papers. If you give everyone who writes a well-written paper an A, that's reinforcing well-written papers (and probably more what you want to do).

But if you just give everyone an A, that may be positive, but it simply isn't reinforcement.