MugaSofer comments on Reinforcement and Short-Term Rewards as Anti-Akratic - Less Wrong

24 Post author: Intrism 13 April 2013 08:47PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (27)

You are viewing a single comment's thread.

Comment author: MugaSofer 20 May 2013 10:08:09AM -1 points [-]

CFAR describes reinforcement in a very striking way in some of their course materials: they call it "training your inner pigeon." Not only is that a nice, snappy turn of phrase, it illustrates the problem with attempting to self-administer rewards very nicely. Did Skinner's pigeons self-administer their rewards? No, of course they didn't. I shouldn't expect my inner pigeon to, either. So, my next step is to build a robot that gives me candy when I get stuff done.

The idea is that your conscious mind is to a degree separate from your lizard brain, so "you" train your "inner pigeon". You aren't your inner pigeon, you're Skinner.

Of course, the reinforced parts of the brain overriding the smart bits is what akrasia is all about, so I'm not sure how well this neat demarcation works in practice.