pjeby comments on Five Stages of Idolatry - Less Wrong

6 Post author: hegemonicon 25 July 2009 06:16PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (16)

You are viewing a single comment's thread. Show more comments above.

Comment author: Peter_de_Blanc 26 July 2009 02:10:59PM 7 points [-]

The general phenomenon you're noticing here is this: if you're trying to pick some real number x to maximize f(x), you'll start with some particular value of x and keep trying out different values. As long as f(x) seems to be increasing in x, you will increment x by larger and larger amounts. At some point, you shoot past the local maximum, and f(x) decreases. So now you start decrementing x, somewhat more slowly than you were previously incrementing it. Soon x becomes smaller than optimal, and you switch directions again. You'll gradually approach the local maximum, but you actually cross it many times.

Comment author: pjeby 26 July 2009 04:24:50PM 0 points [-]

That is brilliant. It even suggests a brain-hardware implementation that'd be consistent with PCT's generalized notion of learning.