Oscar_Cunningham comments on Rationality Quotes September 2011 - Less Wrong

7 Post author: dvasya 02 September 2011 07:38AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (482)

You are viewing a single comment's thread. Show more comments above.

Comment author: simplicio 13 September 2011 01:16:46PM *  2 points [-]

Let me see if I've cottoned on by coming up with an example.

Say you work with someone for years, and often on Mondays they come in late & with a headache. Other days, their hands are shaking, or they say socially inappropriate things in meetings.

"Good inductive bias" appears to mean you update in the correct direction (alcoholism/drug addiction) on each of these separate occasions, whereas "bad inductive bias" means you shrug each occurrence off and then get presented with each new occurrence, as it were, de novo. So this could be glossed as basically "update incrementally." Have I got the gist?

I think what's mildly confusing is the normatively positive use of the word "bias," which typically suggests deviation from ideal reasoning. But I suppose it is a bias in the sense that one could go too far and update on every little piece of random noise...

Comment author: Oscar_Cunningham 13 September 2011 01:48:37PM 4 points [-]

I think what's mildly confusing is the normatively positive use of the word "bias," which typically suggests deviation from ideal reasoning. But I suppose it is a bias in the sense that one could go too far and update on every little piece of random noise...

"Inductive bias" is a technical term, where the word bias isn't meant negatively.