mistercow comments on Statistical Prediction Rules Out-Perform Expert Human Judgments - Less Wrong

68 Post author: lukeprog 18 January 2011 03:19AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (195)

You are viewing a single comment's thread.

Comment author: mistercow 19 January 2011 05:14:38PM 0 points [-]

It's interesting to me that the proper linear model example is essentially a stripped down version of a very simple neural network with a linear activation function.

Comment author: gwern 19 January 2011 05:22:12PM 1 point [-]

Is that really true? Couldn't one say that of just about any Turing-complete (or less) model of computation?

'Oh, it's interesting that they are really just a simple unary fixed-length lambda-calculus function with constant-value parameters.'

'Oh, it's interesting that they are really just restricted petri-nets with bounded branching factors.'

'Oh, it's interesting that these are modelable by finite automata.'

etc. (Plausible-sounding gobbledygook included to make the point.)

Comment author: mistercow 19 January 2011 06:22:39PM 2 points [-]

Yes, sort of, but a) a linear classifier is not a Turing-complete model of computation, and b) there is a clear resemblance that can be seen by merely glancing at the equations.

Comment author: Will_Sawin 21 January 2011 04:45:02AM 0 points [-]

I would argue that neurons, neural nets, SPRs, and everyone else doing linear regression use those techniques because it's the simplest way to aggregate data.