Stuart_Armstrong comments on Why the tails come apart - LessWrong

114 Post author: Thrasymachus 01 August 2014 10:41PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (90)

You are viewing a single comment's thread. Show more comments above.

Comment author: Stuart_Armstrong 07 August 2014 04:25:21PM 1 point [-]

Another approach seems to be stepwise regression: http://en.wikipedia.org/wiki/Stepwise_regression

Comment author: EHeller 07 August 2014 05:14:24PM *  4 points [-]

I see a lot of stepwise regression being used by non-statisticians, but I think statisticians themselves think its something of a joke. If you have more predictors than you can fit coefficients for, and want an understandable linear model you are better off with something like LASSO.

Edit: Don't just take my word for it, google found this blog post for me: http://andrewgelman.com/2014/06/02/hate-stepwise-regression/

Comment author: Lumifer 07 August 2014 05:38:45PM 1 point [-]

I concur. Stepwise regression is a very crude technique.

I find it useful as an initial filter if I have to dig through a LOT of potential predictors, but you can't rely on it to produce a decent model.

Comment author: [deleted] 07 August 2014 04:30:25PM 1 point [-]

So it wasn't as clear with the previous link, but it seems to me that the nth step of this method doesn't condition on the fact that the last n-1 steps failed.