Eliezer_Yudkowsky comments on Outside the Laboratory - Less Wrong

63 Post author: Eliezer_Yudkowsky 21 January 2007 03:46AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (336)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Eliezer_Yudkowsky 23 January 2007 01:03:58AM 5 points [-]

Heh. Fair enough, John, I suppose that someone has to arbitrage the books. I'll add it to Jane Galt's observation regarding the genuine usefulness of salad forks.

I agree that 0.005 is equally pulled out of a hat. But I also agree on your earlier observation regarding there being some necessity for standardization here.

Personally, I would prefer to standardize "small", "medium", and "large" effect sizes, then report likelihood ratios over the point null hypothesis. A very strong advantage of this approach is that it lets someone do a large study and report a startling likelihood advantage of 1000 for "no effect" over "small effect", rather than just the boring old phrase "not statistically significant". This is probably worth its own post, but I may not get around to writing it.