gwern comments on Firewalling the Optimal from the Rational - Less Wrong

86 Post author: Eliezer_Yudkowsky 08 October 2012 08:01AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (339)

You are viewing a single comment's thread. Show more comments above.

Comment author: gwern 10 October 2012 03:33:21PM *  7 points [-]

A sample size of one is more than enough for internal validity, assuming I take enough data points to detect an effect. (I typically do 20+ pairs; the stronger the effect, the less you need.)

What n=1 threatens is any kind of external validity, that is, whether one would observe the effect or lack of effect in someone other than me. I may find that potassium is fantastic for me, but that tells me very little about whether potassium would help you or anyone else on this page.

Comment author: V_V 10 October 2012 05:35:24PM 1 point [-]

Agree.