paper-machine comments on Knowledge value = knowledge quality × domain importance - Less Wrong

8 Post author: John_Maxwell_IV 16 April 2012 08:40AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (40)

You are viewing a single comment's thread. Show more comments above.

Comment author: gwern 16 April 2012 03:15:45PM *  6 points [-]

But knowledge does not come in two grades, "scientific" and "useless". Anecdotes do count as Bayesian evidence, they are just weak Bayesian evidence. And well designed scientific studies constitute stronger Bayesian evidence then poorly designed studies. There's a continuum for knowledge quality.

Methodologically, each self-experiment is typically much more poorly run than the kinds of trials we try to discuss here (RCTs), so each self-experiment represents less than n=1 of data. The RCTs usually have at least a few dozen and ideally hundreds or thousands of subjects, either singly or pooled for meta-analysis. So a single such meta-analysis represents thousands of subjects times the fractional quality of a self-experiment, leading to the conclusion that one self-experiment is worth somewhere less than one-hundredths to one-thousandths of any comparable RCT.

The human mind doesn't do 64-bit floating weights. It doesn't even do shorts.

Comment author: [deleted] 16 April 2012 03:24:45PM 1 point [-]

It doesn't even do shorts.

Of course the human mind does shorts! They're comfy and easy to wear!

Comment author: gwern 16 April 2012 03:31:03PM 2 points [-]

You're actually why we don't do shorts. (Please, never again wear them in public.)