Will_Newsome comments on How to Fix Science - Less Wrong

50 Post author: lukeprog 07 March 2012 02:51AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (141)

You are viewing a single comment's thread. Show more comments above.

Comment author: Will_Newsome 04 March 2012 03:07:17AM 1 point [-]

ISTM a large benefit of commonplace Bayes would be that competent statisticians could do actually meaningful meta-analyses...? Which would counteract widespread statistical ineptitude to a significant extent...?

Comment author: satt 04 March 2012 11:45:27AM *  2 points [-]

I'm not sure it'd make much difference. From reading & skimming meta-analyses myself I've inferred that the main speedbumps with doing them are problems with raw data themselves or a lack of access to raw data. Whether the data were originally summarized using NHST/frequentist methods or Bayesian methods makes a lot less difference.

Edit to add: when I say "problems with raw data themselves" I don't necessarily mean erroneous data; a problem can be as mundane as the sample/dataset not meeting the meta-analyst's requirements (e.g. if the sample were unrepresentative, or the dataset didn't contain a set of additional moderator variables).