V_V comments on Too good to be true - Less Wrong

24 Post author: PhilGoetz 11 July 2014 08:16PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (119)

You are viewing a single comment's thread. Show more comments above.

Comment author: private_messaging 21 July 2014 05:29:12AM *  2 points [-]

This is almost mystical wording.

There's something that just didn't get conveyed: English language. That paper, with it's idiot finding, was looking at the studies downloaded from Medline and presumably published in English, or at least with an English abstract (the search was done for English terms and no translation efforts were mentioned).

As long as researchers retain freedom to either write their study up in English or not there's going to be an additional publication-in-a-very-foreign-language bias.

With regards to acupuncture, one thing that didn't happen, is soviet union being full of acupuncture centres and posters about awesomeness of acupuncture everywhere on the walls, something that would have happened if there was indeed such a high prevalence of positive findings in locally available literature.

Comment author: V_V 25 July 2014 09:27:50AM 2 points [-]

As long as researchers retain freedom to either write their study up in English or not there's going to be an additional publication-in-a-very-foreign-language bias.

As a rule of thumb, I would say that any research published after the early 1990s in a language other than English is most likely crap.

Comment author: gwern 25 July 2014 07:11:13PM 2 points [-]

Why do you think it changed, and in the early 1990s specifically? (The original study I posted only examined '90s papers and so couldn't show any time-series like that, so it can't be why you think that.)

Comment author: V_V 25 July 2014 08:59:00PM 3 points [-]

I suppose that before the 1990s respectable Soviet scientists published primarily in Russian.