Giles comments on How to Fix Science - Less Wrong

50 Post author: lukeprog 07 March 2012 02:51AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (141)

You are viewing a single comment's thread.

Comment author: Giles 04 March 2012 05:37:31PM 3 points [-]

journals to only accept experiments that were registered in a public database

I know this is stating the obvious, but the next stage after this is for people to regard "science" as what's in the database rather than what's in the journals. Otherwise there's still publication bias (unless people like writing up boring results and journals like publishing them)

Comment author: scav 07 March 2012 12:04:45PM 1 point [-]

Well, the database wouldn't contain any results. What it does though is reduce the importance of published claims that have a large number of non-published (probably failed) attempts at showing the same effect.

Ideally you want the literature review section of a paper to include a mention of all these related but unpublished experiments, not just other published results.

Comment author: jdgalt 08 March 2012 06:12:03AM 0 points [-]

Boredom is far from the only bad reason that some journals refuse some submissions. Every person in the chain of publication, and that of peer review, must be assumed at least biased and potentially dishonest. Therefore "science" can never be defined by just one database or journal, or even a fixed set of either. Excluded people must always be free to start their own, and their results judged on the processes that produced them. Otherwise whoever is doing the excluding is not to be trusted as an editor.

I hasten to add that this kind of bias exists among all sides and parties.