You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

TimS comments on Case Study: Testing Confirmation Bias - Less Wrong Discussion

32 Post author: gwern 02 May 2012 02:03PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (61)

You are viewing a single comment's thread. Show more comments above.

Comment author: TimS 03 May 2012 12:56:26AM 0 points [-]

Putting in more work to get another interesting experimental result is a harm to the researcher? On what planet?

Comment author: gwern 03 May 2012 01:21:24AM *  2 points [-]

Well, presumably if working harder on their submission was their utility-maximizing choice, they would have done so already sans experimental manipulation; if any more quality time was used up, it probably came at the expense of some other activity...

Comment author: TimS 03 May 2012 01:55:25AM 0 points [-]

It looks like I badly misunderstood your comment. When you wrote "the researchers," I thought that was a coy way of referring to yourself in reference to the two experimental results of which I questioned the ethics.

I'm not arguing for the optimality of compliance with an IRB or other "ethical" guidelines - I'm doubtful they do a reasonable job of creating morally optimal research protocols, and they clearly prevent the discovery of certain interesting or useful results - like your results from these posts that relied on deception. And that doesn't even account for the compliance costs that I now realize was the point of your comment. Oops