ChristianKl comments on LessWrong 2.0 - Less Wrong

89 Post author: Vaniver 09 December 2015 06:59PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (312)

You are viewing a single comment's thread. Show more comments above.

Comment author: ChristianKl 10 January 2016 12:59:30PM 1 point [-]

Jason Mitchell writes in "On the emptiness of failed replications" that there certain knowledge you need to replicate experiments that's not in the paper:

I have a particular cookbook that I love, and even though I follow the recipes as closely as I can, the food somehow never quite looks as good as it does in the photos. Does this mean that the recipes are deficient, perhaps even that the authors have misrepresented the quality of their food? Or could it be that there is more to great cooking than simply following a recipe? I do wish the authors would specify how many millimeters constitutes a “thinly” sliced onion, or the maximum torque allowed when “fluffing” rice, or even just the acceptable range in degrees Fahrenheit for “medium” heat. They don’t, because they assume that I share tacit knowledge of certain culinary conventions and techniques;

[...]

Likewise, there is more to being a successful experimenter than merely following what’s printed in a method section. Experimenters develop a sense, honed over many years, of how to use a method successfully. Much of this knowledge is implicit. Collecting meaningful neuroimaging data, for example, requires that participants remain near-motionless during scanning, and thus in my lab, we go through great lengths to encourage participants to keep still. We whine about how we will have spent a lot of money for nothing if they move, we plead with them not to sneeze or cough or wiggle their foot while in the scanner, and we deliver frequent pep talks and reminders throughout the session.

How best to give those pep talks would be an example.

Comment author: Lumifer 11 January 2016 03:30:24PM 1 point [-]

even though I follow the recipes as closely as I can, the food somehow never quite looks as good as it does in the photos

The guy is profoundly misguided about the purpose of food X-D

And food photography is a specialized and lucrative field for a reason.