The best description of the scientific method I have ever seen is from a conceptual physics textbook by Hobson. Paraphrasing:
The scientific method involves the dynamic interplay between theory and experiment.
That’s it. Perfect. As a scientist, I don’t come to work on Monday and make an observation, then form a hypothesis on Tuesday, devise an experiment to test some prediction on Wednesday, perform the experiment Thursday, and interpret the result on Friday. On any given day I would be hard pressed to tell you where I am in the process. All of the above, really. It’s a mess. It’s a constant back and forth comparing theoretical expectations to the final arbiter of any dispute: nature. Some people specialize in one aspect of the process, and can spend years chewing on some piece of it. But it is seldom done in isolation.
Meanwhile, science fair projects across the nation—under the advisement of teachers who themselves often do not have personal experience in how science really works—approach their subject in an uncharacteristically formulaic way. Nine times out of ten the effort culminates in a proof that the initial hypothesis was right; as if that were the goal and criterion for success. The rare student is surprised by the data, admitting to a failure of the hypothesis, quickly reconsidering initial assumptions and driving into an unexpected yet rewarding direction (dynamic interplay). That’s the real scientist at work. Too bad the judges (in my experience as a judge) often don’t recognize this apparent failure as the true success.
I can’t pass up the opportunity to share with you the “best” high school science fair project I ever saw (when I was myself a student participant in the fair—and no, it was not my project): “Does light travel through the dark?” Setup: light-tight cardboard box painted black on the inside; flashlight shining through a hole in one end; a peephole in the other end to see if the light made it. Any guesses?
-- Tom Murphy
As a scientist, I don’t come to work on Monday and make an observation, then form a hypothesis on Tuesday, devise an experiment to test some prediction on Wednesday, perform the experiment Thursday, and interpret the result on Friday. On any given day I would be hard pressed to tell you where I am in the process. All of the above, really. It’s a mess.
That is a large part of the reason why we have problems like the file drawer effect and data dredging.
Here's the new thread for posting quotes, with the usual rules: