Bugmaster comments on How to Fix Science - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (141)
Wait, is it ? You say,
That makes science as we know it the best method indeed, simply by definition. You list some problems with the way science is done, and outline some possible solutions, and that's fine. But your opening sentence doesn't say, "science isn't as efficient as it could be", it says "science is broken". That's a pretty audacious claim that the rest of your post does not support -- especially since, in a deliciously ironic twist, you link to scientific articles as evidence that "science is broken".
Um?
If I collect a set of totally useless methods, followed by method A which is not totally useless, followed by method B which is also not totally useless, method A is the first method I've collected that wasn't totally useless, but it isn't definitionally the best method.
Perhaps I misinterpreted lukeprog's words. It sounded to me like he was saying, "all these other methods were useless, and science is the only method we know of that isn't useless". This makes science the best thing we've got, by definition, though it doesn't preclude the existence of better methods that are yet unknown to us.
Ah, I see.
Sure, if by "first" Luke meant /only/, then yes, Luke's statement (properly interpreted) means science as we know it the best method currently available, and essentially contradicts the rest of his post. Agreed.
Can you clarify your reasons for thinking he meant /only/ rather than /first/?
I interpreted "first" to mean "first in human history". Since science is the method we currently use to understand the world, I assumed that no other methods were as good -- otherwise, we'd be using those. Human history is ongoing, though, so we could find better methods in the future.
Luke goes on to discuss different ways of fixing science, which led me to believe that he doesn't know of any other methods that are superior to science, either. If he did, presumably he'd be advocating that we drop science altogether, and replace it with these other methods.
It's by no means clear that we're generally using the best methods ever discovered. In fact, it seems unlikely on the face of it. It's not especially uncommon for an earlier method to become popular enough that later superior methods fail to displace it in the popular mind.
That aside, at this point it kind of sounds like the main thing we're disagreeing about is whether the two different things under discussion in Luke's post are both properly labelled "science" or not. In which case I'm happy to concede the point and adopt your labels. In which case everyone involved agrees that we should use science and the interesting discussion is about what techniques science ought to comprise.
Can you list some examples ?
Good point. I guess it all depends on whether the changes Luke proposes should count as reforming science, or as replacing it with an entirely new methodology. I don't think that his changes go far enough to constitute a total replacement; after all, he even titled the article "How to Fix Science", not "Science is Dead, Let's Replace It".
In addition, I think that the changes he proposes to fix publication bias and NHST are incremental rather than entirely orthogonal to the way science is done now (I admit that I'm not sure what to make of the "experimenter bias" section). But it sounds like you might disagree...
Just to pick one we're discussing elsethread, billions of people around the world continue to embrace traditional religious rituals as a mechanism for improving their personal lot in life and interpreting events around them, despite the human race's discovery of superior methods for achieving those goals.
Yes, agreed, that's basically what our disagreement boils down to. As I said before, if we can agree about what changes ought to be made, I simply don't care whether we call the result "reforming science" or "replacing science with something better."
So I'm happy to concede the point and adopt your labels: we're talking about incrementally reforming science.
Fair enough, I think I misinterpreted what you meant by "popular mind". That said, though, all the people whose primary job description is to understand the natural world are currently using science as their method of choice; at least, all the successful ones are.
In that case, we have no fundamental disagreements; incremental improvement is always a good thing (as long as it's actually an improvement, of course). The one thing I would disagree with Luke (and, presumably, yourself) about is the extent to which "science is broken". I think that science works reasonably well in its current form -- though there's room for improvement -- whereas Luke seems to believe that science has hit a dead end. On the other hand, the changes he proposes are fairly minor, so perhaps I am simply misinterpreting his tone.
Fair enough. I agree that if by "popular mind" we mean successful professional understanders of the natural world, then my assertion that science has not displaced religion in the popular mind as a preferred mechanism for understanding the world is at the very least non-obvious, and likely false. That seems an unjustified reading of that phrase to me, but that doesn't matter much.
I can't decide if we disagree on whether "science works reasonably well in its current form", as I don't really know what that phrase means. Even less can I decide whether you and Luke disagree on that.
Note necessarily since humans aren't perfectly rational.
I don't think it's ironic. Assuming that all science is representative of all science, if science isn't broken then science saying that science is broken means that science is broken (because it's in a logically impossible epistemic state). If science is broken then science is broken. So in any case science saying that science is broken means that science is broken. Of course all science isn't representative of all science, but that takes the sting out of the irony.