Science is tailored to counteract human cognitive biases. Aliens might or might not have the same biases. AIs wouldn't need science.
For example, science says you make the hypothesis, then you run the test. You're supposed to make a prediction, not explain why something happened in retrospect. This is to prevent hindsight bias and rationalization from changing what we think is a consequence of our hypotheses. But the One True Way does not throw out evidence because humans are too weak to use it.
Science is tailored to counteract human cognitive biases.
That isn't really clear to me. Science wasn't intelligently designed; it evolved. While it has different ideals and functions from other human institutions (such as religions and governments), it has a lot in common with them as a result of being a human institution. It has a many features that contribute to the well-being of its participants and the stability of their organizations, but that don't necessarily contribute much to its ostensible goal of finding truth.
For instance, it has been common...
I'm afraid I haven't properly designed the Muggles Studies course I introduced at my local Harry Potter fan club. Last Sunday we finally had our second class (after wasted months of insistence and delays), and I introduced some very basic descriptions of common biases, while of course emphasizing the need to detect them in ourselves before trying to detect them in other people. At some point, which I didn't completely notice, the discussion changed from an explanation of the attribution bias into a series of multicultural examples in favor of moral relativity. I honestly don't know how that happened, but as more and more attendants voiced their comments, I started to fear someone would irreversibly damage the lessons I was trying to teach. They basically stopped short of calling the scientific method a cultural construct, at which point I'm sure I would have snapped. I don't know what to make of this. Some part of me tries to encourage me and make me put more effort into showing these people the need for more reductionism in their worldview, but another part of me just wants to give them up as hopeless postmodernists. What should I do?