“If we gave it the design of a spaceship, and the details of a proposed test flight, it could tell us how the spaceship would perform on such a flight. But it could not design the spaceship for us in the first place. And even if it predicted that the spaceship we had designed would explode on take-off, it could not tell us how to prevent such an explosion. That would still be for us to work out. And before we could work it out, before we could even begin to improve the design in any way, we should have to understand, among other things, how the spaceship was supposed to work. Only then would we have any chance of discovering what might cause an explosion on take-off. Prediction – even perfect, universal prediction – is simply no substitute for explanation.”

The question is now: how does this focus on explanations tie in to other ideas which are emphasised in science, like falsifiability, experimentalism, academic freedom and peer review? I find it useful to think of these aspects of science less as foundational epistemological principles, and more as ways to counteract various cognitive biases which humans possess. In particular:

1. We are biased towards sharing the beliefs of our ingroup members, and forcing our own upon them.
2. We’re biased towards aesthetically beautiful theories which are simple and elegant.
3. Confirmation bias makes us look harder for evidence which supports than which weighs against our own beliefs.
4. Our observations are by default filtered through our expectations and our memories, which makes them unreliable and low-fidelity.
5. If we discover data which contradicts our existing theories, we find it easy to confabulate new post-hoc explanations to justify the discrepancy.
6. We find it psychologically very difficult to actually change our minds.

We can see that many key features of science counteract these biases:

1. Science has a heavy emphasis on academic freedom to pursue one’s own interests, which mitigates pressure from other academics. Nullius in verba, the motto of the Royal Society (“take nobody’s word for it”) encourages independent verification of others’ ideas.
2. Even the most beautiful theories cannot overrule conflicting empirical evidence.
3. Scientists are meant to attempt to experimentally falsify their own theories, and their attempts to do so are judged by their peers. Double-blind peer review allows scientists to feel comfortable giving harsher criticisms without personal repercussions.
4. Scientists should aim to collect precise and complete data about experiments.
5. Scientists should pre-register their predictions about experiments, so that it’s easy to tell when the outcome weighs against a theory.
6. Science has a culture of vigorous debate and criticism to persuade people to change their minds, and norms of admiration for those who do so in response to new evidence.

But imagine an alien species with the opposite biases:

1. They tend to trust the global consensus, rather than the consensus of those directly around them.
2. Their aesthetic views are biased towards theories which are very data-heavy and account for lots of edge cases.*
3. When their views diverge from the global consensus, they look harder for evidence to bring themselves back into line than for evidence which supports their current views.
4. Their natural senses and memories are precise, unbiased and high-resolution.
5. When they discover data which contradicts their theories, they find it easiest to discard those theories rather than reformulating them.
6. They change their minds a lot.

In this alien species, brave iconoclasts who pick an unpopular view and research it extensively are much less common than they are amongst humans. Those who try to do so end up focusing on models with (metaphorical or literal) epicycles stacked on epicycles, rather than the clean mathematical laws which have actually turned out to be more useful for conceptual progress in many domains. In formulating their detailed, pedantic models, they pay too much attention to exhaustively replaying their memories of experiments, and not enough to what concepts might underlie them. And even if some of them start heading in the right direction, a few contrary pieces of evidence would be enough to turn them back from it - for example, their heliocentrists might be thrown off track by their inability to observe stellar parallax. Actually, if you’re not yet persuaded that this alien world would see little scientific progress, you should read my summary of The Sleepwalkers. In that account of the early scientific revolution, any of the alien characteristics above would have seriously impeded key scientists like Kepler, Galileo and others (except perhaps the eidetic memories).

And so the institutions which actually end up pushing forward scientific progress on their world would likely look very different from the ones which did so on ours. Their Alien Royal Society would encourage them to form many small groups which actively reinforced each other’s idiosyncratic views and were resistant to outside feedback. They should train themselves to seek theoretical beauty rather than empirical validation - and actually, they should pay much less attention to contradictory evidence than members of their species usually do. Even when they’re tempted to change their minds and discard a theory, they should instead remind themselves of how well it post-hoc explains previous data, and put effort into adjusting it to fit the new data, despite how unnatural doing so seems to them. Those who change their minds too often when confronted with new evidence should be derided as wishy-washy and unscientific.

These scientific norms wouldn’t be enough to totally reverse their biases, any more than our scientific norms make us rejoice when our pet theory is falsified. But in both cases, they serve as nudges towards a central position which is less burdened by species-contingent psychological issues, and better at discovering good explanations.


* Note that this might mean the aliens have different standards for what qualifies as a good explanation than we do. But I don’t think this makes a big difference. Suppose that the elegant and beautiful theory we are striving for is a small set of simple equations which governs all motion in the solar system, and the elegant and beautiful theory they are striving for is a detailed chart which traces out the current and future positions of all objects in the solar system. It seems unlikely that they could get anywhere near the latter without using Newtonian gravitation. So a circular-epicycle model of the solar system would be a dead end even by the aliens’ own standards.