This essay is closely based on an excerpt from Meyers’s Exploring Social Psychology; the excerpt is worth reading in its entirety.
Cullen Murphy, editor of The Atlantic, said that the social sciences turn up “no ideas or conclusions that can’t be found in [any] encyclopedia of quotations . . . Day after day social scientists go out into the world. Day after day they discover that people’s behavior is pretty much what you’d expect.”
Of course, the “expectation” is all hindsight. (Hindsight bias: Subjects who know the actual answer to a question assign much higher probabilities they “would have” guessed for that answer, compared to subjects who must guess without knowing the answer.)
The historian Arthur Schlesinger, Jr. dismissed scientific studies of World War II soldiers’ experiences as “ponderous demonstrations” of common sense. For example:
- Better educated soldiers suffered more adjustment problems than less educated soldiers. (Intellectuals were less prepared for battle stresses than street-smart people.)
- Southern soldiers coped better with the hot South Sea Island climate than Northern soldiers. (Southerners are more accustomed to hot weather.)
- White privates were more eager to be promoted to noncommissioned officers than Black privates. (Years of oppression take a toll on achievement motivation.)
- Southern Blacks preferred Southern to Northern White officers. (Southern officers were more experienced and skilled in interacting with Blacks.)
- As long as the fighting continued, soldiers were more eager to return home than after the war ended. (During the fighting, soldiers knew they were in mortal danger.)
How many of these findings do you think you could have predicted in advance? Three out of five? Four out of five? Are there any cases where you would have predicted the opposite—where your model takes a hit? Take a moment to think before continuing . . .
. . .
In this demonstration (from Paul Lazarsfeld by way of Meyers), all of the findings above are the opposite of what was actually found.1 How many times did you think your model took a hit? How many times did you admit you would have been wrong? That’s how good your model really was. The measure of your strength as a rationalist is your ability to be more confused by fiction than by reality.
Unless, of course, I reversed the results again. What do you think?
Do your thought processes at this point, where you really don’t know the answer, feel different from the thought processes you used to rationalize either side of the “known” answer?
Daphna Baratz exposed college students to pairs of supposed findings, one true (“In prosperous times people spend a larger portion of their income than during a recession”) and one the truth’s opposite.2 In both sides of the pair, students rated the supposed finding as what they “would have predicted.” Perfectly standard hindsight bias.
Which leads people to think they have no need for science, because they “could have predicted” that.
(Just as you would expect, right?)
Hindsight will lead us to systematically undervalue the surprisingness of scientific findings, especially the discoveries we understand—the ones that seem real to us, the ones we can retrofit into our models of the world. If you understand neurology or physics and read news in that topic, then you probably underestimate the surprisingness of findings in those fields too. This unfairly devalues the contribution of the researchers; and worse, will prevent you from noticing when you are seeing evidence that doesn’t fit what you really would have expected.
We need to make a conscious effort to be shocked enough.
1 Paul F. Lazarsfeld, “The American Solidier—An Expository Review,” Public Opinion Quarterly 13, no. 3 (1949): 377–404.
2 Daphna Baratz, How Justified Is the “Obvious” Reaction? (Stanford University, 1983).
First time around (with hindsight bias) I answered F, T, F?, T, T
Second time around (without hindsight bias) I answered F, T, T?, T, F
Educated people are more likely to agree with authority, because they have spent more time being conditioned to obey teachers. I generalized that they might also take orders easier in the military, and conform to the circumstances easier, despite "rough and tumbled" blue collar stereotypes.
I thought be difficult to measure, but that there would be some small but probably measurable advantage.
I couldn't really tell. At first my guess was based on the idea that repressed people are more motivated and fight harder. When I reversed my decision, it was because I put a higher weight on the situation being similar to women in business, where men are more likely to rock the boat and ask for a higher salary or promotions than women are. In retrospect, both of these are attempts to confirm a hypothesis, rather than to disprove it.
People often favor members of their own group. Unless a majority of southern blacks dislike a majority of southern whites, rather than just being indifferent, I hypothesized that they would relate to them more easily as fellow southerners.
Initially, I presumed what I thought was the simple and obvious answer, that people would avoid stress. After that, I recalled that adrenalin, deep bonds of sharing an experience, and a sense of purpose are play a big part, and that boredom may actually be a bigger factor since soldiers wouldn't want to abandon their countrymen.
It's hard to describe the different sensations of the two thought processes. I think it was harder to put in as much effort when I was actively suspending my disbelief. I was just going through the motions. The second time, I was really unsure, and took a deeper look. Or maybe I would have taken a deeper look if I had reexamined it under some other pretense.
I wasn't sure whether the recession statement was true. I believe it is, but I'm not sure it would be for a full scale depression, since if people are earning less then they won't be able to be more thrifty, because they will always need to eat and afford the basic necessities.