I want to make
1) A general compliment for the post.
I think the tables are helpful for those who seek to recognize their biases. Bravo!
2) A comment about the 3% of the 3B1B video.
Thinking about the audience is crucial for communication. I think the video has reached much more than the 3% of its target audience.
3) A meta-comment N1 on communication.
When communicating, it is useful to know why you are doing it (also for other activities). If one wants to make the broad population aware of cognitive biases, one should know why and consider the marginal added value of the educational activity.
4) A meta-comment N2 on communication.
I believe communication is most efficient when one understands the motives of the target audience and through communication provides support for the achievement of those motives.
E.g. Situation: my co-authors are angry with the referee who criticized our manuscript as too implicit. I might, step 1) focus on making the best effort to resubmit the paper, thus putting explicitly the motivation for action
step 2) make them aware of the transparency bias, on the example of how the manuscript can be written more clearly, thus introducing action(rewriting) that is aligned with the motivation (resubmission).
Note in the example above, the educational part comes as a side-effect. One might be explicit about overcoming the biases to solidify the educational effect.
To recap, we should have the interests of our audience in mind. Moreover, if we do not act in the interest of the audience we risk triggering their defensive mode and thus make our efforts futile if not harmful
4-bis) A meta-comment on meta-comment N2.
One might say that scalability is important (e.g. for Raising the Sanity Waterline) and that knowing one's audience is not scalable.
In other words, it's too costly to "educate" one person at a time.
I think this is not always true, there are motivations that are common across the population. Distilling those motives might be extremely useful for communication. Understanding which biases an "average Joe" is facing in his primary activities might be the most efficient way to "educate" the population on implicit biases.
E.g. I imagine a hypothetical video titled "How to actually get rich instead of fooling yourself" might be an example.
P.S. This is my first comment on LW, so "hello world". It looks longish - if you think multiple comments is a better format, please let me know.
Building on the recent SSC post Why Doctors Think They’re The Best...
The scientific term for this mismatch is: confirmation bias
The scientific term for this mismatch is: selection bias
The scientific term for this mismatch is: illusion of transparency
The scientific term for this mismatch is: hindsight bias
The scientific term for this mismatch is: optimism bias
Why this is better than how we usually talk about biases
Communication in abstracts is very hard. (See: Illusion of Transparency: Why No One Understands You) Therefore, it often fails. (See: Explainers Shoot High. Aim Low!) It is hard to even notice communication has failed. (See: Double Illusion of Transparency) Therefore it is hard to appreciate how rarely communication in abstracts actually succeeds.
Rationalists have noticed this. (Example) Scott Alexander uses a lot of concrete examples and that should be a major reason why he’s our best communicator. Eliezer’s Sequences work partly because he uses examples and even fiction to illustrate. But when the rest of us talk about rationality we still mostly talk in abstracts.
For example, this recent video was praised by many for being comparatively approachable. And it does do many things right, such as emphasize and repeat that evidence alone should not generate probabilities, but should only ever update prior probabilities. But it still spends more than half of its runtime displaying mathematical notation that no more than 3% of the population can even read. For the vast majority of people, only the example it uses can possibly “stick”. Yet the video uses its single example as no more than a means for getting to the abstract explanation.
This is a mistake. I believe a video with three to five vivid examples of how to apply Bayes’ Theorem, preferably funny or sexy ones, would leave a much more lasting impression on most people.
Our highly demanding style of communication correctly predicts that LessWrongians are, on average, much smarter, much more STEM-educated and much younger than the general population. You have to be that way to even be able to drink the Kool Aid! This makes us homogeneous, which is probably a big part of what makes LW feel tribal, which is emotionally satisfying. But it leaves most of the world with their bad decisions. We need to be Raising the Sanity Waterline and we can’t do that by continuing to communicate largely in abstracts.
The tables above show one way to do better that does the following.
What do you think about this? Should we communicate more concretely? If so, should we do it in this way or what would you do differently?
Would you like to correct these tables? Would you like to propose more analogous observations or other biases?
Thanks to Simon, miniBill and others for helping with the draft of this post.