Letting Go

Aug 24, 2017

by Eliezer Yudkowsky

Our natural state isn’t to change our minds like a Bayesian would. Getting the people in opposing tribes to notice what they’re really seeing won’t be as easy as reciting the axioms of probability theory to them. As Luke Muehlhauser writes, in The Power of Agency:

You are not a Bayesian homunculus whose reasoning is “corrupted” by cognitive biases.

You just are cognitive biases.

Confirmation bias, status quo bias, correspondence bias, and the like are not tacked on to our reasoning; they are its very substance.

That doesn’t mean that debiasing is impossible. We aren’t perfect calculators underneath all our arithmetic errors, either. Many of our mathematical limitations result from very deep facts about how the human brain works. Yet we can train our mathematical abilities; we can learn when to trust and distrust our mathematical intuitions, and share our knowledge, and help one another; we can shape our environments to make things easier on us, and build tools to offload much of the work.

Our biases are part of us. But there is a shadow of Bayesianism present in us as well, a flawed apparatus that really can bring us closer to truth. No homunculus—but still, some truth. Enough, perhaps, to get started.

Singlethink
3912y1 min readShow Highlight
25
The Importance of Saying "Oops"
6412y2 min readShow Highlight
26
The Crackpot Offer
5112y2 min readShow Highlight
71
Just Lose Hope Already
6012y1 min readShow Highlight
76
The Proper Use of Doubt
4012y2 min readShow Highlight
30
You Can Face Reality
6312y1 min readShow Highlight
35
The Meditation on Curiosity
4212y3 min readShow Highlight
96
No One Can Exempt You From Rationality's Laws
5812y2 min readShow Highlight
51
Leave a Line of Retreat
6811y3 min readShow Highlight
72
Crisis of Faith
6411y9 min readShow Highlight
246
The Ritual
4211y4 min readShow Highlight
19