LESSWRONG
LW

816
Wikitags

Priors

Edited by Kaj_Sotala, Eliezer Yudkowsky, pedrochaves, et al. last updated 2nd Oct 2020

In the context of Bayes's Theorem, priors refer generically to the beliefs an agent holds regarding a fact, hypothesis or consequence, before being presented with evidence. Upon being presented with new evidence, the agent can multiply their prior with a likelihood distribution to calculate a new (posterior) probability for their belief.

Examples

Suppose you had a barrel containing some number of red and white balls. You start with the belief that each ball was independently assigned red color (vs. white color) at some fixed probability. Furthermore, you start out ignorant of this fixed probability (the parameter could be anywhere between 0 and 1). Each red ball you see then makes it more likely that the next ball will be red, following a Laplacian Rule of Succession. For example, seeing 6 red balls out of 10 suggests that the initial probability used for assigning the balls a red color was .6, and that there's also a probability of .6 for the next ball being red.

On the other hand, if you start out with the prior belief that the barrel contains exactly 10 red balls and 10 white balls, then each red ball you see makes it less likely that the next ball will be red (because there are fewer red balls remaining).

Thus our prior affects how we interpret the evidence. The first prior is an inductive prior - things that happened before are predicted to happen again with greater probability. The second prior is anti-inductive - the more red balls we see, the fewer we expect to see in the future.

As a real life example, consider two leaders from different political parties. Each one has his own beliefs - priors - about social organization and the roles of people and government in society. These differences in priors can be attributed to a wide range of factors, ranging from their educational backgrounds to hereditary differences in personality. However, neither can show that his beliefs are better than those of the other, unless he can show that his priors were generated by sources which track reality better1.

Because carrying out any reasoning at all seems to require a prior of some kind, ideal Bayesians would need some sort of priors from the moment that they were born. The question of where an ideal Bayesian would get this prior from has occasionally been a matter of considerable controversy in the philosophy of probability.

Updating prior probabilities

In informal discussion, people often talk about "updating" their priors. This is technically incorrect, as one does not change their prior probability, but rather uses it to calculate a posterior probability. However, as this posterior probability then becomes the prior probability for the next inference, talking about "updating one's priors" is often a convenient shorthand.

References

Blog posts

  • Priors as Mathematical Objects
  • "Inductive Bias"
  • Probability is Subjectively Objective
  • Bead Jar Guesses by Alicorn - Applied scenario about forming priors.

See also

  • Evidence
  • Inductive bias
  • Belief update

References

  1. Robin Hanson (2006). "Uncommon Priors Require Origin Disputes". Theory and Decision 61 (4) 319–328. http://hanson.gmu.edu/prior.pdf↩
Subscribe
Discussion
1
Subscribe
Discussion
1
Posts tagged Priors
180The Solomonoff Prior is Malign
Ω
Mark Xu
5y
Ω
52
92Learning the prior
Ω
paulfchristiano
5y
Ω
28
88A Priori
Eliezer Yudkowsky
18y
133
53Priors as Mathematical Objects
Eliezer Yudkowsky
18y
20
34Learning the prior and generalization
Ω
evhub
5y
Ω
16
154Priors and Prejudice
MathiasKB
1y
31
38Separating the roles of theory and direct empirical evidence in belief formation: the examples of minimum wage and anthropogenic global warming
VipulNaik
11y
66
151Trapped Priors As A Basic Problem Of Rationality
Scott Alexander
4y
33
46Infinite-width MLPs as an "ensemble prior"
Ω
Vivek Hebbar
2y
Ω
0
34The prior of a hypothesis does not depend on its complexity
cousin_it
15y
69
26The universal prior is malign
Ω
paulfchristiano
9y
Ω
8
23Priors and Surprise
MichaelVassar
16y
32
221-page outline of Carlsmith's otherness and control series
Nathan Young
1y
3
22Chapter 49: Prior Information
Eliezer Yudkowsky
11y
8
9Cryonics priors
AnthonyC
13y
22
Load More (15/23)
Add Posts