LESSWRONG
LW

2230
Wikitags

Bayesianism

Edited by Ruby, Eliezer Yudkowsky, Vladimir_Nesov, et al. last updated 18th Jun 2023

Bayesianism is the broader philosophy inspired by Bayes' theorem. The core claim behind all varieties of Bayesianism is that probabilities are subjective degrees of belief -- often operationalized as willingness to bet.

See also: Bayes theorem, Bayesian probability, Radical Probabilism, Priors, Rational evidence, Probability theory, Decision theory, Lawful intelligence, Bayesian Conspiracy.

This stands in contrast to other interpretations of probability, which attempt greater objectivity. The frequentist interpretation of probability has a focus on repeatable experiments; probabilities are the limiting frequency of an event if you performed the experiment an infinite number of times.

Another contender is the propensity interpretation, which grounds probability in the propensity for things to happen. A perfectly balanced 6-sided die would have a 1/6 propensity to land on each side. A propensity theorist sees this as a basic fact about dice not derived from infinite sequences of experiments or subjective viewpoints.

Note how both of these alternative interpretations ground the meaning of probability in an external objective fact which cannot be directly accessed.

As a consequence of the subjective interpretation of probability theory, Bayesians are more inclined to apply Bayes' Theorem in practical statistical inference. The primary example of this is statistical hypothesis testing. Frequentists take the application of Bayes' Theorem to be inappropriate, because "the probability of a hypothesis" is meaningless: a hypothesis is either true or false; you cannot define a repeated experiment in which it is sometimes true and sometimes false, so you cannot assign it an intermediate probability.

Bayesianism & Rationality

Bayesians conceive rationality as a technical codeword used by cognitive scientists to mean "rational". Bayesian probability theory is the math of epistemic rationality, Bayesian decision theory is the math of instrumental rationality. Right up there with cognitive bias as an absolutely fundamental concept on Less Wrong.

Other usages

The term "Bayesian" may also refer to an ideal rational agent implementing precise, perfect Bayesian probability theory and decision theory (see, for example, Aumann's agreement theorem).

Subscribe
Discussion
4
Subscribe
Discussion
4
Posts tagged Bayesianism
16Approximately Bayesian Reasoning: Knightian Uncertainty, Goodhart, and the Look-Elsewhere Effect
RogerDearnaley
2y
2
143Probability is in the Mind
Eliezer Yudkowsky
18y
227
120What is Bayesianism?
Kaj_Sotala
16y
218
69Searching for Bayes-Structure
Eliezer Yudkowsky
18y
49
213The Second Law of Thermodynamics, and Engines of Cognition
Eliezer Yudkowsky
18y
76
415That Alien Message
Eliezer Yudkowsky
17y
176
206My current LK99 questions
Eliezer Yudkowsky
2y
38
157Newcomb's Problem and Regret of Rationality
Eliezer Yudkowsky
18y
620
143Lawful Uncertainty
Eliezer Yudkowsky
17y
57
136No One Can Exempt You From Rationality's Laws
Eliezer Yudkowsky
18y
53
124Bayesian Injustice
Kevin Dorst
2y
10
117Terminal Values and Instrumental Values
Eliezer Yudkowsky
18y
46
117Beautiful Probability
Eliezer Yudkowsky
18y
124
88A Priori
Eliezer Yudkowsky
18y
133
88Circular Altruism
Eliezer Yudkowsky
18y
310
Load More (15/56)
Add Posts