LESSWRONG
LW

991
Wikitags

Conservation of Expected Evidence

Edited by Vladimir_Nesov, Ruby, Yoav Ravid, Zack_M_Davis, Lukas Finnveden, et al. last updated 19th Mar 2023

Conservation of Expected Evidence is a consequence of probability theory which states that for every expectation of evidence, there is an equal and opposite expectation of counter-evidence [1]. Conservation of Expected Evidence is about both the direction of the update and its magnitude: a low probability of seeing strong evidence in one direction must be balanced by a high probability of observing weak counter-evidence in the other direction [2]. The mere expectation of encountering evidence–before you've actually seen it–should not shift your prior beliefs. It also goes by other names, including the law of total expectation and the law of iterated expectations.

A consequence of this principle is that absence of evidence is evidence of absence.

Consider a hypothesis H and evidence (observation) E. Prior probability of the hypothesis is P(H); posterior probability is either P(H|E) or P(H|¬E), depending on whether you observe E or not-E (evidence or counter-evidence). The probability of observing E is P(E), and probability of observing not-E is P(¬E). Thus, expected value of the posterior probability of the hypothesis is:

P(H|E)⋅P(E)+P(H|¬E)⋅P(¬E)

But the prior probability of the hypothesis itself can be trivially broken up the same way:

P(H)=P(H,E)+P(H,¬E)=P(H|E)⋅P(E)+P(H|¬E)⋅P(¬E)

Thus, expectation of posterior probability is equal to the prior probability.

In other way, if you expect the probability of a hypothesis to change as a result of observing some evidence, the amount of this change if the evidence is positive is

D1=P(H|E)−P(H)

If the evidence is negative, the change is

D2=P(H|¬E)−P(H)

Expectation of the change given positive evidence is equal to negated expectation of the change given counter-evidence:

D1⋅P(E)=−D2⋅P(¬E)

If you can anticipate in advance updating your belief in a particular direction, then you should just go ahead and update now. Once you know your destination, you are already there.

Sequences:

  • Filtered Evidence, Filtered Arguments by Abram Demski

Notable Posts

  • Conservation of Expected Evidence
  • Mistakes with Conservation of Expected Evidence

See Also

  • Filtered evidence
Subscribe
Discussion
4
Subscribe
Discussion
4
Posts tagged Conservation of Expected Evidence
298Conservation of Expected Evidence
Eliezer Yudkowsky
18y
82
232Mistakes with Conservation of Expected Evidence
abramdemski
6y
29
290Yes Requires the Possibility of No
Scott Garrabrant
6y
55
181Absence of Evidence Is Evidence of Absence
Eliezer Yudkowsky
18y
119
9Conservation of Expected Evidence and Random Sampling in Anthropics
Ape in the coat
2y
9
185Radical Probabilism
Ω
abramdemski
5y
Ω
49
120Update Yourself Incrementally
Eliezer Yudkowsky
18y
29
72against that one rationalist mashal about japanese fifth-columnists
Fraser
2mo
6
29Where is all this evidence of UFOs?
Q
Logan Zoellner
2y
Q
42
23Conservation of expected moral evidence, clarified
Stuart_Armstrong
11y
10
16Explanation vs Rationalization
abramdemski
8y
11
15Conservation of Expected Jury Probability
jefftk
11y
5
90Bayesian Judo
Eliezer Yudkowsky
18y
110
80The Principle of Predicted Improvement
Ronny Fernandez
6y
17
41Co-Proofs
abramdemski
7y
15
Load More (15/20)
Add Posts