Random Tag

Contributors

You are viewing revision 1.0.0, last edited by DanielLC

Log odds are an alternate way of expressing probabilities, which simplifies the process of updating them with new evidence. Unfortunately, it is difficult to convert between probability and log odds. The log odds is the log of the odds ratio. Thus, the log odds of A are logit(P(A)) = log(P(A)/P(¬A)).

$P(A|B) = P(B|A)\frac{P(A)}{P(B)}$

$P(\neg A|B) = P(B|\neg A)\frac{P(\neg A)}{P(B)}$

$\frac{P(A|B)}{P(\neg A|B)} = \frac{P(B|A)}{P(B|\neg A)}\frac{P(A)}{P(\neg A)}$

$\log\left(\frac{P(A|B)}{P(\neg A|B)}\right) = \log\left(\frac{P(B|A)}{P(B|\neg A)}\right) + \log\left(\frac{P(A)}{P(\neg A)}\right)$

$logit\left(P(A|B)\right) = \log\left(\frac{P(B|A)}{P(B|\neg A)}\right) + logit\left(P(A)\right)$

Thus, in order to find the posterior log odds *l**o**g**i**t*(*P*(*A*|*B*)), one simply adds the prior log odds ratio *l**o**g**i**t*(*P*(*A*)) by the log of the likelihood ratio $\log\left(\frac{P(B|A)}{P(B|\neg A)}\right)$.

The base of the logarithm doesn't matter so long as it's consistant, and the natural log is usually used.

Suppose you have a box that has a 5% chance of containing a diamond. You also have a diamond detector that beeps half of the time if there is a diamond, and one fourth of the time if there is not. You wave the diamond detector over the box and it beeps.

The prior log odds of the box containing a diamond are ln(1/19) = -2.94. The log of the likelihood ratio of a beep is ln((1/2)/(1/4)) = ln(2) = 0.69. The posterior log odds are -2.94 + 0.69 = -2.23. This corresponds to an odds ratio of e^-2.23 = 0.108:1, and thus a probability of 0.108/1.108 = 0.097 = 9.7%. The correct answer is actually 9.5%. There was error due to rounding.