Does "sure" mean 100% confidence? If so, is this a correct statement?
Or would it be more correct to say: - we're extraordinarily confident that Newton's gravitation is close to correct, - we're extraordinarily confident that Einstein's gravitation is even closer, - we're mildly confident that we will find no closer theories, though one alternative to explaining dark matter would be modified gravitation, so we're considerably less confident than we would be if there were no known evidence suggesting inaccuracies in Einstein's gravitation, by a factor of P(Einstein|DarkMatter).
"you're allowed to increase P(BadDriver) a little bit,"
No, you're really not.
You're only allowed to replace P(BadDriver) with P(BadDriver|HadOneAccident).
If you have a second accident, you replace that in turn with P(BadDriver|HadOneAccident^HadASecondAccident), which if you are rational you might reexamine and update to P(BadDriver|HadTwoAccidents^HadQuiteALotOfNearMissesIfWeAreBeingHonest)
But my point is, when applying each new piece of evidence, you have to remember the conditions that caused you to get your current probability, or you end up with naive Bayes and after seeing a few new bookcases you believe in aliens.
From earlier pages, this will be harder than it initially appears.
Say that, on hearing there was a dagger, the king also ponders what other things an assassin might carry. Poisons, for sure - an assassin would have them like 6:1 odds at least, and a non-assassin would be surely no more than 0.02:1.
Listening devices, for spying and stuff. Probably 4:1 and 0.02:1 again.
Naive Bayesian analysis would say that doctors, with their knives and stethoscopes and drugs, would be carrying tools with odds of 9 * 6 * 4 : 1 = 216 : 1 if they were an assassin, and 0.02 ...
Be wary here.
We see on the next (log probability) that a plethora of small evidences sums to a very large number of bits.
In the bookcase aliens example, if you went to 312 houses and found that every one of them had a new bookcase, then by this approach, it's time to reexamine the aliens hypothesis.
In practice, it's just simply not. Aliens are still just as unlikely as they were previously. New bookcases are now more likely.
It's time to reexamine your 50:1 in favor of aliens estimate for a new bookcase. It's time to check whether there's a really good door...
Is "-1 against" the same as "+1 for"?
Expressing the first practical example entirely in terms of negative numbers seems like a poor pedagogical choice.
Phrasing as "3 bits against" and then "a further 1 bit against" may help.
Adding that the blue ones are not a great pick if you want pearls may help people understand the direction of "against".
Is this a probability or an odd? What's a "chance"? In this list, "chance"s are expressed both as a fraction, and as a percentage, like some kind of hybrid probablodd. This feels like muddying the waters. When you're introducing a new concept like "probability and odds, while synonyms in lay speak, are different things in statistics", it's probably not good to conflate both with another lay synonym like "chance".
In this page, the terms "probability" and "odds" are used in the statistical sense of "In the classical and canonical representation of probability, 0 expresses absolute incredulity, and 1 expresses absolute credulity." (from the linked definition) and "odds are a ratio of desired outcomes vs the field" (has no linked definition, I'm just wildly guessing based on context).
Explaining this distinction clearly at the outset for non-statistically trained users, may be worthwhile.
Explaining what is meant by odds, on this page about them, may be worthwhile.
It m...
This (the ignoring of cost) seems like a flaw to Bayesian analysis, and makes me think there's probably some extension to it, which is being omitted here for simplicity, but which takes into account something like cost, value, or utility.
For example, the "cost" of a bayesian filter deciding to show a salesman a spam email is far lower than the "cost" of the same filter deciding to prevent them from seeing an email from a million-dollar sales lead.
So, while the calculation of probabilities should not take into account cost, it feels like the making decisio... (read more)