LESSWRONG
LW

by [anonymous]
1 min read12th Aug 20212 answersNo comments

9

ET JaynesMind Projection FallacyProbability & StatisticsAIRationality
Frontpage

Is the objectivity of plausibility assignments assumed in the Jaynes-Cox formulation of probability theory?

This is what I mean by “the objectivity of plausibility assignments”:

 and  are propositions.  is the plausibility of  given that  is true and is represented with a real number as a result of our desiderata. Is the quantity  uniquely determined by  and ? 

If this is the case, is this one of the assumptions that we make (implicitly or explicitly) or can this be derived from our desiderata?

If not, then in what sense is the plausibility of  given  objective?

Thank you

New to LessWrong?

Getting Started

FAQ

Library

Jaynes-Cox Probability: Are plausibilities objective?
12th Aug 2021
New Answer
New Comment

2 Answers sorted by
top scoring

Dagon

Aug 12, 2021

50

Is the quantity  uniquely determined by  and ? 

No.  p(A|B) is determined by (p(B|A) * p(A)) / p(B).  All three terms are independent beliefs in plausibility level.

> If not, then in what sense is the plausibility of  given  objective?

The relationship of the different expressions of plausibility is objective.  The values are subjective.   Much like "2 + 2 = 4" is objective, but whether I actually have two coins in two pockets is subjective (or at least contingent).

[-][anonymous]3y30

Thanks! 

Objective Bayesians say that “if two different people have the same information, B, then they will assign the same plausibility ”, right? If they didn’t say this, wouldn’t they just be subjective Bayesians? 

So how is this possible without the plausibility  being uniquely determined by  and ?

Reply
3Dagon3y
If two different bayeseans have the same priors and the same evidence, they will agree.  If they have mutual knowledge of their rationality and common priors, their posteriors will converge.  Neither of these is the same as "having the same information B" when the item in question is A|B (setting B to 1, so any prior for B is irrelevant).
2TAG3y
And the same concept of, and weighting of, evidence.
3Dagon3y
Yes, "same evidence" in this context implies that it is usable in the same bayesean updates in the same way.
3[anonymous]3y
  Please see this section about Professor Jaynes’ view of priors from Wikipedia: https://en.wikipedia.org/wiki/Prior_probability#Uninformative_priors Essentially, he says that it is impossible for two people with the same information to have different priors and instead should use the same “objective prior”. Same idea for evidence as well 
1[anonymous]3y
Hmmm... I see what you mean but I am not sure if that is the understanding of the Jaynes-Cox school of thought. Please see the picture below ⬇️ - it is from pages 44-45 of Professor Jaynes’ book. Have I misunderstood what Professor Jaynes is saying?
3Dagon3y
It's easy to get tripped up here, because authors are describing theoretical perfect agents, but saying "people" to sound somewhat accessible.  My old intro to physics book started with an assertion that "in this text, we will assume that all elephants are perfectly spherical, frictionless, and uniformly dense".  This was good for calculating orbital mechanics or collisions, but very bad for understanding anything about pachyderms. 1) people NEVER have the same information.  They have different experiences, and can only imperfectly communicate those experiences with each other.  They don't actually do bayesean updates - there's a bunch of heuristics and summaries that go on in our cognition. 2) Hypotheses about universal common priors are pretty shaky.  Selection bias in the universe of considered options is just one way that what you probably think of as "prior" is actually a posterior belief from very early learning.
1[anonymous]3y
Ahhh... that makes a lot of sense -Thank you! A couple of things that I still find a bit confusing: 1. ‘It's easy to get tripped up here, because authors are describing uniformly-dense spherical objects, but calling them "elephants" to make it sound more accessible.’ - So what is the difference between objective Bayesianism and subjective Bayesianism? And do you have any references to show that what you describe is the view of the objective Bayesian school of thought? Although your explanation makes a lot of sense, it does seems to contradict the obvious meaning of the text that I quoted above, which is the bible of objective Bayesianism, so I would appreciate some references that show that the author is actually ‘describing uniformly-dense spherical objects, but calling them "elephants" to make it sound more accessible.’ 2. Professor Jaynes says “It is ‘objectivity’ in this sense that is needed for a scientifically respectable theory of inference.” - How can scientists make claims like “everyone should prefer hypothesis 1 over hypothesis 2 because of the evidence” when they can only talk about the plausibility of the hypotheses given the information that they have which is obviously different to the information that everyone else has? Does every individual have to verify the claims of scientists independently given their own information? 3. ‘Hypotheses about universal common priors are pretty shaky.’ - Are you saying that “a priori” probability distributions don’t exist? This seems to contradict the objective Bayesian viewpoint (please see the quotation below ⬇️ from the Wikipedia page on Uninformative priors)
3Dagon3y
I should probably have stated earlier that I'm more interested in practical and human-level (and medium-term artificial agents, with far more calculating power than humans, but still each a tiny subset of the actual universe), than in academic or theoretical distinctions.   I am not well-positioned to explain or defend the idea of "objective" probability.  There may be such a thing in toy situations, but I haven't seen any path from micro to macro that makes me believe it's feasible for anything real.
1[anonymous]3y
I see... Thanks a lot for your help anyway. Much appreciated. I’m actually quite new to this forum so I would really appreciate it if someone could point me to the seasoned objective Bayesians here
[-]Carlos Javier Gil Bellosta2y10

I would only like to note that in the conception of probability of Jaynes, Keynes and others, it makes no sense to talk about P(A). They all assume that probabilities do not happen in the void and that you are always "conditioning" on some previous knowledge, B. So they would always write P(A|B) where other authors/schools just write P(A).

Reply

Charlie Steiner

Aug 13, 2021

20

Sort of?

There is a sense in which Cox's theorem and related formalizations of probability assume that the plausibility of (A|B) is some function F(A,B). But what they end up showing is not that F is some specific function, just that it must obey certain rules (the laws of probability).

So the objectivity is not in the results of the theorem, it's more like there's an assumption of some kind of objectivity (or at least self-consistency) that goes into what formalizers of probability are willing to think of as a "plausibility" in the first place.

[-][anonymous]3y20

Thinking about again, I am not sure if the assumption that such a function F exists is as intuitive as I first thought. We are trying to formalise the intuitive concept of the plausibility of a A given B, i.e. “how true the proposition A is given that we know that the proposition B is true”, and this assumption seems to contradict some of our, at least my, intuitions about plausibility.

For example, suppose A is some proposition suppose B is a proposition which tells us absolutely nothing about A. Maybe B = “1+2=3” and A = “The earth is not flat 🌎”. Intuit... (read more)

Reply
2JBlack3y
  I'm not sure what your objection is here. You appear to be using propositions A and B that we believe to be almost certainly true, in which case the plausibility of A given B must be very close to 1 by definition. Maybe you meant to negate B? In general though, yes Cox's result is an existence proof, not a uniqueness one. It means that under given reasonable conditions you can use probability theory, but doesn't tell you what probabilities to assign to which propositions. Jaynes' extension of this to objective probabilities is much more controversial and does not have anything like a mathematical proof.
1[anonymous]3y
Thanks for the reply! Sorry about that. Think it would have been clearer if chose a different A and B. But I believe the argument still holds because by (A|B), I did not mean (A|B, I) where I is the background information (I should have been clearer about this as well as I am going against the convention). So basically, we have are not conditioning on any background information so (A|B) is not close to one by definition. Well what does it prove the existence of? Are you saying that Cox’s theorem implies the existence of a function F such that [the plausibility (A|B) = F(A, B) for any propositions A and B]?  I do not think that Professor Jaynes’ theory necessarily warrants a mathematical proof as we are only trying to formalise our intuitions about plausibilities. My contention is that Professor Jaynes’ theory contradicts our intuitions about plausibilities and hence the necessity of an “imprecise” theory of plausibility which addresses this problem. We cannot argue that Cox’s theorem justifies Professor Jaynes’ theory if we start with axioms which are not consistent with our understanding of plausibility. This is what David Chapman argues: Chapman discusses this in more detail here: Probability theory does not extend logic.  
[-][anonymous]3y10

Fantastic answer! Thanks a lot - I really appreciate it

Reply
Moderation Log