This is a special post for quick takes by MikkW. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
It's a shame that in practice Aumann Agreement is expensive, but we should try to encourage Aumann-like updating whenever possible.
While, as I pointed out in my previous shortform, Aumann Agreement is neither cheap nor free, it's powerful that simply by repeatedly mutually communicating the fact that they have opposing beliefs, two people can come to arrive at (in theory) the same beliefs together, that they would have if they had access to all the information the other person has, even without being aware of the specific information the other person has.
While it's not strictly necessary, Aumann's proof of the Agreement Theorem assumes that A) both agents are both honest and rational, and importantly: B) both agents are aware that the other is honest and rational (and furthermore, that the other agent knows that they know they are rational, and so on). In other words, the rationality and honesty of each agent is presumed to be common knowledge between both agents.
In real life, I often have conversations with people (even sometimes on LW) who I'm not sure are honest, or rational, and who I'm not sure consider me to be honest and rational. Lack of common knowledge of honesty is a deal-breaker, and the lack of common knowledge of rationality, while not a deal-breaker, slows the (already cumbersome) Aumann process down quite a bit.
So, I invite you to ask: How can we build common knowledge of our rationality and honesty? I've already posted one shortform on this subject, but there's more to be said.
I don't think there's any shortcut. We'll have to first become rational and honest, and then demonstrate that we're rational and honest by talking about many different uncertainties and disagreements in a rational and honest manner.
Not sure I agree with you here. Well, I do agree that the only practical way I can think of to demonstrate honesty is to actually be honest, and gain a reputation for honesty. However, I do think there are ways to augment that process: right now, I can observe people being honest when I engage with their ideas, verify their statements myself, and update for the future that they seem honest; however, this is something that I generally have to do for myself, and if someone else comes along and engages with the same person, ... (read more)