[Crossposted from https://tsvibt.blogspot.com/2023/05/better-debates.html.]

When two people disagree about a proposition even though they've thought about it alot, the disagreement is often hard to resolve. There's a gulf of data, concepts, intuitions, experiences, inferences. Some of this gulf has to be resolved by the two people individually trying to collate and present their own positions more clearly and legibly, so that they can build up concepts and propositions in whoever is receiving the model. Also, most new understanding comes from people working on their own or with others who are already synced up--for the most part they already agree on what and how to investigate, they have shared context of past experience and data, they agree on background assumptions, they have a shared language, they trust each other.

But still, a lot of value comes from debate. The debaters are forced to make their evidence and logic legible. Ideas are tested against other ideas from another at least somewhat coherent perspective. Analogies and disanalogies are drawn out. Bundles of facts can be sifted, spot-checked, and compared; predictions can be resolved into updates. The case, in being laid out to the debate partner, is also made clearer to the audience. The audience can see where another expert thinks the strong and weak points are in a position.

So there's value on the table from debates. But debates usually suck. People talk past each other. They waste effort talking about non-cruxy claims. The truth about verifiable claims isn't made available, missing the chance to bring one or the other perspective into contact with reality. People cite statistics and analyses which become meaningless in a context where they can't be investigated and can't take on their full meaning by relating in detail to the discourse context.

What would a better debate look like? Below is a speculative list of ways to structure a debate so that it finds and explains more truth. As armchair speculation, this list is gesture or inspiration, not tested advice.

• Multiple rounds. Have multiple conversations with the same debaters on the same topic. Debaters sometimes have to pause a thread of conversation and go off to collect data, clarify their case, reevaluate and update, look into counterdata, come up with a more concise response to critiques, pass the other's Ideological Turing Test, or mull over the other's concepts and perspective.
• Seconds. Debaters bring seconds--people who can step in to make certain points, or can (being already versed in the perspective) efficiently work in the background to bring up information for the main debater to use.
• Free-flowing. Debates often have a regimented structure, with a fixed overall length, and alternating statements with prescribed length. Don't do that, let the debaters have back and forth.
• Technical facilitation. Offload cognitive labor from the debaters by having support people who (perhaps on big visible screens):
  • Check easily-checkable claims.
  • Bring in numbers and diagrams and exact statements from citations.
  • Map the argument. Summarize claims and counterclaims, define terms (especially clarifying how each debater uses important words), track sub-points and digressions.
  • Track stated cruxes and double-cruxes.
  • Remind the debaters of the current thread stack, if needed.
  • Filter comments from an audience.
• Discourse facilitation. Have one or two facilitators who more directly guide the discourse:
  • Encourage debaters to paraphrase each other's position, and sometimes try to pass their Ideological Turing Test.
  • Highlight when the debaters are using terms differently, or are making unshared background assumptions.
  • MC the conversation, e.g. sometimes briefly summarizing the conversation so far, and summarizing prior rounds at the beginning of subsequent rounds.
  • Help avoid blindspots. E.g. if one debater is evading answering a question, bring that to light. E.g. if there are conflicts and/or conflict-orientation in the debate, help bring that to light.
  • Check if a claim under discussion is a crux or a double-crux for the debaters.
  • Avoid the discourse getting bogged down in uninteresting and nonuseful regimes, e.g. by going back to a previous topic or asking a provoking question.
  • Process smoothing. E.g. if the debaters have two threads that they want to separately explore, the facilitator is in charge of remembering that there was the other thread and bringing it back in at some point.
  • Context holding. E.g. (somehow) make it more ok for debaters to change their mind. E.g. if one of the debaters is struggling with a thought, then if needed instruct the other to give them some moments to think quietly.
• Spirits. Somehow evoke these spirits:
  • The debaters are not trying to convince the audience of something, they're trying to communicate with each other.
  • The debaters are trying to understand where each other is coming from, e.g. they paraphrase each other and try to pass each other's ITT.
  • The debaters are trying to seek the truth, trying to coconstruct a coherent total perspective that integrates all the facts. The debate isn't a debate, it's a collision. E.g. the debate doesn't have "sides" or voting for a winner or even a fixed proposition. It's fine and encouraged if the debaters just start truth seeking and hypothesizing--thinking out loud with each other--instead of making contradictory statements. The disagreement is used as a pointer to where models are incorrect, incomplete, or not yet integrated.

To find what is actually helpful and feasible, one would have to run iterated experiments. A path could go like: first start with debates on topics that are cool/important/interesting, and are very concrete with lots of real-world data that can resolve disagreements. For example, nutrition questions like "Should you supplement with XYZ?" or "Is ABC bad for you?". Then, when the support systems are showing real value, expand into more abstract, more difficult debates, like between linguistic theories or something. Then expand into more fraught areas such as policy debates or big controversies, including policies around AI.