We now have some useful prediction markets up on Covid issues, so it’s worth looking at what they say and thinking about what other markets we could generate. I encourage you to suggest additional markets in the comments, with as much detail as possible.

As I wrote a while ago, if you want prediction markets to be successful, you need five elements:

  1. Well Defined. The resolution mechanisms must be clear and transparent.
  2. Quick Resolution. The longer it takes, the less people will be interested.
  3. Probable Resolution. There has to be a definitive outcome most of the time.
  4. Limited Hidden Information. If others know what I don’t, I’m the sucker.
  5. Sources of Disagreement and Interest. Suckers at the table.

To these, of course, we can add an implied sixth, which is

  1. Real Money. Money talks, bullshit walks. Are we doing this or not?

Thus, now that we have Polymarket posting real Covid-19 markets, we have the potential to learn things that matter, with a level of resolution we can use, and I’m glad I’ve been able to help them figure out what markets to offer.

We need real money prediction markets if we want to rely on their information. I’m glad Metaculus exists and puts up some markets, and it’s good for getting some idea at all, but it is not remotely the same thing. Their main advantage is that, exactly because they don’t use real money, they can violate the five pillars and those who are inclined to participate at all will still participate because there is no cost of capital, need to invest tons of attention or worry about being the sucker when it’s for internet points.

Whereas at Polymarket, a prime motivation of liquidity providers is to use the markets to generate information, providing motivation in turn for others to come participate.

There are three new markets up, let’s check them out.

Will Omicron be >1% of all USA cases by the end of the year?

Here’s what it would look like betting $1000 or $10,000 on this respectively.

It was my suggestion to use a relatively low threshold like 1% of cases, in order to allow the market to resolve faster. There is an interesting and important question of whether Omicron would then fully displace Delta, but if Omicron goes from 0% to 1% in a month, going from 1% to 50% is a lot less exponential growth than that and should happen that much faster. The game is very much over at that point.

If the chance of 1% happening in time gets very low or very high, or there’s sufficient volume, other markets with other percentages and/or longer time horizons (or other locations) can be created to continue asking the questions that matter and improving our estimates. For now, it seems better to focus on only one market of this type, to ensure better liquidity.

It’s possible that some people are trading thinking that 1% isn’t that much, as opposed to it being the majority of the way to 50%, which is one of many possible sources of good trading.

For those in other countries like the UK, this is still mostly the question you care about, since the growth rates in both places will be highly correlated.

Currently the market is putting this result at about 67% to happen within the month, and you can bet four figures without too much slippage in price, and five figures if you’re confident enough to buy up to 77% to do so, which could easily be a good buy especially if you’re reacting quickly to new information. If you think that the market is off by a lot, I’d encourage you to come in and participate.

You can also choose to provide liquidity to the market to encourage other participants. If there’s back and forth trading you make a profit, but you’ll be on the wrong end of any permanent market moves, including the final move to 100% or 0%, unless you withdraw your funds first. It’s not an easy way to make a profit and needs to be timed and monitored carefully, but it is helping to generate a public good. Here we already have $10k in liquidity, so we’re already doing pretty well, but more always helps and we see signs of at least some back-and-forth trading.

The current market price at least seems reasonable. If I had to either buy or sell right now, I would buy, but I definitely wouldn’t move the market much doing so. It’s a tight timeline. We definitely have cases already, but there’s a wide range of potential transmission advantages for Omicron and a wide range of how many existing cases there are, and 1% in a month could go either way. Discussion in the comments is encouraged, especially backed by toy models and actual math.

Will the FDA give emergency use authorization or otherwise approve Paxlovid before 2022?

As I’ve noted a few times, Paxlovid Remains Illegal. When will this change?

It’s not like this is urgent or anything. Looks like it’s a toss-up whether it will happen by the end of the year.

That’s a lot of liquidity, and it’s currently at 49%. If you can figure out the timeline first, there’s a lot of profit available. You take a hit to your price when playing big, but it’s a remarkably reasonable hit if you know something.

One month from now would be fast, slightly faster than the meeting on MolnupiravirThere doesn’t seem to be any sense of special urgency coming from the FDA. The flip side is that there is outside pressure on them on this one (that hopefully I am helping to increase somewhat), and the symbolic cost of this not stretching into 2022 seems non-trivial. With Omicron now on its way, there’s more reasons to apply pressure and to accelerate the schedule, and Metaculus had this as a coin flip before we knew about Omicron. So while this could definitely go either way, I’m guessing this is somewhat low.

Will the Omicron variant be marked as a Variant Of High Consequence by the CDC before 2022?

The definition is: A VOHC has clear evidence that prevention measures or medical countermeasures (MCMs) have significantly reduced effectiveness relative to previously circulating variants.

By the definition, it seems like there is a much higher than 10% chance that this will ultimately be a variant of high consequence. The second question then is how often that would cause the CDC to make that declaration by the end of the year? The CDC tends to always be behind the curve and hates doing useful things under uncertainty, so they’d essentially need proof.

A month seems like a long time to me. By the time Omicron is 1% of cases in the USA, it seems like we should have more than enough information to know if vaccine effectiveness against infection has declined substantially, purely through looking at the data from sequenced individuals, but will type of evidence, together with the mutations and lab analyses, be considered sufficient? That’s the question being asked here, as much as the question of the physical properties of Omicron. To win on Yes, you need to win both wagers, hence the currently low price.

I definitely wouldn’t sell here unless I knew a lot more about how the CDC operates and knew they would move sufficiently slowly or demand an impossibly high standard of evidence. I’d be worried before buying that someone else did sell down to here, and that they did have that knowledge, so I’d want to investigate further.

What we’d like to know, more than whether the CDC will officially acknowledge that Omicron is a VOHC quickly, is whether Omicron actually is such a variant, and to what extent. That would unfortunately require some combination of a longer-dated market and a means of resolution that would answer the question.

I’ll also mention the market that has the highest trading volume.

Will the United States report a record high 7-day COVID-19 case average before January 1, 2022?

This market is less interesting than it was earlier, since it seems clear that we’re not on a trajectory to set a new record before the end of the year, but it seemed worth highlighting that volumes can get meaningful over time. Here, the volume has almost reached $250k.

Oracles

The problem of things like VOHC declarations not telling us what we want to know leads us to the issue of oracles.

The best way to resolve a wager is to have a reliable source and a well-defined outcome. Unfortunately, for many of the things we care most about, this is not possible. For example, suppose we wanted to know if Omicron cases were more severe, less severe or about as severe as Delta.

In theory, we could go the Metaculus route and say something like ‘of the first five published papers of the right type in the proper journals’ and come up with a tight definition. In practice, that’s not great. It potentially takes quite a long time, still involves a bunch of judgment calls and/or complex definitions, and could end up giving us the wrong answer.

This is one of the big issues with prediction markets in practice. It’s not that useful to go betting exactly how the resolution mechanism will work, or to wait around for months or years for resolution.

Another proposal is to use a social mechanism. The Augur protocol, for example, resolves markets by splitting its entire chain in two if there’s sufficiently robust disagreement, assuming the truth-tracking chain will be the valuable one. I do not much trust that assumption, and it turns truth into a social phenomenon or one about money, influence and power. You’re now predicting social reality not physical reality. That’s exactly what prediction markets are there to prevent.

As an exercise, what would happen if there was a disputed presidential election that wasn’t as clear who was right as it was in 2020? Who wins the bets on the 2020 election if January 6 goes differently? Would the actual winner win bets, or would it be a partisan dispute resolved along partisan lines?

Who do you think is going to make the College Football Playoff this year if Alabama loses a close game to Georgia? What do you think is driving that decision? The answer depends on whether you think the group that’s deciding is trustworthy, and what criteria you think they are using. Neither of these things are at all clear.

Thus, the proposal to use a trusted person, or trusted small group, as an oracle.

We can designate a trustworthy person or small group, and let that person decide the outcome. My suggestion, with his permission, is that this person be Scott Alexander.

(If asked, I would be willing as well, but Scott seems better for this.)

He’s probably not the best possible choice, but he seems like a very good choice.

We can certainly do a lot better with someone like Scott and a well-written question than an untrustworthy Oracle using murky criteria (again, see: College Football Playoff Committee) but that only goes so far. There’s still some amount of wagering about how the Oracle will think and make its decision.

I still think it is worth doing, because it allows us to ask the questions we care about and get reasonable answers. I am confident that if it is very clear by January 1 that Omicron kills more of the people it infects, that Scott will agree with this, and that if it’s similarly clear that Omicron kills less of those people, Scott would agree with that instead. There would be cases where it was less clear, and the decision could go either way and the trading gets to be about that, but that’s a price I think we need to be willing to pay. I hope we have the interest levels necessary to justify paying it.

Future Prediction Markets

What other prediction markets about Covid-19 would provide high information value, while being sufficiently well-defined and short-term? Let’s put our brainstorming caps on and see what we can come up with. There’s a lot of willingness to help get these markets going if we can figure out the right markets to offer.

In particular, what is needed are precise questions and good resolution mechanisms and information sources. The biggest barrier to asking the questions we care about, and getting the information now, is finding a reliable way to measure that information in the future.

   
New Comment
11 comments, sorted by Click to highlight new comments since:

Would love to see markets on when certain countries, like Morocco, Israel and Japan, will re-open their borders.

Essentially, the only reason they have ever closed borders is due to COVID. So the resolution would be straightforward. 

These kind of markets would have high social value, e.g. travelers to those countries hedging.

just jotting this down for now. can elaborate on the five bullet points later this weekend.

"Will XX re-open their borders for inbound flights in December?"

This question resolves positive if at least five international (5) flights land into territorial XX between December 20 and December 25.

  1. Quick Resolution. Make these markets resolve by mid-December. e.g. Morocco has closed borders until Dec 13. Will they re-open after that? If so, is the re-opening in both directions or just for inbound flights? 
  2. Probable Resolution. OK
  3. Limited Hidden Information. This is the one I'm most uncertain about. For some countries, it's unclear who exactly makes these decisions and how much hidden information there might be.
  4. Sources of Disagreement and Interest. (1) Do repatriation flights count as re-opening? (2) Some countries (like Japan, Israel) only allow their own citizens back in, not international travellers. Others (like Morocco) don't even let their citizens back.

The Paxlovid prediction market seems to offer some sort of coordination mechanism for lobbying the FDA. Imagine a professional FDA lobbyist/activist who purchases shares in the FDA approving Paxlovid before the end of the year, and then goes on to launch an energetic lobbying campaign to convince them to do it. This is just a different (and, I think, positive) spin on the "assassination market" concept.

Instead, it's a sort of "activism market," a way to indirectly organize payment for public goods even more generally.

Step 1) Convince polymarket to set up a question relevant to the activist work you'd like to accomplish. Make sure there is a concrete benchmark for that activism. How many ships will be backed up at the Port of Long Beach on Jan. 31st, 2022? Will the FDA EUA/approve Paxlovid by Dec. 31, 2021?

Step 2) Buy lots of shares contingent on a positive outcome.

Step 3) Organize an activist campaign to bring about that outcome.

Step 4) Profit!

There are definitely threats and challenges posed by this technology, but I think the positives are exciting as well and worth dwelling on!

We still need to prevent this from becoming an assassination market - we need some mechanism that prevents the equal-and-opposite outcome of a professional FDA lobbyist/activist purchasing shares in the FDA not approving Paxlovid, and then going on to run a campaign to prevent it.

That’s a good point. I think the right frame here is “activation energy” and “catalysis.”

Let’s say that for each uncertain question, the outcome is based on three factors at any given time. One is random chance. Another is potential energy - the most stable possible state. The third is activation energy - the energy input required to move from the current state to a more stable state.

Prediction-market-funded activism seems like it would just provide a catalytic input for change generally, lowering activation energy across the board.

So for the incentive effect to be net good, you’d sort of have to assume that on the whole, the long-run most stable states for social changes are best. You’d also assume that activation energy (incentives, coordination) is the main barrier to getting there from here.

So in the case of Paxlovid, if you assume that the “stable state” is getting it approved - since it’s so effective and necessary - then lowering the activation energy for activism seems likely ultimately to result in speeding its approval. Even if it got anti-Paxlovid activists motivates good, those activists would be pushing uphill.

This optimism is just a gut assumption that underpins my intuitions that prediction markets could be net good in situations like this. But that’s literally all it is at this point - a gut assumption.

[-]Zvi40

I'd be very surprised if people trading in prediction markets then battling it out to steer the FDA wouldn't be an improvement over current conditions, but I also think there's a lot of zeroes before that's something to consider.

It might just be status quo bias or cynicism-driven pattern-matching, but I feel like for any given deadline, paxlovid-is-illegal is more of a "stable state" than paxlovid-is-legal - it feels like it would be easier to lock the general public into 'paxlovid is dangerous/untrustworthy/ineffective" with a campaign against it than it would be to lock the general public into a state of "paxlovid is safe and works and we use it" with a campaign for it, although now I'm actually trying to visualise a world in which paxlovid remains illegal indefinitely in the face of evidence I feel less confident in that cynicism than I did two weeks ago.

[+][comment deleted]20

Will the mrna covid-19 vaccines be removed from the market prior to 2025?

I'm inclined to bet against my preferred outcome, for peace of mind.