See my new post, "An alarm bell for the next pandemic, V. 2," for updated criteria and more historical investigation.
My last post analyzed whether the sheer volume of COVID-19 posts on LessWrong could have alerted an average reader to the seriousness of the coming pandemic. I concluded that the answer was "no." Other posters pointed out that some people did bring it up early, and that we still did an above-average job at acknowledging and preparing for the pandemic. But I am still looking for a reliable alarm bell that will ring loud enough to hear it before the stock market crashes 20% next time there's a pandemic on the horizon.
This is my attempt.
Note: This questionnaire has passed two of my historical tests so far.
1) On 2009 H1N1 (swine flu) it performed correctly, not "ringing" in the context of a stock market that just went up all year long.
Trigger to investigate
Some threshold for investigating whether to ring the alarm bell is necessary. We can't be constantly scanning the atmosphere for any sign of smoke to signal the next fire. So I want a trigger for when we should bother to look into the threat of pandemic more closely.
Most of us at least casually browse the news. Making the trigger news-linked seems sensible.
The first COVID article in the New York Times was from Jan. 8th, "China Identifies New Virus Causing Pneumonialike Illness." It was on page A13. Several stories were published in the ensuing weeks. The first article on page A1 was "The Test a Deadly Coronavirus Outbreak Poses to China’s Leadership," on January 21st, a month before the stock market crashed.
A headline article in a major newspaper seems like a good candidate as a trigger to investigate using the method I'll explain below.
A simple model of pandemic risk
I created a four-factor model to evaluate pandemic risk. The factors are transmissibility, harm, spread, and institutional signals. Each are divided into several subcategories and are presented as questions. I believe each category could have been answered in a strong "yes" days or weeks prior to Feb. 20th, the edge of the stock market crash. Anyone following the news or capable of some quick scientific literature searches should have been able to answer them correctly without having a deeper understanding of the science or doing any mathematical modeling themselves.
Factor 1: Transmissibility
- Does the disease appear to spread from human to human?
- Does the disease spread via indirect contact (coughing, sneezing)?
- Is there any evidence that the disease is transmissible before or just after the start of symptoms?
- Do any academic papers, especially in the Lancet or the New England Journal of Medicine, suggest the possibility of "risk of much wider spread," "exponential growth," or use similar phrases? Try searching "[DISEASE NAME] exponential growth" on Google Scholar.
Factor 2: Harm
- Is there evidence that the disease has a 3% or higher mortality rate among those 60 (or even younger), or 1%+ mortality among those 50 (or younger)?
- Can the disease last for two weeks in more serious cases?
- Do around 5% of patients seem to require hospitalization?
- Are there no vaccines or treatments that have been proven effective?
Factor 3: Spread
- Is the world death toll over 2,000?
- Has the disease been detected in at least 10 industrialized countries collectively containing a total of at least 1 billion people, found in people with no clear link to the original source?
- Is the disease present in major cities with strong international travel links?
- Has the disease spread in advance of a lockdown, or escaped it?
Factor 4: Institutional response
- Has a city-wide lockdown been attempted in a city of a population of at least 10 million, or have travel restrictions to or from major economies been implemented?
- Has the WHO or a similar organization declared an "emergency of international concern" or "global emergency," or issued an even more severe warning?
- Have there been several front-page news stories about the disease?
- Are there reports or warnings of shortages of medical supplies from the most-affected regions?
There are 16 questions here. My guess is that if you can answer 13 of them with a "yes," it's time to ring the alarm bell. Although it would be ideal if they all came with clear sources, it's probably better to post and reconstruct your research later, than not to post at all.
Note: as Bucky pointed out in the comments below, it would be valuable to craft a set of "alarm bell" questionnaires which, based on the actual historical availability of COVID-19 data, would have been "ringing" a month, two weeks, one week, and two days before the stock market crash.
The cutoffs I chose here were all selected to have been passed prior to Feb. 20th, but for the death toll cutoff I just chose 2,000 as a nice round number, though we only hit that number a few days before the crash. I tried to strike a balance by requiring only 13 of 16 criteria, but that again was an arbitrary choice.
Deeper reasoning on these choices is of course ideal, but I think it's still a reasonable starting point.
Ringing the alarm bell
What should you do if you run this checklist and get a score of at least 13?
Take a look at what Scott Aaronson wishes he'd told a friend on Feb. 4th. This is what he actually said, and what will likely seem reasonable to you next time you're in the same situation:
For now, I think the risk from the ordinary flu is much much greater! But worth watching to see if it becomes a real pandemic.
The outcome for his friend?
A couple days ago, the same friend who emailed me on February 4, emailed again to tell me that both of her parents (who live outside the US) now have covid-19. Her father had to go to the emergency room and tested positive. Her mother stayed home with somewhat milder symptoms. Given the overloaded medical system in their country, neither can expect a high standard of care.
This is the start of how, in hindsight, he wishes he'd responded:
HOLY SHIT!!!!!—GET YOUR PARENTS SOMEWHERE SAFE—CANCEL ALL TRAVEL PLANS—STOCK UP ON FOOD AND MASKS AND HAND SANITIZERS. SELL ALL STOCK YOU OWN!!! SHORT THE MARKET IF YOU KNOW HOW, OTHERWISE GET CASH AND BONDS. HAVE AN ISOLATED PLACE TO ESCAPE TO. IF YOU’RE FEELING ALTRUISTIC, JOIN GROUPS MAKING THEIR OWN MASKS AND VENTILATORS.
Why didn't he, or the rest of us, respond with this kind of tone and early timing?
We were all waiting for a gigantic, powerful, bright-yellow steamroller of a consensus to flatten our doubts. We needed the stock market to crash before we started really talking about it every single day. We needed everybody else to be talking about it first. We should not wait that long. We can't afford to.
This is human nature, and while it's embarrassing, it's nothing to feel guilty or ashamed about. This community has a strong focus on preparing for future catastrophes and advocating for better preparedness. We should be learning from this now.
I think we need some kind of community standard for when we ring the alarm bell. There should be a standard for when anybody can do that, with no fear of embarrassment and a great deal of praise as long as they have justification.
In some factories, anybody can push the button to cease all work on the factory floor, for any reason, with no consequences if it was a false alarm.
This is probably too easy for our purposes. On the factory floor, you can see the issue with your own eyes. Your reputation with the colleagues you work alongside is on the line, regardless of the official consequences.
That's why I like the idea of a checklist, and I'm submitting the one above as a tentative draft.
Responding to the alarm bell
If somebody rings the alarm bell, what should you do?
1. Because the first post may not have been based on the most accurate and up-to-date information, others should vet any sources submitted by the original poster, and look for better sources where they can. Compiling these sources, clipping out direct quotes that support each of the factors in the "should I ring the alarm bell" questionnaire, and writing up articles for easy sharing for a variety of audiences is a good step.
2. If my conjecture is correct, attaining a certain volume of new posts daily is key for making discussion and action on the topic feel normal. Early commentators and posters should focus on generating new topics for discussion and try to get new posts up quickly. The key is to create an appearance of robust discussion, in order to normalize it for people who are still hesitant to acknowledge pandemic as a real possibility and act accordingly.
3. Make it real for yourself. Stock up on a week's worth of groceries, other necessities, nice-to-haves.
4. Decide on and publicly announce your threshold for selling stocks. The point isn't to make a buck. It's to represent the gravity of the situation in a real way, and pull probably the biggest lever you have to signal your prediction to the economy. Remember, when you sell stock, you're not gambling: you're sending a price signal to the world. That is you ringing the alarm bell.
5. Start a conversation with your friends and family. Post on social media. Write an op-ed. Ask trusted people to investigate the evidence for themselves and write about it so that the responsibility isn't all on you. Remember, you're trying to put the key in the ignition of that gigantic steamroller of consensus opinion and turn on the motor. Make memes.
But next time it will be different
It seems possible that we'll see a global scale-up of stockpiles in the wake of this disaster. We'll have accumulated a lot of cultural knowledge about how to respond to a pandemic. Pandemic will be available in our collective memory as a real possibility. We might put in place some strong preventative measures, such as a crackdown on wild animal markets. Policies will change. Technology will advance, giving us better ability to predict, treat, and vaccinate against the next illness. The market might be on a hair trigger next time around.
Ideally, we'd have periodic global review of the state of readiness.
A convenient report would be issued, perhaps in book form, giving a priori estimates of where we'd expect the next pandemic to originate from, how our infrastructure has improved since last time, how markets have responded to warning signs that we encounter in the coming decades. We'd have the information we need to judge whether things really are different.
Ideally, next time, the checklist I've created here will not predict the onset of mass global response to pandemic accurately. That could be because we've gotten so good at responding to pandemics that the same conditions don't create cause for alarm. Or it could be that we're so good at predicting them that the market responds much earlier, hopefully with the result that we never get to the same terrible state of affairs before government and NGOs are motivated to act. Either the building gets fireproofed or the alarm bell gets more sensitive.
Modeling whether the situation has changed
It would be valuable to construct some models akin to the one above to determine whether the context for pandemic risk fundamentally changes in the future.
1. List the major weak points of our current pandemic infrastructure. Can we point to ways in which they've substantially improved compared to where we were pre-COVID-19?
2. Look at the organizations involved in signalling the next pandemic: the WHO, the CDC and its counterparts in other nations, the popular press, the Bill and Melinda Gates Foundation (who donated $100 million to fight COVID-19 in January). What would we look for to gauge their threshold for ringing the alarm bell? How would we know if it has changed relative to 2020?
3. Our improving synthetic biology infrastructure will give us more resources to monitor, treat and prevent disease. It will also give us the power to make deadlier diseases. What technological improvements would expand the ability of a rogue actor either to resurrect an old superbug like smallpox, or to create a new one? What real security do we have against this possibility? With time, what is expanding more quickly: our ability to prevent or cause harm?
4. Who nailed this pandemic prediction on the head, with evidence and arguments and confidence that make us feel like it wasn't just a lucky guess? Is there a convenient way we can keep track of them so that we have a convenient source of guidance next time? We need to establish our go-to source of wisdom so that we don't have to do all the thinking in the middle of the next crisis.
In a pandemic, a matter of weeks can make a difference of many thousands of lives, billions or trillions of dollars, and immense social disruption.
We will see another pandemic.
It might be worse. There's no clear reason why mortality and transmissibility of a virus should be inversely correlated. The next virus could be both more catching and more fatal than COVID-19.
Having clues and some commentary and a few posts here and there isn't enough.
Right now, we can't trust the established authorities to nail this. Is anybody feeling hunky dory about the way world governments are behaving now, or how they will change over time?
Nature won't provide us with a grace period. Rolling a 1 on a 20-sided die doesn't make the odds of another 1 on your next roll any less likely. Getting a heads on a coin flip doesn't increase the likelihood of getting a tails next time. The next pandemic could happen any time.