Crossposted to the EA Forum.
We (the Cambridge Existential Risks Initiative) ran an Existential Risks Introductory Course (ERIC) in the first quarter of 2022, aiming to introduce the field of existential risks, without being explicitly associated with any particular philosophy. We expect the programme to be most useful to people who are new to this field, and we hypothesised that we may be able to reach a different target audience by not explicitly branding it as EA.
The full curriculum we used for the programme, along with exercises and organisation spotlights, can be found here. This was primarily designed by Callum McDougall, with some inputs from the rest of the CERI team.
If you are interested in joining the next iteration of the course in Winter 2022 (either as a participant or as a facilitator), please fill out this interest form.
This post contains an overview of the course, which is followed by an abbreviated version of the syllabus for the ease of gathering feedback. The weekly summaries may also be helpful for community builders looking for summaries of any of the core readings from our syllabus.
We welcome any feedback on the content, exercises or anything else pertaining to the course, either here publicly on the Forum, or you can also reach out to us privately if you prefer that.
The course consists of 8 weeks of reading (split into core and applied). Some weeks also include exercises, which participants are encouraged to complete and discuss in the session. Each week, participants will meet for 1.5 hour sessions where they will discuss the material and exercises with a facilitator.
The topics for each week are as follows:
The first group of core materials here outlines the key ideas of Toby Ord’s book The Precipice, that we may be living in a uniquely important and dangerous time thanks to the threat of existential risks.
However, it is important to know that not everyone in the existential risks field shares these views, and there have been alternative framings proposed. The paper below discusses the drawbacks with the “Techno-Utopian Approach” to x-risks, as exemplified by books like The Precipice. We will read more of it in later sessions, but for now it is important to be aware that there are other ways of thinking about these issues.
Finally, please check out these, which relate to how we’d like you to approach our discussion sessions:
In Week 2 we start to investigate specific existential risks.
We will focus on anthropogenic risks, which arise from unique features of human society or current technology. Unlike natural risks, we can’t point to the historical record as evidence for their probability being small, meaning we could plausibly be facing more risk from them than we have at any previous time in history.
During Week 3, we will focus on the first of two particularly significant risks from future technology: engineered pathogens. We discuss some past examples of bioweapon misuse or bioresearch accidents, as well as the kind of organisations and protocols that exist to make these events less likely.
We will also discuss the different ways we can think about risks from future technology, for instance through the lens of the unilateralist’s curse (the idea that in any group, decisions made by individuals that have a significant impact on the rest of the group will be systematically made more than they should, and this problem grows as the group grows).
In Week 4, we turn our attention to the second major risk from future technology: unaligned artificial intelligence.
AI safety is a large field (it has 2 separate 8-week fellowships at Cambridge alone!). In this session, we hope to give you an overview of the key ideas: why AI could be transformative to society, why it poses risks which humanity may be currently unsuited to handle, and some of the different approaches that are being taken to try and make it go well.
This week, we’ll conclude our discussion of specific risks. We will cover dystopias (defined as a world with a functioning civilisation, but is locked into a terrible form), and extreme suffering risks (or s-risks).
Additionally, many of the risks we have discussed so far wouldn’t have occurred to researchers 50 years ago, which could make us suspect the existence of other currently unknown risks, which make themselves known as technology advances. We will discuss the possibility of such “unknown unknowns”, and what they imply for work on existential risks.
Finally, we will also provide an overview of the risk landscape, and discuss the probabilities that Ord puts on each of the risks he discusses.
Week 6 marks a movement away from discussing specific risks, and towards the kinds of broad strategies that can help mitigate a variety of risks. We will focus on how to improve forecasting & decision-making — both within organisations and at the individual level.
This week, we will discuss some different responses to the problem of existential risks. One influential school of thought is longtermism - the idea that the very long-run future impact of our actions should represent our dominant moral consideration. However, not all frameworks for thinking about x-risks need to go hand-in-hand with longtermism; in fact an over-focus on longtermism may pose some serious problems. The recently-published Democratising Risk paper offers an alternative path for the field.
Other Frameworks
Longtermism
Our Potential
One of the main ways in which we can affect the world for the better is through our careers. For this final week we hope to help you think about potential next steps for applying the ideas of existential risk reduction or longtermism to your own life and career.
If you would be interested in facilitating this course when it is run again in Winter 2022, we would love to hear from you.
The course will be virtual as default. Familiarity with the core concepts of x-risks is desirable, but you don’t have to be an expert in order to facilitate. This is designed as an introductory fellowship, so far more important are good communication skills, and an ability to stimulate productive and interesting conversations among the fellows. Overall, being a facilitator is a great way to help with outreach and field-building, as well as improve your communication skills. I can say that I’ve personally thoroughly enjoyed the experience!
If this sounds like it might be a good fit for you or someone you know, the expression of interest form can be found here.
If you or anyone you know might be interested in participating in this course, please fill out the expression of interest form here. We welcome people from all backgrounds and career stages!
We would be particularly interested in hearing if you have suggestions for: