A follow-up (h/t LW review). I got quite a bit out of the workshop, most importantly
There was much more but much less legible and "evaluatable." I think ESE was excellent, and I would have done it even if I knew that I wouldn't get two close friendships out of it.
I'm quite interested in ICF, and it sounds pretty similar to a lot of the rationality development we're doing with Athena. Would love to chat with you all about it.
That's cool to hear!
We are hoping to write up our current thinking on ICF at some point (although I don't expect it to happened within the next 3 months) and will make sure to share it.
Happy to talk!
Remark: This post was written collectively by the organizing team of the Epistea Summer Experiment.
Cross-posted to the EA Forum here.
Epistea Summer Experiment (ESE, /ˈiːzi/) was an experimental summer workshop in Prague combining elements of applied rationality and experiential education. The main goals were to:
We consider the event successful and plan to use the insights gained for creating more content along similar lines.
The remainder of the post will outline our motivation for focusing on these goals, our takeaways, and future plans.
Most of today’s rationality curriculum and research is focused on individual rationality, or ‘how to think clearly (alone)’. The field of group rationality - or ‘how to think well and act as groups of humans’ - is less developed, and open problems are the norm.
[...] I feel like group rationality remains a largely open and empty field. There’s a lot of literature on what we do wrong, but not a lot of ready-made “techniques” just sitting there to help us get it right — only a scattering of disconnected traditions in things like management or family therapy or politics. My sense is that group rationality is in a place similar to where individual rationality was ~15 years ago [...]. (cited from ‘Open Problems In Group Rationality’, by Duncan Sabien)
The central problem is that people use beliefs for many purposes - including tracking what is true. But another, practically important purpose is coordination. We think it’s likely that if an aspiring rationalist decides to “stop bullshitting”, they lose some of the social technology often used for successfully coordinating with other people. How exactly does this dynamic affect coordination? Can we do anything about it?
There are more reasons why we believe progress in the domain of group rationality is needed. There are for example the classical problems in coordination (e.g. Moloch), communication (e.g. common knowledge and miasma), social dynamics (e.g. groupthink, pluralistic ignorance, etc.) and others. In particular, we have little know-how about how to teach the skills which are important for effectively solving any one group rationality problems (this is also called pedagogical-content knowledge or PCK).
Group rationality and group epistemics are important for all kinds of EA, long-termist and x-risk efforts, possibly more so than in most other domains. It has been observed in the past that topics related to EA are prone to coordination failures. Given the sheer size of these problems, it is unlikely any one of us will solve them alone.
Overall, we are confident that the field of group rationality is both important and neglected.
Experiential education is an educational tradition with a roughly 40-year history in Czechia. The central idea is that the process of learning often happens through directly experiencing the content - in contrast to other, more passive ‘classroom-style’ approaches to learning. Clearly, different types of content lend themselves more to one or the other pedagogical approach. For example, advanced mathematics is hard to experience directly. Understanding team dynamics or the role of trust in cooperation, on the other hand, can effectively be taught via relevant experiences.
Several members of our team have organized events of this type, some of them targeted to talented high schoolers. Judging by our personal experience, the methodology succeeds in giving people more agency and helps them coordinate in a group context. This is why we were excited to transfer the pedagogical know-how from the experiential education school of thought to teaching group rationality in particular.
We developed a new technique for increasing internal alignment called ‘Internal Communication Framework’ (ICF). [1] On the theoretical side, it is based on multi-agent mind models, predictive processing and game theory (for more theory behind our effort, see Jan's post and Kaj's sequence). On the practical side, it draws from Internal Family Systems (IFS) and Internal Double Crux (IDC).
Our goal for the event was to gather more data and we have anecdotal evidence that the technique is useful for increasing internal alignment in individuals.
Since the event was highly experimental, we did not extend our outreach efforts to a broad audience and instead targeted the event to people who already had prior experience with applied rationality. Our participants were CFAR alumni, members of the Moscow Kocherga hub and other people with a similar background. The motivation behind this was to minimize the risks in cases where our content wouldn’t work. Specifically, we wanted to avoid several failure modes, including idea inoculation, PR risks and destabilizing participants prone to mental health issues. (We also warned everyone that the content was experimental.)
In creating the activities, we drew a lot of inspiration from the Czech Experiential Learning Centre. Over the years, they have accumulated an impressive amount of knowledge and a library of activities ranging from outdoor games to deep introspection methods. We adjusted some of these for our goals and created a couple of new ones. We also incorporated a few classes which were taught traditionally (i.e. classroom-style) to introduce relevant concepts. Part of the content was created originally by Epistea, based mainly on theoretical reasoning.
After generating a set of individual activities, we arranged them into a 6-day long program while taking into account program coherence, the need to balance mental and physical intensity for participants, the overarching plotline, and other factors.
Examples of activities or techniques used are:
Overall we consider the workshop successful:
We also made mistakes:
Though the participants’ feedback was positive, the sample size collected last summer is small. We will continue to experiment with rationality education along similar lines and gather more data. Our future plans include events focused on group rationality, epistemics, ICF and also exchange of ideas among rationality teachers. Further information on these will follow soon. If you want to make sure not to miss information on future events we organize, you can fill in this form.
[1] As the technique and the right method of teaching it are still in development, there isn’t any public write up available.
[2] There is going to be a follow-up survey to check if the participants retained the knowledge and how they evaluate the experience after a longer period of time.