This is a special post for quick takes by jelly. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
I found that listing things as a hierarchy, like a taxonomy, immensely dissolved my confusion about what to do in both AI safety and my personal life. I had been picturing the AI safety field as something vague and huge and confusing, but breaking it down into categories and subcategories made it much easier to think about. Not only that made it clear simply because writing things down is helpful, but the hierarchy feature itself chunks/abstracts things to make it easier on my working memory. In hindsight it feels really obvious, but the effect was much larger than I expected.
Also, here's my AI safety taxonomy. I wrote it only for myself so there may be some confusing parts and some missing here and there
taxonomy
ai safety
technical ai safety
prosaic ai safety
persona selection model
interp
mech interp
activation oracles
j-space
model diffing
scalable oversight
automated ai alignment
agent foundations
learning-theoretic agenda
natural abstractions
synthesizing standalone world-models
embedded agency
decision theory
ai control
evals
meta-philosophy
brain-like agi
corrigibility
non-technical ai safety work
forecasting
buy time
politics ...
impact on outside society
recruit more people
persuade more people, i.e. advocacy
politics
international coordination
funding
awareness of cybersecurity
awareness of what other "ai safety" people are doing?
awareness of which ai lab is winning the race?
taking care of the rationality community
useful questions to ask are:
which of these is [some content about ai safety] related to?
which is missing from this list because of [some content about ai safety]?
when i contribute to ai safety, which of these do i target?