I think a lot about how to increase the chance of contributing something valuable to x-risk mitigation - and AI safety as my particular path. 5 weeks ago, @jaybailey suggested that one way to achieve that goal can be to Have an Unreasonably Specific Story about the Future (a Future That I Want, to be even more specific). Do I have a 5-minute story that helps to do this? I think yes: 1)The current environment and AI architecture incentivize continued growth in capabilities and scale, which also increase weaknesses and threats, and where agents are viewed as short-term profits and building trust at the expense of strategic resilience and rational safety. 2) Many stakeholders would lift their skepticism regarding the risks (and perhaps even advocate for a more cautious approach to AI in their own network) if presented with a compelling case of clear and present risk of irreversible damage to society, which would tilt the balance in favor of decisions that reduce the risk of catastrophic incidents 3) Creating such a case requires assessments of impacts and likelihoods that are a) accurate, high-elicitation, and up to date against the latest models, research, and threat intelligence. b) well-crafted to make immediate sense to the audience c) well publicized to reach the decision makers that matter 4) Each time I share a failure case / threat model / demo / paper, and a decision maker understands why it rises above the FUD, the alternative of stricter governance gains momentum. 5) When someone learns something, the next question is always the same. What do we do next? It's the golden moment. We organize behavior change, working extremely efficiently through chokepoints (even simplifying processes and systems to create some if necessary), to re-align systems, people, and impact. If doing this looks like a lower rate of acceleration, it is not slowing down, and if it is, that just indicates an opportunity to allocate resources more optimally - and we just show that.
The most valuable part of a story such as this, in my mind, is how it can act as a filter. Anything that does not meet your requirements can be disregarded as a line of work. From the original article: (https://www.lesswrong.com/posts/8t8jdTyq6X2B7D8St/have-an-unreasonably-specific-story-about-the-future)
"Anything that is unlikely to help with at least one of those critical paths is a strategy I reject as insufficient in my preference ordering."
So if we look at your story, it seems like the filtering line here is: "if presented with a compelling case of cl... (read more)