Imagine in 6 months or 6 years, a frontier AI model goes horribly wrong. Perhaps it releases a synthetic virus which kills hundreds. Perhaps it shuts down the internet. Perhaps it gains control over China's nuclear armament.
Fortunately humanity survives without too much lasting damage. But in the immediate aftermath there's a clear call from the people. Something must be done. The question is, what?
Without a good answer there is a strong risk that the opportunity is squandered, or worse, that policies which sound good but are actively harmful are chosen - for example strongly limiting deployment while allowing training to continue full speed ahead.
If this scenario does occur we should be ready to answer the call. This involves:
considering how the overton window is likely to change post-disaster, and what are the most effective policies that could be easily and quickly pushed through as a result.
considering what can be done at all levels of government, both state and federal, legislative and executive.
creating concrete draft legislation and executive orders.
preparing websites explaining clearly both to the public and relevant experts our policy ideas.
keeping a low enough profile to avoid wasting too many weirdness points when the proposals are still out the overton window, but making sure relevant actors (both in government and media) are aware enough that they'll know who to call the day after.
Imagine in 6 months or 6 years, a frontier AI model goes horribly wrong. Perhaps it releases a synthetic virus which kills hundreds. Perhaps it shuts down the internet. Perhaps it gains control over China's nuclear armament.
Fortunately humanity survives without too much lasting damage. But in the immediate aftermath there's a clear call from the people. Something must be done. The question is, what?
Without a good answer there is a strong risk that the opportunity is squandered, or worse, that policies which sound good but are actively harmful are chosen - for example strongly limiting deployment while allowing training to continue full speed ahead.
If this scenario does occur we should be ready to answer the call. This involves: