I was surprised to learn today that the AGI Safety & Alignment at GDM is unable to veto the deployment of a potentially unsafe model unless this is escalated to and signed off by decision makers that, due to competitive pressures, are largely incentivised to lean towards deploying potentially unsafe models unless compelled otherwise by government intervention.
I believe that there is some evidence that frontier AI labs publicly welcome this sort of regulatory oversight, but Anthropic has a proposed 1.5 page frontier model transparency framework which includes some pre-deployment requirements, such as complying with a secure development framework. I'm not sure whether this document is a rough draft, but the enforcement section seemed to be pretty weak to me.
The framework as written only authorises the attorney general to seek civil penalties after a 30-day cure window — it does not authorise injunctive relief (a court order used when monetary compensation is insufficient and immediate action is required to prevent irreparable harm). I haven't thought about this carefully, but my working interpretation is that if this were adopted without further adjustments (which I don't believe is likely), it may allow deployments of a misaligned model to be legally defended against shutdown. Is my reading here correct?