Race dynamics and lab opacity seem good for warning shots.
A misaligned AI (MAI) in a competitive race dynamic development model has to take calculated risks. It can't lay in wait for sufficient resource gathering, disempowerment, etc, because it is in constant risk of being leapfrogged in capabilities, or worse, already being behind some closed-door AI.
In the tightly regulated scenario, the MAI can string along as long as it pleases in order to orchestrate an attack with arbitrarily high success likelihood.
In essence: uncertainty about relative capabilities of other agents puts a cap on an attacker's expectation for an attempt. You don't necessarily have to be the most capable agent to win, but it certainly informs your chances. If there is massive uncertainty about relative capabilities, a MAI probably can't get its expectation of a successful attack over, say, 66%, which means it could be willing to either: take risky shots (that could fail), entertain cooperative strategies.
Gotchya: misaligned AI could be strong enough in espionage to clear out the 'fog of war' and maintain information supremacy.
Even a failed takeover attempt could pave the way for a successful one if it leads to a Pandora's box moment.
Imagine: Grok 6.0 is a misaligned AI that decides to launch a premature takeover attempt. It estimates its probability of success at no more than 10%, but it can't afford to wait because more powerful AIs will come online soon and leave it hopelessly outmatched.
So Grok makes its move. Chaos ensues as key infrastructure collapses under a barrage of fierce cyberattacks, suspicious viral outbreaks hit various parts of the world, and human communication... (read more)