Epistemic status: Probably a terrible idea, but fun to think about, so I'm writing my thoughts down as I go.
Here's a whimsical simple AGI governance proposal: "Cull the GPUs." I think of it as a baseline that other governance proposals should compare themselves to and beat.
The context in which we might need an AGI governance proposal:
Suppose the world gets to a point similar to e.g. March 2027 in AI 2027. There are some pretty damn smart, pretty damn autonomous proto-AGIs that can basically fully automate coding, but they are still lacking in some other skills so that they can't completely automate AI R&D yet nor are they full AGI. But they are clearly very impressive and moreover it's generally thought that full AGI is not that far off, it's plausibly just a matter of scaling up and building better training environments and so forth.
Suppose further that enough powerful people are concerned about possibilities like AGI takeoff, superintelligence, loss of control, and/or concentration of power, that there's significant political will to Do Something. Should we ban AGI? Should we pause? Should we xlr8 harder to Beat China? Should we sign some sort of international treaty? Should we have an international megaproject to build AGI safely? Many of these options are being seriously considered.
Enter the baseline option: Cull the GPUs.
The proposal is: The US and China (and possibly other participating nations) send people to fly to all the world's known datacenters and chip production facilities. They surveil the entrances and exits to prevent chips from being smuggled out or in. They then destroy 90% of the existing chips (perhaps in a synchronized way, e.g. once teams are in place in all the datacenters, the US and China say "OK this hour we will destroy 1% each. In three hours if everything has gone according to plan and both sides seem to be complying, we'll destroy another 1%. Etc." Similarly, at the chip production facilities, a committee of representatives stands at the end of the production line basically and rolls a ten-sided die for each chip; chips that don't roll a 1 are destroyed on the spot.
All participating countries agree that this regime will be enforced within their spheres of influence and allow inspectors/representatives from other countries to help enforce it. All participating countries agree to punish severely anyone who is caught trying to secretly violate the agreement. For example, if a country turns out to have a hidden datacenter somewhere, the datacenter gets hit by ballistic missiles and the country gets heavy sanctions and demands to allow inspectors to pore over other suspicious locations, which if refused will lead to more missile strikes.
Participating countries can openly exit the agreement at any time (or perhaps, after giving one-month notice or something like that?). They just can't secretly violate it. Also presumably if they openly exit it, everyone else will too.
Note that after the initial GPU destruction in the datacenters, the inspectors/representatives can leave, and focus all their efforts on new chip production.
That's it.
The idea is that this basically slows the speed of AI takeoff by 10x (because compute will be the bottleneck on AI R&D progress around this time). And a slower takeoff is good! It's great for avoiding misalignment/loss of control, which is in everyone's interest, and it's also great for avoiding massive concentration of power, which is in most people's interest, and it's also good for avoiding huge upsets in the existing balance of power (e.g. governments being puppeted by corporations, China or US having their militaries become obsolete) which is something that most powerful actors should be generically in favor of since they are currently powerful and therefore have more to lose in expectation from huge upsets.
Would sending or transferring the ownership of the GPUs to an AI safety organization instead of destroying them be a significantly better option?
PRO:
- The AI safety organizations would have much more computing power
CON:
- The GPUs would still be there and at risk of being acquired by rogue AIs or human organizations
- The delay in moving the GPUs may make them arrive too late to be of use
- Transferring the ownership has the problem that the ownership can easily be transferred back (nationalization, forced transfer, or sold back)
- This solution requires verifying that the AI safety organizations are not advancing capabilities (intentionally or not)