On The Atlantic interview with Nate Soares the interviewer, CEO of The Atlantic, makes the point at some point that if private firms gets banned from developing AI, he still expects governments to continue developing it and I would add: "and perhaps in secret". And he basically gestures "wouldn't that be even worse?
Which government on earth is going to give up these Superhackers that we have right now? You can gain complete visibility in every nation on earth with that for basically zero cost. For that reason alone after all the GPU's have been appropriated by the government, I think those trillions of dollars of GPU's won't be melted down but are going to be sitting in a cave somewhere continuing to at least develop superhackers. Which is potentially an ASI-complete problem.