This is a special post for quick takes by Richard_Ngo. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
I agree this is worth taking seriously, and I'm glad you have also converged on the interestingness of things like Vlad Nesov's ideas! I've suspected for some time that Dario's "country of geniuses in a datacenter" concept is specifically intended to allow for hedging in the case of worlds where LLMs are superhuman at a wide range of skills without triggering a singularity; the country of geniuses by some definition will arrive, and yet the world could look much the same.