The US are the Big Scary
I don't really know how to say it otherwise, and I don't have the mental health to turn this into a full post.
The US are the biggest actor in AI. Their companies are firmly nationalist, using arguments such as "we need to have the best AI to defeat our autocratic opponents". The US have whimsical politics which can decide to ruin a foreign country; Trump, POTUS now and for the critical coming years of AI takeoff, does not have the interests of even nominal allies at heart.
I often see arguments on LW about China, but they always land flat for me because China is looking very responsible on AI safety compared to the US!
Even if the US don't destroy the world out of misalignment, they'll probably vassalize it out of power concentration.
I just don't see how my non-US, democratic, liberal, non-AI-pilled country can avoid becoming a third world state dependent on the US for AI goods and services, even if it doesn't end up outright conquered.
Please don't assume that we want the US to win.
This isn't limited to non-Americans. Plenty of rightie-ish Americans are rooting for China on the basis that China at least makes overtures towards ideological and cultural pluralism, and backs them up by open-sourcing their models. It isn't trivially obvious to me that the median Trump supporter would be better off if Anthropic dominated, versus if Moonshot decisively ended the moat once and for all and open-sourced the result.
I think U.S. AI companies, and, to a degree, much of the AI Safety sphere, are making a strategic mistake by taking sides in a cu... (read more)