LESSWRONG
LW

AI
Frontpage

-1

[ Question ]

If only the most powerful AGI is misaligned, can it be used as a doomsday machine?

by StanislavKrym
13th May 2025
1 min read
A
0
0

-1

AI
Frontpage

-1

New Answer
New Comment
Moderation Log
More from StanislavKrym
View more
Curated and popular this week
A
0
0

The scenario of AI-2027.com implies that the American AI with the help of the Chinese AI either destroys the Chinese regime or destroys China along with the USA.  What if the Chinese AI is less powerful, but, unlike the American one, is aligned to human interests in some form, be it the Deep Utopia, Chinese communism[1] or the AI god protecting the entire humanity[2] and/or teaching anyone anything too fundamental to use or to be a secret? Will the American AI, being more powerful, destroy China along with the US or will it dethrone the US while leaving Earth and a percent of resources in space to the Chinese AI? 

How do the answers to the questions above change if the US officials learn that if they don't release the AI, then[3] China will somehow receive more compute than the US, ensuring, for example, that the Chinese AI will be more powerful in a year unless the US release their AI?

  1. ^

    If both AIs are rather well-meaning, but have incompatible views on the future, then they might, for example, try to build the Deep Utopia in the US-controlled part of the world and Chinese communism in the other part. But what would they do if coexistence is actually impossible?  

  2. ^

    A similar question can be asked about the Chinese AI trying to protect the aliens, but aliens can be saved if both AIs are destroyed by World War III.

  3. ^

    Such a scenario is apparently possible if China invades Taiwan and the US economy is in big trouble. I tried to write a review of the AI-2027 forecast under the improbable assumptions that Taiwan and South Korea are destroyed in May 2025, and China, unlike the USA, does set up factories of chips, while capabilities per compute stay the same. Under these assumptions China has a far bigger chance to win the race.