I've been trying to learn a bit about the broader game board for alignment, and notice I'm deeply confused about certain giant blanks in my map. I'm hoping someone can at least point me to any way of thinking about questions such as:
(1) Are we actually way more doomed if Chinese AI labs win the race?
I've heard takes ranging from "China has no safety work to speak of and this is an instant bad ending" to "Xi Jinping and the CCP are broadly competent and aware of the risks and we should trust them to manage risk better than the US, if anything" to "it's not even a consideration, Chinese labs are just copycats who rely entirely on distillation and their AI labs will never overtake the west."
(2) How do I think about the possibility of government takeover of AI labs?
I've heard takes ranging from "this is an inevitability once AI crosses certain thresholds" to "the administration is too incompetent and slow-acting to possibly carry this out."
(3) Are multipolar endgames realistic?
I've heard takes ranging from "the first lab across the finish line will dominate/absorb/neutralize the competition, we should only worry about alignment at the winning lab" to "the only way we survive is if lots of different ASI's appear nearly simultaneously and keep each other in check."
(4) Should we expect sufficiently coherent AGI to intentionally pause recursive self-improvement for a substantial period of time while it solves its own alignment problem?
I've heard takes ranging from "RSI is inevitable and capabilities will go to the moon" to "Yes AGI will pause for a microsecond but it'll be easy for it to solve its own alignment problem" to "alignment is so much harder than capabilities that barely supercritical AGI will take over and pause AI development for a long time, if not indefinitely."
2:
"the administration is too incompetent and slow-acting to possibly carry this out."
I think overall competence shouldn't be the most important factor here. As I see it the Trump administration is faster acting and more willing to take flashy actions despite social and legal precedents (or even legality), and I think this is something people across the spectrum should notice (for example, I have a quite negative view of the administration, in large part because Trump will quickly take abnormal actions that I don't like. People who have a positive view of... (read more)