This is a special post for quick takes by Linch. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
What are people's favorite arguments/articles/essays trying to lay out the simplest possible case for AI risk/danger?
Every single argument for AI danger/risk/safety I’ve seen seems to overcomplicate things. Either they have too many extraneous details, or they appeal to overly complex analogies, or they seem to spend much of their time responding to insider debates.
I might want to try my hand at writing the simplest possible argument that is still rigorous and clear, without being trapped by common pitfalls. To do that, I want to quickly survey the field so I can learn from the best existing work as well as avoid the mistakes they make.
Here's a slide from a talk I gave a couple of weeks ago. The point of the talk was "you should be concerned with the whole situation and the current plan is bad", where AI takeover risk is just one part of this (IMO the biggest part). So this slide was my quickest way to describe the misalignment story, but I think there are a bunch of important subtleties that it doesn't include.
Yeah I believe this too. Possibly one of the relatively few examples of the midwit meme being true in real life.
3basil.halperin
* Y'all are over-complicating these AI-risk arguments by Dynomight
* AI Alignment, Explained in 5 Points, by Daniel Eth
* The case for taking AI seriously as a threat to humanity, by Kelsey Piper
