Cross-posted from my website. There's a vision of aligned AI where it totally restructures the accessible universe and everything is different, which isn't what I want to talk about today. I'm talking about the prosaic vision of aligned AI, where things are basically normal but better, artificial superintelligence is helpful...
Cross-posted from my website. As of a few months ago, I had this simplified mental model where either AI developers race ahead and kill everyone, or we coordinate a pause and things go okay. But my old mental model underrated the likely possibility that we get a global pause on...
Many people support stricter regulations on frontier AI, and some of those people donate to political campaigns for pro-regulation candidates. Not many people oppose AI regulations, but that group includes AI companies and execs who have giant piles of cash to throw at super PACs. This situation is made possible...
TLDR: Take the population ethics quiz here: https://mdickens.me/pop-ethics/ Population ethics is an oft-overlooked subfield within ethics. Many people hold views that they don't realize contradict each other, or that have strange implications that they wouldn't endorse if they thought about it more. Not just that—population ethics is a BIG DEAL....
I continue to believe we should pause frontier AI development. Any discussion of alternative strategies should be thought of as planning for contingencies. A unifying driver behind many post-alignment risks—catastrophic risks that remain even if we solve the alignment problem—is that by strong default, ASI would end liberal democracy. Liberalism—in...
To achieve the best possible future, we must know what that future looks like. In other words, we need to solve ethics.[1] The problem of solving ethics is so large and abstract that it’s difficult to say useful things about. In lieu of any structured analysis, herein lies a collection...
Cross-posted from my website. Some people think we should pause AI, but not now. They say we should wait until AI reaches human level, [1] because: * It's not (catastrophically) dangerous until after then. * Human-level AI will help us do safety research. Alternatively, other people (like me) think we...