Epistemic note: This essay conflates two related concepts, the tendency of humans to build civilization by exploiting Nature’s rules and the vulnerability of that same civilization to exploits in turn, under one name. I’d like a better name for these two concepts and am open to suggestions. There is a...
A lesson in courage from Washington, DC Yesterday I described an experience that impressed upon fifteen-year-old me the importance of speaking with urgency and courage when something awful is happening. I lived a fresh reminder of the importance of courage last week at PauseCon, a first-of-its-kind conference in Washington, DC...
The summer before my freshman year of high school, I attended a science-themed summer camp at the University of Florida. It was a cool week! I stood on top of a nuclear reactor. I accidentally sabotaged a lesson on overfishing and tragedy of the commons by independently reinventing the concept...
Many people who are paying attention to the trajectory of AI worry about its potential to concentrate power. I think this is a reasonable thing to worry about, with some important caveats. If someone builds a superintelligence, I think they are far more likely to die ignominiously with the rest...
This April 1st, I’m pleased to report that everything is fine. We did it! We saved the world. Congratulations, humanity. There are no more looming apocalypses, no desperate screaming crises, no unendorsedly miserable people on Earth, no creeping degeneration of death and aging existing as a perpetual affront against my...
In my occasional advising calls with aspiring AI Safety folks, one of the most common questions I get is “What courses should I take next?” I often find myself replying: “None; go do stuff instead.” Fabricando fit faber. By making, one becomes a maker. There are a lot of courses...