Thanks author for this amazing piece, especially bibliography to followup up on some of the direct sources. While I had been introduced to Normal Accident Theory a decade ago, I wasn't familiar with the HEVCR model and it definitely opens up new -- and very practical -- doors to thinking about existential risk in the context of AI.
If use the HEVCR what are the actual "exposure" and "vulnerability" issues for humanity? At least, I would assert that the exposure and vulnerability will vary widely between individuals and population groups. That is a stunning insight that in and of itself deserves future work.
Maybe it's even worse and we're just ms dos. Nobody bothers to emulate us except for the fun games
What a beautiful explanation. This relates to politics that a policy suggestion makes logical sense for most parties but still presents an unknown tiny risk therefore most politicians decide doing nothing is the best bet in most cases