This is a special post for quick takes by Richard_Ngo. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
[Haven't read those fictions or the quoted spoilers]
Glad to hear you saying this. In fact, I've had a couple quite concerning conversations with a couple different people in which I'm like "so what would you do if you accidentally invented a Friendly AGI in your basement one day? what are some of your important first actions?" and they don't give one of the incredibly obvious and important answers, and don't even necessarily agree to it after I say it.
I'll add that the HM attitude extends to various other things. For example, some people around here are contemptuous of bioethics. I can see where they're coming from, but I think the attitude is quite wrong, and in particular, one does want to "bring in many stakeholders to the conversation as coequal voices", because that's how you be non-HM. Cf. https://www.lesswrong.com/posts/yH9FtLgPJxbimamKg/genomic-emancipation-contra-eugenics