LESSWRONG
LW

AI
Frontpage

3

Three Paths to Existential Risk from AI

by harsimony
16th Jun 2021
1 min read
2

3

This is a linkpost for https://harsimony.wordpress.com/2021/06/09/three-paths-to-existential-risk-from-ai/
AI
Frontpage

3

Three Paths to Existential Risk from AI
2Charlie Steiner
1harsimony
New Comment
2 comments, sorted by
top scoring
Click to highlight new comments since: Today at 11:24 AM
[-]Charlie Steiner4y20

Description? Also, none of your scenarios seem to involve a big intelligence or multitasking advantage - its certainly harder to imagine humans getting outwitted in many different ways in rapid sequence, culminating in an extremely efficient gain of power for the AI, but it actually seems more realistic to me for a fast takeoff (the other option being something like Paul's "gradual loss of control" slow takeoff).

Reply
[-]harsimony4y10

Good points. I would imagine that all of these scenarios are made possible by an intelligence advantage, but I did not make that explicit here.

Your point about multitasking (if I understood it correctly) is important too. We can imagine an unfriendly-AI pursuing all 3 paths to existential catastrophe simultaneously. The question becomes, are there prevention strategies for combinations of existential-risk-paths which work better than simply trying to prevent individual paths? I have to think on that more.

Reply
Moderation Log
More from harsimony
View more
Curated and popular this week
2Comments