This article closely aligns to what I think, but it misses a big point. I believe the crux is not whether the END state is desirable but rather how societal upheaval should be managed in relation to AI development. Even if we believed that ASI-run society could lead to paradise (some do and some don't clearly), if we never can get there at all, this whole conversation is a moot point. Judging by how AI development is going, there's a distinct chance that we never "get there" by enraging regular people in the short term. In fact, bad planning can lead to a world that barely adopts ASI because people have revolted... (read 790 more words →)
This article closely aligns to what I think, but it misses a big point. I believe the crux is not whether the END state is desirable but rather how societal upheaval should be managed in relation to AI development. Even if we believed that ASI-run society could lead to paradise (some do and some don't clearly), if we never can get there at all, this whole conversation is a moot point. Judging by how AI development is going, there's a distinct chance that we never "get there" by enraging regular people in the short term. In fact, bad planning can lead to a world that barely adopts ASI because people have revolted... (read 790 more words →)