[Possible trigger warning for discussion of mortality.]
I've been on LessWrong for a very long time. My first exposure to the power of AI was in the mid 1980's, and I was easily at "shock level 4" at the turn of the millennium thanks to various pieces of fiction, newsgroups, and discussion boards.
My current best guess is that there's a double-digit percentage chance the human race (uploads included) will go extinct in the next century as a result of changes due to AI.
With that background in mind, existential AI risk is not my highest priority, and I am making no meaningful effort to address that risk other than sometimes posting comments here on LW. This post is an attempt to provide some insight into why, to others who might not understand.
Put bluntly, I have bigger things to worry about than double digit odds of extinction in the next century due to AI, and I am a rather selfish individual.
What could possibly be more important than extinction? At the moment, that would be an extremely solid 50% chance of death in the next 3-4 decades. That's not some vague guesswork based on hypothetical technological advances; it's a hundred thousand people dying per day, every day, as they have been for the last century, each death contributing data to the certainty of that number. That's two decades of watching the health care system be far from adequate, much less efficient.
Consider that right now, in 2022, I am 49 years old. In 2030 I'll be 57, and there's good reason to believe that I'll be rolling 1d100 every year and hoping that I don't get unlucky. By 2040, it's 1d50, and by 2050 it's 1d25. Integrate that over the next three decades and it does not paint a pretty picture.
Allow me a moment to try to convey the horror of what this feels like from the inside: every day, you wonder, "is today the day that my hardware enters catastrophic cascading failure?" Every day, it's getting out a 1d10 and rolling it five times, knowing that if they all come up 1's it's over. I have no ability to make backups of my mind state; I cannot multihost or run multiple replicas; I cannot even export any meaningful amount of data. The high reliability platform I'm currently running on needs to fail exactly once and I am permanently, forever, dead. My best backup plan is a single digit probability that I can be frozen on death and revived in the future. (Alcor provides at best only a few percent odds of recovery, but it's better than zero and it's cheap.)
That's what it feels like after you've had your first few real health scares.
I'd like to say that I'm noble enough, strong enough as a rationalist that I can "do the math" and multiply things out, take into account those billions of lives at risk from AI, and change my answer. But that's where the selfish aspect of my personality comes in: I turns out that I just don't care that much about those lives. I care a lot more about personally surviving the now than to have everyone survive the later.
It's hard to care about the downfall of society when your stomach is empty and your throat is parched. It's hard to care about a century from now, when death is staring you in the face right now.
Apologies for the absence; combination of busy/annoyance with downvotes, but I could also do a better job of being clear and concise. Unfortunately, after having given it thought, I just don't think your request is something I can do for you, nor should it be. Honestly, if you were to simply take my word for it, I'd wonder what you were thinking. But good information, including primary sources, is openly accessible, and it's something that I encourage those with the interest to take a deep dive into, for sure. Once you go far enough in, in my experience, there's no getting out, unless perhaps you're way more demanding of utter perfection in scientific analysis than I am, and I'm generally seen as one of the most demanding people currently in the PL-memory field, to the point of being a bit of a curmudgeon (not to mention an open sympathizer with skeptics like CSICOP, which is also deeply unpopular). But it takes a commitment to really wanting to know one way or the other. I can't decide for anyone whether or not to have that.
I certainly could summarize the findings and takeaways of afterlife evidence and past-life memory investigations for a broad audience, but I haven't found any reason to assume that it wouldn't just be downvoted. That's not why I came here anyways; I joined to improve my own methods and practice. I feel that if I were interested in doing anything like proselytizing, I would have to have an awfully low opinion of the ability of the evidence to speak for itself, and I don't at all. But you tell me if I'm taking the right approach here, or if an ELI5 on the matter would be appropriate and/or desired. I'd not hesitate to provide such content if invited.
[Possible trigger warning for discussion of mortality.]
I've been on LessWrong for a very long time. My first exposure to the power of AI was in the mid 1980's, and I was easily at "shock level 4" at the turn of the millennium thanks to various pieces of fiction, newsgroups, and discussion boards.
(If you're curious, "The metamorphosis of prime intellect", "Autonomy", and "A fire upon the deep" all had large impact on me.)
My current best guess is that there's a double-digit percentage chance the human race (uploads included) will go extinct in the next century as a result of changes due to AI.
With that background in mind, existential AI risk is not my highest priority, and I am making no meaningful effort to address that risk other than sometimes posting comments here on LW. This post is an attempt to provide some insight into why, to others who might not understand.
Put bluntly, I have bigger things to worry about than double digit odds of extinction in the next century due to AI, and I am a rather selfish individual.
What could possibly be more important than extinction? At the moment, that would be an extremely solid 50% chance of death in the next 3-4 decades. That's not some vague guesswork based on hypothetical technological advances; it's a hundred thousand people dying per day, every day, as they have been for the last century, each death contributing data to the certainty of that number. That's two decades of watching the health care system be far from adequate, much less efficient.
Consider that right now, in 2022, I am 49 years old. In 2030 I'll be 57, and there's good reason to believe that I'll be rolling 1d100 every year and hoping that I don't get unlucky. By 2040, it's 1d50, and by 2050 it's 1d25. Integrate that over the next three decades and it does not paint a pretty picture.
Allow me a moment to try to convey the horror of what this feels like from the inside: every day, you wonder, "is today the day that my hardware enters catastrophic cascading failure?" Every day, it's getting out a 1d10 and rolling it five times, knowing that if they all come up 1's it's over. I have no ability to make backups of my mind state; I cannot multihost or run multiple replicas; I cannot even export any meaningful amount of data. The high reliability platform I'm currently running on needs to fail exactly once and I am permanently, forever, dead. My best backup plan is a single digit probability that I can be frozen on death and revived in the future. (Alcor provides at best only a few percent odds of recovery, but it's better than zero and it's cheap.)
That's what it feels like after you've had your first few real health scares.
I'd like to say that I'm noble enough, strong enough as a rationalist that I can "do the math" and multiply things out, take into account those billions of lives at risk from AI, and change my answer. But that's where the selfish aspect of my personality comes in: I turns out that I just don't care that much about those lives. I care a lot more about personally surviving the now than to have everyone survive the later.
It's hard to care about the downfall of society when your stomach is empty and your throat is parched. It's hard to care about a century from now, when death is staring you in the face right now.