I have various thoughts on the actual topic here that I might post later, but for now I wanted to quickly ask: did you write this collaboratively with an LLM chatbot? And if so, what was the division of labor between you and the LLM? (I'm not trying to "catch" you posting AI writing, here, I'm just curious whether my gut sense is right or not.)
The first section about the boarding school feels especially LLM-esque to me, with its repeated use of the "not X but Y" construction ("it wasn't justice—it was logistics," "isn't her rebellion, but her sadness"), the way it's crammed with striking details that feel made-to-order for the story's themes ("She never fed her horse," "She cried while decorating planners and making gingerbread houses"), its very rapid pace that never stops to dwell on any given topic for long, its use of the name "Aria"[1], etc.
(There are some other features of the first section that are weighting heavily in my judgment here but are harder to describe in words... there's something about the cadence, I guess? And also the... oddly detached perspective of the narrator? And the use of a somewhat precious/cutesy tone in spite of the heavy subject matter? And some other stuff too.)
I apologize for butting in to ask something totally unrelated to the substance of the essay -- I just didn't want to miss the opportunity to get feedback about how well my inner "AI writing detector" is functioning.
Like "Elara" and "Voss," this is one of those names that recent chatbot LLMs very often use for fictional characters, even though they're relatively rare in real life and in non-LLM-written fiction.
As a quick demonstration, try searching for tweets that contain both "Aria" and "Elara." When I did that just now, it turned up a ton of obviously AI-generated content, including several posts from the Grok account.
If I instead search for both "Jessica" and "Elara," I get hardly any results -- and even fewer AI-generated results -- despite the fact that Jessica is ~400x more common than Aria in the U.S. Which shows that these results are not just determined by strong AI-Elara link on its own.
Hi! Very quickly, yes, I use LLMs quite a bit to iterate on my writing. That said, sections 2 and 3 were more AI-assisted than section 1. The details in section 1 come from a particular experience of girlhood. I appreciate the curiosity!
I think Aria is a very pretty name--it reminds me of pretty music. I say we keep Aria for ourselves. The AIs can have Elara and Voss.
I would love to hear your other thoughts if you feel like sharing them!
Like “Elara” and “Voss,” this is one of those names that recent chatbot LLMs very often use for fictional characters, even though they’re relatively rare in real life and in non-LLM-written fiction.
… “Voss”, really? Do you happen to know why that is? (This guy come to mind immediately; is there some other fictional “Voss” who could be the culprit?)
I don't know why Voss or Sarah Chen, or any of these other names are so popular with LLMs, but I can attest that I have seen a lot of "Voss" as well.
This is a thoughtful and well-written essay, but I have my issues with it:
Aria is not unique. As a psychiatry resident, I am all too familiar with the fact that all too many human beings are broken, and the extent of dysfunction might not to be obvious to those who do not spend a lot of time around impoverished communities:
Let me tell you about a patient, or at least a synthesis of several patients. We’ll call her Maria.
Maria is the same age as Aria. Like Aria, she has problems with substance use. Like Aria, she has a complicated relationship with her mother. That is where the similarities end.
Maria’s mother isn’t flying in with designer drugs; she’s working a second shift cleaning offices and a third shift at a diner (optimistically, in the UK, she's just as likely to not work at all and subsist off unemployment or disability allowances), and Maria hasn’t seen her awake in three days. Maria isn’t acting out to see if the boundaries will hold; she’s acting out because there are no boundaries. There is no one home to make any. The “friction” in her life is not a carefully calibrated challenge to build character. It is the constant, grinding abrasion of poverty, neglect, and trauma. She doesn’t have an emotional support animal; she has a barely legal descendant of an American bully chained up in the yard that her step-dad threatens to kill when he's drunk.
When Maria skips class, it’s not to escape to a more exciting party; it’s because a boy from her neighborhood who thinks he owns her is waiting outside. When she uses drugs, it’s not a rebellious search for meaning in a meaningless world; it’s a desperate attempt to numb the relentless pain of a too-meaningful one, a world where every choice is freighted with the potential for immediate, catastrophic consequences.
And consequences? Maria craves a world without them. Her tragedy isn’t that an urn she pushes off the mantel fails to shatter. Her tragedy is that when her stepfather pushed her down the stairs, the bone shattered exactly as physics would predict, and the primary consequence was her mother telling her not to make a fuss.
Maria does drugs, just like her wealthier counterpart. She probably has access to coke and ket (the supply is cleaner in the UK, and probably cheaper), but in its absence, she's drinking alcohol. A lot of alcohol.
Maria's school lacks the cushy amenties Aria takes for granted. No personal therapist for her. Social workers who might be well-meaning, but are utterly burnt-out and unable to do very much about her issues. When I go visit the pubs around here and disclose that I'm a psychiatry trainee, it's 50:50 if someone won't immediately tell me about the problems they're facing, kids going without a diagnosis of ADHD or autism for years or even decades from when it was flagged.
Someone like Maria, or even Aria, might eventually receive a diagnosis. You may take your pick of any of the following:
Now, outside of the obvious, I would wager that she might well have depression or ADHD. The pattern fits.
A rose by another name smells just as sweet, and has just as many thorns. Should Maria ever end up in front of a child or adolescent psychiatrist, a formal diagnosis is unlikely to do her any good.
She doesn't have the luxury of having parents capable of shifting her to a different, more elite or more strict boarding school. She might drop out, her parents and social workers will likely be powerless to stop her. Her parents didn't have the means to put her in a relatively safe environment, or at least one without boys/men ready and willing to take advantage of her. She's probably going to be knocked up sooner or later. Later down the line, she might commit a crime, be it petty, drug-related or more serious, and begin a spiral that may or may end in a lengthy prison sentence.
It isn't the presence or absence of money and luxury that usually causes such problems. Some people are simply broken, dealt a bad hand by genetics or environmental factors.
The prevalence of such conditions, however, does depend on socio-economic background. In their respective cohorts, there are far more Marias than there are Arias, and that's adjusting for population size. There might be one Aria in her class. It is possible to have an entire class of Marias.
Wealth is a decent proxy for IQ, and IQ a decent proxy for mental health and well-being. The universe doesn't care about human notions of fairness, the halo effect isn't entirely unjustified: the rich are likely to be happier, healthier, smarter and better adjusted.
The kind of person who wins big at the lottery, isn't the kind of person who might have earned the same amount of sum by labor or investment. Little surprise that they squander it. Similarly, it far less of a negative signal to be poor in a society where everyone is poor than it is to be in one where far more opportunities for socio-economic mobility exist.
(I would probably have to look up better citations, but I strongly expect that the Native American communities that make large amounts of money do better than those without that good fortune. They're both still heavily dysfunctional. The money or not having to work for a living isn't what's causing it. I do not expect this trend to hold.)
I don't expect a wealthier society to, by itself, change this. But the same factors that produce "abundance" hinge on technological advancement. Giving everyone UBI won't solve Maria or Aria, but better medication, genetic or social engineering, those might.
I have had lifelong struggles with depression or ADHD, I found a workable solution to both, albeit with drawbacks. In a less enlightened time, I'd have just been screwed.
In the future, we will have the tools to solve ennui and such failures of the ancestral psyche, which hasn't adjusted to motor vehicles or the absence of famine, let alone Fully Automated Luxury Space Communism (with optional homosexuality). Will we apply those tools? I hope so.
The worst part of depression is often the anhedonia. You cease to care, you lose the ability to enjoy things you once enjoyed. I am (mostly) an optimist about the future, which is an intellectual position hard to hold while feeling that life sucks and has sucked for ages. But I have given thought to what I'd do in a better future. Is it possible that humans will exhaust our entertainment options, that we won't be able to expand Infinite Fun Space faster than we can plumb it? I think that's very unlikely.
Yet, if we somehow manage to end up with nothing to do, and can't make the universe more exciting, we can change ourselves. I see this as a last resort, but if I find myself as a mind in a Matrioshka Brain that finds the space of experience to be unavoidably ergodic, unable to find a new and exciting hobby to indulge, then I am willing to tamper with reward circuitry, to make myself with content merely with the space of what's possible or already experienced.
UBI will be necessary, to ensure that biological humans survive in a future where their cognitive and physical labor don't fetch a rate sufficient to justify a living wage. But I don't think more money actually means more problems, and it is a solvable problem.
Aria is strictly better off than Maria. She has parents who care, and where they can't, the resources to seek better. Just having the money for better treatment makes a difference, and hopefully we'll have the technology to match soon! At the very least, I don't see any fundamental barriers in the way.
The picture of abundance that you describe, with material problems solved but spiritual problems ever present, feels pretty unlikely to me.
Here's how the landscape looks to me now. Most scenarios of the future are bad, where humans get thrown to the side. Then there's a small valley of good scenarios, of which the main one I think is the "housecats" scenario: superintelligences build a world where humans will live well. Not just materially well, but well in general. Because an aligned superintelligence will understand our spiritual needs (including the need to get something only with effort, the need to be needed for something, and so on) just as well as material ones.
And separating the huge plain of bad scenarios from the small valley of good, there's a jagged wall of cliffs - scenarios where superintelligences got part of our values, but not all. Many of these cliffs are S-risks or similar, much worse than the ordinary bad result. Others are like the abundance scenario, where material needs get met but spiritual ones don't. Or the inverse scenario, where spiritual needs get satisfied but material ones don't. I think there are too many of these cliffs to describe, and we should try to not end up in the cliffs at all.
This seems relevant to plausibility of permanent disempowerment (originally-humans being denied potential to eventually match originally-AI superintelligences in level of development). Not being permanently disempowered is at least an occasionally occurring spiritual need, so perhaps distinguishing permanent disempowerment as a major possibility runs a similar risk of privileging this particular spiritual need as being more at risk (from superintelligence that otherwise doesn't kill everyone).
Mostly excluding permanent disempowerment from possible outcomes (even if by stipulation) could also be a good exercise in hardening arguments against the motte-bailey of humanity being "OK" (surviving) with permanent disempowerment vs. humanity being doomed to permanent disempowerment (two framings with very different valence describing exactly the same outcomes). Wanting to believe humanity survives might result in ballooning expectations of permanent disempowerment, while skepticism about AIs sharing cosmic endowment with powerless humanity might result in shrinking of expected non-disempowerment eutopia outcomes.
So forcing probability of extinction plus disempowerment to be close to that of extinction alone puts these pressures in conflict with each other. If permanent disempowerment is not an option, asking for humanity's survival translates into asking for the eutopia outcomes with no permanent disempowerment to get more likely. And skepticism about AIs sharing cosmic endowment translates into expecting human extinction, rather than merely ballooning permanent disempowerment that eats some of the probability of eutopia.
The bit about Aria was quite well-written and evocative, and it seems very plausible to me to suggest that some fraction of the populace would freak out if faced with actual abundance. I also like the suggestion that we do ethnographic research to see how exactly societies such as the Shakopee navigate their abundance, and what problems pop up there.
At the same time, you seem to be suggesting that the school environment caused Aria's problems while also giving the impression that she was the only one in the school to do anywhere near that badly. That sounds like she would probably have been troubled anywhere. Even though her issues clearly didn't get better during her time at your school, it's not obvious to me that this would have been worse than the median outcome elsewhere.
Here, nobody reacted to her drug use, but like AlphaAndOmega mentions, someone else's drug use may eventually lead to things like the justice system labeling them a young (and later adult) offender, failing classes in a school where they don't have peers willing to bail them out, and finally getting abused and maltreated when they're unable to defend themselves. Sure, some people will shape up and get their act together if genuinely forced to, but many will just spiral deeper.
I also feel like your essay is inconsistent about whether it's painting this kind of a reaction as something only a small minority has to abundance, or as something that abundance would cause to everyone. You say "no one self-destructed quite like Aria", but also "we could all be Aria". You say "In a world of billions, even if a small percentage of people", and then a couple of paragraphs later flip from 'small percentage' to 'everyone' with "In a world where everyone becomes like Aria, would we know what to do with ourselves?".
While I think the implication that everyone would react this way is too strong, I also think that the essay doesn't really need it - a problem that only a minority suffers from is still a problem! Assuming that AGI doesn't just entirely wipe out humanity or otherwise make these kinds of questions irrelevant, I think all of your suggestions of what to do still make sense even if the problems aren't something that literally everyone will suffer from.
Because, for the first time, we could all be Aria.
No. "Aria" is the type of person who is discontent no matter what.
It's like a modern version of: "Eve ate the apple, therefore all of you must die".
Aria has mental problems, therefore abundance would actually be bad for the rest of us. I'm not convinced.
So much was given to you, and that’s all you managed?
The principal problem here is the expectations. I expect those to essentially vanish in a state of abundance.
Also, the description of a school as a utopia seems (a) false and (b) totally irrelevant to the interesting claims made about the effect of abundance.
I'm skeptical that much of the suffering and meaninglessness you described is inherent to abundance, and especially that economic labor is a necessary structure for human desire to organize itself around. You might be interested in thecatamites' short post on consequences, which I like a lot:
i always end up talking to people at work who'll insist that without a job, without the consequences of NOT having a job and the way those consequences frame and direct our behaviors, that we simply wouldn't know what to do with ourselves. to which i always think, well, maybe YOU wouldn't, man...
[...]
to want something, to lack shelter or respite from the blunt animal miseries of exploitation, scarcity and torture - surely part of the cruelty of these is how they overshadow all the other ways that we might be unhappy. and how meagre their countervailing images of happiness turn out to be, money, food, ammo or red potion. compare to the strange and elaborate unhappinesses involved in simply being alive, in the directionless abundance of perception itself, that stuck tap endlessly pouring out into a drain. isn't that something worth fighting for, something everyone deserves?
He is writing in the context of video games, where all scarcity is artificial, and in which infinite abundance is only a matter of downloading a cheat engine. Somehow, though, the existence of cheat engines (or walkthroughs, etc) mostly doesn't prevent people from seeking out meaningful challenges and struggles in games anyway. And there are games without friction, walking sims or narrative-focused adventure games, and lots of people like them, too.
I also think it's surprising that you would see "loss of structure" as a characteristic flaw of utopias, when your example utopia - the boarding school - sounds like a very structured, maybe even over-structured environment. Classes go HERE, study hall from this time to that time. I can't speak for Aria, but the people I knew in school who did lots of drugs and pushed boundaries weren't crying out for lack of structure; they were sick of structures, of being told what to do all day, feeling trapped and powerless. Is it possible that what she was feeling had less to do with the weightlessness of endless abundance, and more to do with the awful constriction Scott Alexander describes here? (Scroll down to section III or Ctrl-F "child prison" for the relevant bit).
(My high school also had therapists and meditation programs, and occasionally emotional support animals, and nobody really tried to stop students from getting stoned all day, but it still wouldn't have passed the 'burrito test'. Would yours?)
Ultimately I would prefer human adults have the freedom to decide what they want to do in a state of abundance, even if some of them then decide to live in frictionless comfort. And then, if they decide that frictionless comfort is unsatisfying, to be able to change their mind, attempt something more difficult instead, and have the resources to pursue that too. Even if one chooses scarcity and labor in the end, I'd rather that be chosen internally, not inflicted externally. Schools don't offer that freedom; the students have their goals and purpose decided by an outside authority, and if they don't like them, tough shit. We think it's alright (sometimes), because the students are children and so aren't grown enough to figure things out for themselves. But any future where that becomes universal is nothing like what I'd call utopia.
In my anecdotal experience going to schools like this, the Arias of the elite world have this 'lack of purpose' and thus rebellious / self destructive behavior either due to psychological issues or parental / guardianship neglect.
They were also in the minority. I know plenty of people who have been showered in abundance since birth that are happy with their lives.
I'll take this as a prompt to finish and publish my draft "Utopias".
Utopia doesn't need to be one-size-fits-all. If someone needs challenge and struggle, we'll give them what they need. In a world of plenty with few problems to solve, the most common occupation will be figure-out-what-this-person's-problem-is-and-fix-it. That's if superintelligence hasn't already done that better than we can.
Think virtual fight club, but magnified by the power of human and/or ASI creativity and motivation. Or virtual challenges scaling up to the most crushing, grinding, struggle for survival and dominance. We will have as much struggle and challenge as people want to take on. There will be bragging rights for proving oneself the toughest, smartest, etc. See Yudkowsky's "fun theory" work for some aspects of this; but I want to note that "fun" can be blindingly painful in the moment for some people. I don't know if that personality type will persist after generations of trauma-free upbringing, but if they are around, they'll get the struggle they need.
The idea that we'd get material abundance but remain emotional morons strikes me as wildly unlikely. I think the persistance of trauma is probably largely a byproduct of scarcity, (compeitition for resources creates harmful behaviors that cause trauma) and that human ingenuity would have already largely solved psychology if we weren't so busy struggling to survive. Even if that's wrong, a superintelligence that provides material abundance but completely neglects helping us psychologically (if we want it) would have to be a moron by most theories of successful alignment.
I'll also note, along with the others, that even in your scenario only one person was unhappy; everyone else felt that utopia was quite nice indeed.
Hello!! I'm so grateful that thoughtful voices I've long admired in this community took the time to engage with my essay. I look forward to responding more thoroughly when I return home next week.
To be clear, I don't see abundance-related challenges as a top priority compared to more pressing issues. I do want to take Keynes seriously when he says that pockets of the future exist inside the present. Problems we may dismiss because they don't affect enough people today may become more significant if we achieve AGI-driven abundance (and there are many hurdles to reaching beneficial futures). It may be worth considering some of them now while we have time to think through solutions.
Imagine pushing and pushing and realising you couldn't effect any change.
Eliezer actually addresses this in Free to Optimize
if there's an AI that really does look over the alternatives before I do, and really does choose the outcome before I get a chance, then I'm really not steering my own future. The future is no longer counterfactually dependent on my decisions.
And much more about some of the traits a utopia that is actually fun to live in would have in his Fun Theory sequence. It is quite an interesting read.
Schlaraffenland (1567), the land of milk and honey
Say we achieve abundance—what becomes of our souls?
Transformative AI may soon lift us from the material constraints that have long shaped civilisation. In this essay, I explore how a species forged in struggle might fare in a world without it.
I. The Utopia That Didn't Work
‘The excuse of a private school in a democracy is that it shall be a laboratory, a place for the demonstration of old experiments and the trying of new. It is a place of freedom.’ –Lucy Madeira
Every school must be conceived as a kind of utopia: a headteacher's dream of what the world could be, shrunk down to fit between dormitories and dining halls, and entrusted to pupils who are given the freedom and structure to rehearse a life of joy and meaning, pupils who might one day bring this vision to life beyond the school gates.
Independent schools, especially, are laboratories for utopias—unconstrained by funding, by bureaucracy, by anything but human nature. Wearing rose-tinted glasses, I remember my boarding school, where the grass was always green and the girls always kind.
Our schedule was tailored to the way girls were believed to learn best: two to three classes a day from 8 am to 2 pm, with generous breaks in between to chat under the sun or meet one-on-one with teachers. After school, there was time for music lessons, horseback riding, nature hikes, and team sports. Study hall was a quiet, focused two hours in the evening—no more, no less—so that no one would get too stressed.
If the perfectly engineered system didn't work for any of us, it bent. There were learning specialists for every subject. Therapists on call. Tutoring, accommodations, and interventions, always available with a reassuring smile.
College counselling began with drawing pictures of our ideal university experience, after which counsellors crafted lists of institutions that would fulfil our every desire. Essays and standardised testing prep were dispensed in precise portions to prevent overwhelm. And if, for all the careful orchestration, a student was left without a place to go, the school would quietly lean on its historical ties, opening doors not to fallbacks, but to colleges that others might have called a triumph.
We had dedicated yoga lofts with views of the river. Personalised pilates programmes. Meditation circles. Emotional support animals.
It was utopia. Or at least, someone's earnest attempt at creating one.
Our gilded sanctuary contained a hidden curse: a world without friction offers nothing to push against. Nothing to overcome. Nothing to become. Many of us struggled with this paradox, acting out in various ways, but no one self-destructed quite like Aria.
Aria
Aria[1] was the prettiest girl in our class. She loved puppies and Justin Bieber and shopping and fashion. She had the best taste for which top would look best with which jeans, which jewellery would make you feel a certain way, which candy had the optimal fun-to-calories ratio (Jolly Ranchers were genius, candy corn was amateur hour). Before things went downhill, we sang karaoke in the dorms, baked brownies and cinnamon buns, and made friendship bracelets in the never-ending sleepover that was school.
Something in Aria burned hotter than the rest of us. Her father’s family had developed most of a major American city; her mother kept a busy social calendar but flew in every Friday with the drugs Aria requested, only to be punched in the parking lot for not bringing enough. Aria took our typical teenage rebellion a step further: she did cocaine in the bathroom during mixers with neighbouring schools, snuck off campus to drink at college parties, stole ketamine from the barn, and used Adderall to get through the school day (acquired from the dean of students' son at ten times the market rate, but that's another story). She constantly screamed at her parents or their assistants over the phone. She never fed her horse. She missed classes for therapy, and therapy for anything that promised even a moment’s escape.
We all helped her hide it. We covered for her during important meetings. We took turns stashing her drugs and alcohol when she was up for room inspection. We looked after her horse. We helped her cram for tests and polish essays minutes before class. That's how she made it to junior year.
When she was finally expelled, it wasn't justice—it was logistics. She transferred to a Swiss boarding school with better scenery and better mental health support. In these circles, getting kicked out was a strange badge of honour—an upgrade to somewhere more elite.
What I remember most about Aria isn't her rebellion, but her sadness.
Aria cried all the time. She cried in class. She cried in the showers. She cried while decorating planners and making gingerbread houses. Aria cried during Thanksgiving dinner.
She was grieving, perhaps, for the weightlessness of her existence. She pushed every boundary not to escape it, but to find out if it would hold. And when it didn’t—when no one resisted her, when everything bent or yielded—she escalated. Perhaps she craved consequences: the gravity of actions that couldn’t be undone and the momentousness of decisions that might just change her carefully curated life. But in a world of endless second chances and soft landings, nothing she did seemed to matter.
Imagine living in a world where you pushed an urn off the mantelpiece, and it didn't fall and shatter. Imagine pushing and pushing and realising you couldn't effect any change.
Wouldn’t you go insane too?
II. A World of Arias
‘For [the wealthy] are, so to speak, our advance guard—those who are spying out the promised land for the rest of us and pitching their camp there.’ –John Maynard Keynes, Economic Possibilities for our Grandchildren
To be clear, I am not asking for your sympathy for Aria or for anyone else at boarding school. I am asking for your sympathy for yourself, for your loved ones, and for all of humanity. Because, for the first time, we could all be Aria.
The Possibility of Abundance
Given increasingly capable artificial intelligence (AI) systems, we stand at the threshold of what could be humanity’s first experience of true abundance. As Scott Alexander observes in ‘1960: The Year The Singularity Was Cancelled’, throughout human history, economic growth followed a self-reinforcing cycle: technological advances enabled population growth, which in turn produced more innovators, leading to further technological advances. This virtuous cycle accelerated dramatically with the Industrial Revolution, pushing growth from below 0.1 per cent annually for millennia to unprecedented rates.
This acceleration should have continued toward a singularity, but it did not. Instead, growth peaked around 1960 and then slowed, largely because declining fertility rates interrupted the cycle. Fewer people meant fewer innovators, even as technology continued advancing.
Alexander points out that artificial intelligence offers a way to revive the accelerating growth cycle without relying on population expansion. For the first time, we can convert money directly into inventors and researchers: ‘Money = build more AIs[2] = more research.’
In ‘Machines of Loving Grace’, Dario Amodei envisions a ‘country of geniuses in a datacenter’, ushering in a new era of progress where cancer and Alzheimer’s become historical curiosities like smallpox, where human lifespans double to 150 years, where global poverty plummets as developing nations achieve growth rates beyond anything we have seen in history.
Imagine a vast intelligence that thinks faster and more profoundly than Nobel laureates across every field, works tirelessly without breaks, and can be replicated millions of times over. Such systems could compress the next century of human progress into just five to ten years. Amodei calls this scenario the ‘compressed 21st century.’
Artificial general intelligence (AGI) refers to systems capable of performing the full range of cognitively demanding tasks at or beyond human level. AGI is the stated goal of every major lab, and those with situational awareness say it will arrive sooner rather than later. Sam Altman of OpenAI holds that AGI could emerge as early as late 2025, Amodei of Anthropic claims 2027, and Demis Hassabis of Google DeepMind thinks that AGI could arrive between 2025 and 2030. Independent platforms like Metaculus, which aggregate the views of hundreds of forecasters and aim to provide a more neutral benchmark, currently suggest a 50% chance of AGI by the mid-2030s.
We are approaching a transformation deep enough to dissolve material scarcity—the core constraint that has shaped civilisation since the beginning. And even if we do not reach AGI, today’s frontier models are already poised to drive sweeping productivity gains.
John Maynard Keynes contemplated this scenario in his 1930 essay ‘Economic Possibilities for our Grandchildren’. Keynes imagined a future where humanity would be eight times wealthier in a hundred years, thanks to technological advances and the magic of compound interest. But while most people salivate over such prospects, Keynes approached it with significant apprehension: ‘If the economic problem is solved, mankind will be deprived [emphasis mine] of its traditional purpose.’ He wrote: ‘I think with dread [emphasis mine] of the readjustment of the habits and instincts of the ordinary man, bred into him for countless generations, which he may be asked to discard within a few decades.’
A few decades? Try a few years in Amodei’s compressed 21st century. Keynes made his projections without any concept of artificial intelligence; he was simply extrapolating from economic trends he observed in his own time. What Keynes predicted would happen gradually over generations, AGI could deliver in years. Are we ready for the end of scarcity? Can human society, shaped by millennia of want and struggle, navigate a world where these fundamental drivers disappear almost overnight?
The Difficulties in Realising Abundance
You might ask: Why worry about the problems of abundance when we haven’t even achieved it?
This is a fair concern. Realising universal abundance from advanced artificial intelligence is far from inevitable—it demands urgent work, thoughtful benefit-sharing, and a rethinking of the social contract.
Erik Brynjolfsson introduced the concept of the Turing Trap: our fixation on developing AI that replicates human capabilities rather than augmenting them. This creates a dangerous dynamic: as machines become effective substitutes for human labour, workers lose economic and political bargaining power and become dependent on those who control the technology. The result is a dramatic increase in inequality.
Noticing that AGI is more like a resource than a tool, ‘more like coal or oil than the plow, steam engine, or computer’, Luke Drago and Rudolf Laine draw a parallel to the resource curse commonly seen in petrostates. They call it the intelligence curse: ‘With AGI, powerful actors will lose their incentive to invest in regular people—just as resource-rich states today neglect their citizens because their wealth comes from natural resources rather than taxing human labour.’
We should absolutely dedicate the vast majority of our resources to preventing such dystopian outcomes. But this essay is about the assumption I see everywhere—that once we solve distribution, we will simply frolic for eternity.
Laine’s essay ‘Capital, AGI, and Human Ambition’ goes beyond the problem of inequality; its main concern is ‘humanity’s collective position, the potential for social change, and human agency.’ To me, the agency and ambition that Laine champions represent moments like seeing a friend building something they believe in, their eyes sparkling with passion. Social dynamism manifests as the joy of always having something new to look forward to in our world. Laine identifies these qualities as worth preserving in our current economy and fears their loss in a poorly managed AGI transition. These are values worth defending, regardless of how our economic system evolves.
If these values are what is truly at stake, we have all the more reason to take abundance seriously. As we work toward a world of plenty, we need to ask whether success might undercut the very qualities we hoped to protect. What if achieving abundance drains away the human drive it was meant to liberate?
Realising Desirable Abundance
Many people envision that, freed from economic necessity, they would finally pursue their highest aspirations, find joy and purpose, and channel their energy toward creative or altruistic endeavours. But abundance can just as easily lead to crisis, rebellion, and detachment.
Keynes wrote: ‘To judge from the behaviour and the achievements of the wealthy classes to-day in any quarter of the world, the outlook is very depressing! … For they have most of them failed disastrously, so it seems to me—those who have an independent income but no associations or duties or ties—to solve the problem which has been set them.’ The problem, of course, is mankind’s permanent challenge—to learn ‘how to use his freedom from pressing economic cares, how to occupy the leisure, which science and compound interest will have won for him, to live wisely and agreeably and well.’
Keynes was especially concerned about ‘the wives of the well-to-do classes’, who had been ‘deprived by their wealth of their traditional tasks and occupations’, and who, in the absence of economic compulsion, could find nothing more fulfilling to do.
The challenges of abundance extend beyond boredom or ennui—regrettable for individuals but perhaps manageable for society. Others, unmoored by a lack of meaning, may turn their desperation toward nihilistic movements, pursue destructive technologies, and develop chemical, biological, radiological, and nuclear (CBRN) threats—now far more accessible through advanced artificial intelligence.
Over a century ago, the psychologist William James experienced a violent revulsion at Chautauqua Lake. In ‘What Makes A Life Significant?’, James describes spending a week in what he called utopia: ‘You have culture, you have kindness, you have cheapness, you have equality, you have the best fruits of what mankind has fought and bled and striven for under the name of civilisation for centuries.’
But James found himself recoiling. Upon leaving this paradise, he confesses to ‘quite unexpectedly and involuntarily’ saying:
‘Ouf! what a relief! Now for something primordial and savage, even though it were as bad as an Armenian massacre, to set the balance straight again. This order is too tame, this culture too second-rate, this goodness too uninspiring. This human drama without a villain or a pang... this atrocious harmlessness of all things—I cannot abide with them. Let me take my chances again in the big outside worldly wilderness with all its sins and sufferings...’
James’s experience represents one possible response to abundance: a visceral rejection of comfort and safety in favour of challenge and risk. What proportion of humanity might share similar reactions? In a world of billions, even if a small percentage of people respond by manufacturing their own version of ‘Armenian massacres’ not from poverty or religious hatred, but from a desperate search for meaning, we may face a significant threat.
In a world where everyone becomes like Aria, would we know what to do with ourselves?
There are, of course, distinctions between Aria's situation and humanity's fate in a future of AGI-driven abundance. Aria’s challenges might simply reflect typical adolescent growing pains—perhaps children test limits because they need structure, while mature adults could flourish in a constraint-free environment (though I have my doubts). Still, it is worth noting that not all humans will enter this age of abundance with the same level of psychological readiness. People at different life stages and with varying emotional resources will react in different ways.
Aria has also experienced privilege her entire life, whereas AGI-driven abundance would constitute a transition for most people. Though in some ways, these situations are more similar than they appear. Both Aria and recipients of AGI wealth will experience a profound sense of security—Aria because wealth has been there her entire life, and future beneficiaries because they trust in the new social contract and seemingly limitless productive capacity of advanced AI systems.
Further, Aria's access to abundance comes with strings attached—weekly allowances contingent on making the ‘right’ decisions, implicit and explicit expectations about political views, relationships, educational choices, and career paths. True AGI-driven abundance might be more liberating, allowing for genuine autonomy rather than gilded constraint.
Perhaps conditions like those we see in trust funds, encouraging education or meaningful work, should be considered for government-distributed abundance. Although I imagine these paternalistic structures would face fierce resistance, as many would soon view wealth not as a conditional privilege, but as a fundamental entitlement—the birthright of being human in an AI-enriched world.
No current situation perfectly simulates an AGI-wealthy society, but the mosaic of existing abundance pockets offers valuable insights.
III. Investigating Abundance
‘Nearby is the country they call life.
You will know it by its seriousness.’ –Rainer Maria Rilke, Go to the Limits of Your Longing
I conclude with some proposals for investigating the psychological, economic, and governance challenges that AGI-driven abundance may bring. This agenda proceeds along three paths: analysing existing evidence of abundance-related problems, generating new data through controlled experiments, and developing practical visions and institutions for sustainable post-scarcity societies.
First, we must examine the diseases of affluence—those psychological, social, and existential maladies that emerge when material constraints fall away. We can draw on three case studies: (1) self-made post-economic individuals—such as tech founders or successful crypto investors—who often struggle to find direction once economic survival is no longer a motivator; (2) beneficiaries of generational wealth, including dynastic heirs and elite boarding school students, who frequently rebel against consequence-free privilege; and (3) lottery winners, who receive sudden, unearned wealth and often report isolation or psychological disintegration.
These cases differ in how abundance is acquired—earned vs unearned, sudden vs gradual—and while none perfectly mirrors a post-AGI world, they highlight dynamics likely to recur at scale: the loss of structure, the weakening of ambition, and the erosion of meaning in the absence of consequence. Post-AGI abundance may replicate these effects even more dramatically—sudden, universal, and untethered from merit.
Some of this work has already begun. In recent years, sociologists have turned their attention toward the study of elites. Elite boarding school ethnographer Shamus Khan has argued that ‘poor people are not why there’s inequality; rich people are.’ His work helped shift the sociological gaze upward, toward those who shape institutions and gatekeep opportunity. This was a necessary correction: it is surely unfair—and more than a little uncomfortable—to examine the lives of the poor as if the explanation for their condition lies within them. Yet this newer focus on elites falls short because it treats the privileged instrumentally, never examining their emotional and existential crises as meaningful phenomena in themselves and only scrutinising how they produce and reproduce inequality.
For inequality is a strange problem, and social mobility a strange solution. As Kola Ayonrinde insightfully pointed out in conversation, every time someone rises on the socioeconomic ladder, someone else is pushed down. Ascent is inseparable from descent. There is something unsettling about celebrating success when it depends on someone else's fall.
Children of privilege face a distinct form of social punishment: the eager anticipation of their failure. So much was given to you, and that’s all you managed? Perhaps this cruelty is not about privilege itself, but about its exclusivity. The real problem is not inequality but insufficiency. The compassionate response is not to invert the ladder, but to eliminate the stakes of the climb—to stop maintaining systems in which winning and losing correlate with real suffering. This would be achievable in a world of abundance.
Second, we should design experimental microcosms—radical universal basic income (UBI) experiments engineered to approximate genuine abundance conditions. Existing pilots are limited: they are temporary, provide modest support, and participants inevitably behave accordingly—saving, striving, and planning for the scarcity they know will return.
What we need is an abundance experiment that is actually abundant: a controlled community where participants receive effectively unlimited resources with no time limits and no work requirements. Such an experiment would allow researchers to observe how people create meaning and purpose when truly freed from economic necessity.
Short of doing a full abundant UBI experiment, we could look at the Shakopee Mdewakanton Sioux Community. Each adult tribal member receives payments of around $1 million per year from the tribe's profitable casino operations. On one hand, the community has thrived: they have virtually eliminated poverty, preserved Dakota culture and language, and become one of Minnesota's largest philanthropists, donating over $400 million to various causes. Many tribal members still choose to work at tribal enterprises despite not needing to financially. Yet familiar abundance challenges have emerged—tribal leaders worry about teaching children self-discipline and the value of money when ‘no one will likely ever need to work.’
While there has been some journalistic and academic attention to these dynamics, no one has done a comprehensive ethnographic study of how this wealth affects daily life, meaning-making, and community cohesion. This seems like an obvious place to start. Understanding how the Shakopee navigate their abundance could provide essential insights as we approach AGI-driven prosperity.
Third, we should explore incentive structures for post-scarcity societies. Drawing on game design, prestige economies, and symbolic systems, we would investigate how voluntary challenges and meaning-making rituals might replace economic striving.
Finally, to explore what lies beyond precedent, we must also turn inward and engage our imaginative faculties: through fiction, worldbuilding, and thought experiments that ask, Who would I become in a world without constraints? Such inquiry may uncover deeper psychological and moral dynamics that empirical studies alone cannot reach.
By weaving together these methods, we can anticipate the complex challenges of true abundance before we are submerged in its reality. This is not abstract theorising. With AGI potentially arriving within years, we have a narrow window to understand how abundance affects human psychology and social structures. The alternative is to repeat Aria’s story on a global scale: a world where people rage against a golden void, where the absence of friction breeds not contentment but despair. If we wait until AGI delivers abundance to study its effects, we will be trying to solve psychological and social crises in real-time, with the meaning of billions of lives at stake.
Only by taking abundance seriously—studying it, experimenting with it, and articulating visions for it—can we ensure that our greatest technological achievement becomes humanity's liberation rather than its most sophisticated prison.
Acknowledgements
Thank you to Kola Ayonrinde for the conversations that inspired this essay. I am grateful to Kola, Rudolf Laine, Carlo Attubato, Aviel Parrack, John Soroushian, Liam Patell, Joanna Wiaterek, Catherine Fist, and Philipp Alexander Kreer for their valuable comments and insights.