LESSWRONG
LW

1941
Wikitags

Economic Consequences of AGI

Edited by steven0461, joaolkf, et al. last updated 3rd Jun 2021

The economic consequences of artificial general intelligence arise from their fundamentally new properties compared to the human brains currently driving the economy. Once such digital minds become generally intelligent enough to perform a wide range of economic functions, they are likely to bring radical changes, creating great wealth, but also displacing humans out of more and more types of job.

An important aspect of the question is that of economic growth. The invention of AGI or WBE could cause a sudden increase in growth by adding machine intelligence to the pool of human innovators. Machine intelligence could be much cheaper to produce, faster, and qualitatively smarter than human talent. A feedback loop from better machine intelligence technology, to more and better machine researchers, back to better machine intelligence technology could ensue.

Robin Hanson has written much about the economics of whole brain emulation. In his view, the unrestricted creation of additional uploads will cause a Malthusian scenario, where upload wages fall to subsistence levels. He sees the transition to whole brain emulation as a jump to a new "growth mode" with higher exponential growth rates, similar to the transitions to agriculture and industry.

In "The Future of Human Evolution", Nick Bostrom argues that in an emulated-brain society with individuals living at subsistence levels, entities that possess a large set of features we care about – which he calls flamboyant displays, or culture in general – will be outcompeted by more efficient ones that lack inefficient humans’ cultural aspects. This will lead to elimination of all forms of being that we care about. He proposes that only a Singleton could ensure strict control in order to prevent the elimination of culture through outcompetition.

Others predict that growth will blow up even more suddenly (up to the point where physical limits become relevant), and that growth will be concentrated in a smaller and more coherent set of agents, so that instead of continued free market competition, we will see a singleton emerge.

Blog posts

  • The Hanson-Yudkowsky Foom Debate
  • Overcoming Bias posts tagged "Future"
  • Is The City-ularity Near?

External links

  • Bostrom's paper on elimination of culture
  • Economic growth given machine intelligence
  • Economic implications of software minds
  • Long-term growth as a sequence of exponential modes
  • Is a singularity just around the corner? What it takes to get explosive economic growth

See also

  • Technological singularity
  • Hard takeoff, Soft takeoff
  • Artificial general intelligence, Whole Brain Emulation
  • Technological forecasting
Subscribe
Discussion
1
Subscribe
Discussion
1
Posts tagged Economic Consequences of AGI
35What Other Lines of Work are Safe from AI Automation?
Q
RogerDearnaley, alexgieg
1y
Q
35
13Something Unfathomable: Unaligned Humanity and how we're racing against death with death
Yuli_Ban
3y
14
146"Heretical Thoughts on AI" by Eli Dourado
DragonGod
3y
38
71Rogue AGI Embodies Valuable Intellectual Property
Ω
Mark Xu, CarlShulman
4y
Ω
9
50Dragon Ball's Hyperbolic Time Chamber
gwern
13y
65
300By default, capital will matter more than ever after AGI
L Rudolf L
9mo
102
296Four ways learning Econ makes people dumber re: future AI
Ω
Steven Byrnes
23d
Ω
31
275The Great Data Integration Schlep
sarahconstantin
1y
19
152Applying traditional economic thinking to AGI: a trilemma
Steven Byrnes
8mo
32
152Capital Ownership Will Not Prevent Human Disempowerment
beren
8mo
19
138AI Timelines via Cumulative Optimization Power: Less Long, More Short
jacob_cannell
3y
33
130AI Summer Harvest
Cleo Nardo
2y
10
81Intermittent Distillations #4: Semiconductors, Economics, Intelligence, and Technological Progress.
Ω
Mark Xu
4y
Ω
9
65AI art isn't "about to shake things up". It's already here.
Davis_Kingsley
3y
19
60Whole Brain Emulation: Looking At Progress On C. elgans
jefftk
14y
85
Load More (15/89)
Add Posts