This is a synopsis of a published chapter analogizing the rise and fall of the horse to the fate of humans in a world dominated by ASI. The fate of the horse is a useful proof of concept for "doom" scenarios, as well as a historical precedent challenging the more optimistic predictions we see from some economists. The incentives that drove the replacement of the horse by industrial technology map closely onto likely ASI incentives, which suggests ASIs will be motivated to diminish or eliminate the human population.
Key findings:
For most of history, human technology was great for horses. The world horse population grew from about 460,000 around the time of domestication to a peak of over 100 million.
Industrial technology initially increased demand for horses. Trains replaced horses along long-haul routes, but the increase in freight and human travel led to a rise in demand for short-haul horses that more than compensated. British horses went from 1.3 million in 1811 to 3.3 million in 1901. US horses went from about 4 million in 1850 to nearly 17 million in 1890. People kept predicting that the canal, the railroad, or the bicycle would finish off the horse. They were wrong for a century.
This is consistent with the industrial revolution's increasing demand for human labor (even as it made some jobs obsolete). It is also what we should expect from AI prior to ASI. Mundane AGI will likely make most humans better off. That tells us nothing about what happens once we are no longer useful.
Then came the collapse. With the general-purpose tractor, the truck, and rural paved roads, US draft horse and mule populations fell from a peak of 26.7 million in 1918 to under 3 million by 1950, a collapse of roughly 90%.
Comparative advantage did not save the horse. The horse never lost its comparative advantage! It lost because keeping a horse alive cost more than trading with it was worth. Feed for horses and mules took up 93 million acres in 1915, over a quarter of US cropland. By 1954 it was 10 million. Comparative advantage only protects you if the other party can't take the resources you live on and use them for something else.
Horses could not simply part ways with us. Returning the peak US horse population to the wild would have required somewhere between 40 million and 7.7 billion acres. The high end is about three times the US landmass.
The collapse occurred despite real affection that humans had for the horse. Civic associations like the Horse Association of America organized to prevent its disappearance. To paraphrase Eliezer: humans did not hate the horse. We actually liked the horse! But the horse depended on resources that we could use for other things.
Competition did not save the horse either. There was no ministry of mechanization and no coordinated coup against horsekind. Some 4.7 million independent, competing farms each followed their own economic interest. Competition between ASIs will protect us about as well.
China is a natural experiment. Chinese communism may have been bad for humans, but by stunting development it was good for horses: the population rose to 11.5 million in the 1970s. After the Reform and Opening, China modernized its agriculture and transportation; horse populations fell 70% to 3.47 million by 2018.
Today, Americans keep roughly 7 million horses because we value them as ends in themselves, not because of their economic contribution. This is the optimistic case. Humans will persist and flourish under ASI only to the extent that it cherishes us as a terminal value. Comparative advantage will not save us. Competition between ASIs will not save us.
This is a synopsis of a published chapter analogizing the rise and fall of the horse to the fate of humans in a world dominated by ASI. The fate of the horse is a useful proof of concept for "doom" scenarios, as well as a historical precedent challenging the more optimistic predictions we see from some economists. The incentives that drove the replacement of the horse by industrial technology map closely onto likely ASI incentives, which suggests ASIs will be motivated to diminish or eliminate the human population.
Key findings: