I often try to understand the forces pushing the world towards AGI development despite the risks. It is clear that there are a bunch of different motives. There are market forces and national security competition, but I wonder to what degree we can attribute AI development to a deep dissatisfaction with the world as it is and a desire to transform it even at the cost of much risk. There is a great deal wrong with the world. But if we focus only on its problems, we may develop a distorted picture of what we are risking. To judge correctly, we also have to notice what is good and worth preserving. If we move forward recklessly, what do we stand to lose? Sunsets, dogs, friends, cookies, and infinitely many other small and precious things. Perhaps, if we cultivate gratitude, we would be less willing to gamble it all away.
Risk-taking is rewarded in business. They don’t always pay off, but the best opportunities come with come levels of risk. It’s a part of the move-fast/break-things motto of the Silicon Valley. Overconfidence is too, and it goes hand-in-hand with risk-taking. Sociopaths thrive in that space.
They’re likely thinking something like, There may be a 20% chance of killing everyone, but not if I do it.
I often try to understand the forces pushing the world towards AGI development despite the risks. It is clear that there are a bunch of different motives. There are market forces and national security competition, but I wonder to what degree we can attribute AI development to a deep dissatisfaction with the world as it is and a desire to transform it even at the cost of much risk. There is a great deal wrong with the world. But if we focus only on its problems, we may develop a distorted picture of what we are risking. To judge correctly, we also have to notice what is good and worth preserving. If we move forward recklessly, what do we stand to lose? Sunsets, dogs, friends, cookies, and infinitely many other small and precious things. Perhaps, if we cultivate gratitude, we would be less willing to gamble it all away.