Some really intriguing insights and persuasive arguments in this post, but I feel like we are just talking about the problems that often come with significant technological innovations.
It seems like, for the purposes of this post, AGI is defined loosely as a "strong AI" which is technological breakthrough that is dangerous enough to be a genuine threat to human survival. Many potential technological breakthroughs can have this property and in this post it feels as if AGI is being reduced to some sort of potentially dangerous and uncontrollable ...
Interesting and useful concept, technological leverage.
I'm curious what Googetasoft is?
OK I can see a strong AI algorithm being able to do many things we consider intelligence, and I can see how the technological leverage it would have in our increasingly digital / networked world would be far greater than many previous technologies.
This is the story of all new technological advancements, bigger benefits as well as bigger problems and dangers that need to be addressed or solved or else bigger bad things can happen. There will be n... (read more)