Why should we assume that vastly increased intelligence results in vastly increased power?
A common argument I see for intelligence being powerful stems from two types of examples:
Humans are vastly more powerful than animals because humans are more intelligent than animals. Thus, an AGI vastly more intelligent than humans would also have similarly overwhelming power over humans.
X famous person caused Y massive changes in society because of their superior intelligence. Thus, an AGI with even more intelligence would be able to effect even larger changes.
However, I could easily imagine the following counterarguments being true:
Human advantages over animals stem not from increased intelligence, but from being just intelligent enough to develop complex language. Complex
Why should we assume that vastly increased intelligence results in vastly increased power?
A common argument I see for intelligence being powerful stems from two types of examples:
However, I could easily imagine the following counterarguments being true:
- Human advantages over animals stem not from increased intelligence, but from being just intelligent enough to develop complex language. Complex
... (read more)