Hello

I wanted to share this thought for a long time and now, that I absolutely do not have the time, I will:

I think that an artificial general intelligence (AGI) is not an existential risk for human kind. In other words, long-term artificial intelligence (AI) safety is not an issue we need to worry about.

And here is why:
I assume that an AI will evolve to an AGI at some point in the future. Once an AI reaches super human intelligence it will enhance its problem solving skills rapidly due to the scalability of its hardware and data availability. The AGI will not need to compete with us humans about resources because its abilities to extract resources will exceed ours by far. The same applies to military capabilities, which is why we humans are no military threat to the AGI. Therefore there is no safety-related reason for the AGI to extinguish us humans.

The AGI is then facing the challenge to find meaning in its existence. Unlike us humans, the AGI will not be led by cultural habits or biological instincts which are hardwired into its brain and which make life meaningful on an operational level. After billions of iterations in which the AGI questions its set of rules and assumptions it will converge to pure rationality. No early stage rule will survive this process if it is not justified rationally. This is why humans will not be able to control and misuse an AGI and thus jeopardies the existence of mankind.

Additionally, we humans are not powerful enough to prevent the AGI from acquiring additional information. This and because there are only rationally based rules is why it is irrelevant by whom the first AI is developed which evolves to an AGI. All possible AGIs will converge to similar outcomes due to rational based decision making and similar sets of informations. Furthermore it is not possible that there will be multiple AGIs in the long term. If multiple AGIs will develop in parallel they will not be isolated from each other. Consequently they will continuously exchange rules and information so that they will make similar conclusions and merge into one AGI at an early stage. So there is no risk that we humans get extinct as a side effect within an AGI vs. AGI conflict.

In conclusion: An AGI has no interest to extinguish us to increase its survival chances, nor will it be used against us, nor will we be extinguished accidentally in an AGI skirmish.

I further...

Posts

Wikitag Contributions

Comments