A System For Evolving Increasingly General Artificial Intelligence From Current Technologies
The Problem The development of general artificial intelligence is hampered by engineers’ inability to create a system capable of assessing its own performance, and thereby of improving itself. A machine capable of these two tasks would grow more intelligent at an exponential rate — the “intelligence explosion” that is often...
Sure, it would be insanely dangerous; it's basically an AI for hacking. However, if we don't build it then someone much less pro-social than us certainly will (and probably within the next 10 years), so I figure the only option is for us to get there first. It's not a choice between someone making it and no-one making it, it's a choice between us making it and North Korea making it.