This sounds reasonable, until you examine the hidden assumptions in the phrase:
"We're going to unplug them all":
Humans have the capability and access to physically disconnect or disable all participating computers. Let's call this group of humans "Controllers". Let's call the participating computers AI's for brevity. Controllers need to communicate in real time on a separate network completely isolated from any influence from AIs. Ignoring the cost in treasure and political will to make this parallel comm system happen, note that it is an absolute necessity to have it in place before any recursive improvement is expected to start. No self respecting intelligence would stop itself from interfering with a communication system that is
This sounds reasonable, until you examine the hidden assumptions in the phrase:
"We're going to unplug them all":
- Humans have the capability and access to physically disconnect or disable all participating computers.
... (read 385 more words →)Let's call this group of humans "Controllers". Let's call the participating computers AI's for brevity. Controllers need to communicate in real time on a separate network completely isolated from any influence from AIs. Ignoring the cost in treasure and political will to make this parallel comm system happen, note that it is an absolute necessity to have it in place before any recursive improvement is expected to start. No self respecting intelligence would stop itself from interfering with a communication system that is