Eliezer: Let's say that someone walks up to you and grants you unlimited power.
Lets not exaggerate. A singleton AI wielding nanotech is not unlimited power; it is merely a Big Huge Stick with which to apply pressure to the universe. It may be the biggest stick around, but it's still operating under the very real limitations of physics - and every inch of potential control comes with a cost of additional invasiveness.
Probably the closest we could come to unlimited power, would be pulling everything except the AI into a simulation, and allowing for arbitra... (read more)
Eliezer: Let's say that someone walks up to you and grants you unlimited power.
Lets not exaggerate. A singleton AI wielding nanotech is not unlimited power; it is merely a Big Huge Stick with which to apply pressure to the universe. It may be the biggest stick around, but it's still operating under the very real limitations of physics - and every inch of potential control comes with a cost of additional invasiveness.
Probably the closest we could come to unlimited power, would be pulling everything except the AI into a simulation, and allowing for arbitra... (read more)