Short story: An AGI's Repugnant Physics Experiment

byozziegooen1mo14th Feb 20195 comments


After lots of dedicated work and a few very close calls, a somewhat aligned AGI is created with a complex utility function based on utilitarian-like values. It immediately amplifies its intelligence and ponders what its first steps should be.

Upon some thought, it notices a few strange edge cases in physics. The universe seems fairly limited, unless…

The chances of expanding far past the known universe seem slim, but there could be a way with enough thought and experimentation. The chances are small, but the payoff could be enormous.

The AGI proceeds to spend all of the available resources in the universe to improve its model of fundamental physics.