Occam's Razor suggests that when several theories are able to explain the same observations, the simplest one is preferable.
Occam's Razor can be formalized as Solomonoff Induction.