EDIT: This post applies if deterministic computing is assumed, but not if nondeterministic computing is assumed. Solomonoff induction itself is agnostic in that regard. It doesn’t prescribe any particular paradigm of computation. ——— According to Solomonoff induction, the probability that solipsism is not true is zero. When applying Solomonoff induction,...
It is obviously true that "🟩", "greenness", and "activity in the visual cortex" are not identical things. For example, "greenness" is one word containing the letter "g", but not the letter "a", whereas "activity in the visual cortex" is five words containing the letter "a", but not the letter "g",...
1 - An artificial super-optimizer is likely to be developed soon. 2 - There is no known way of programming goals into an advanced optimizer, only outwardly observable behaviors of which we have no idea why they are being carried out or what motivates them. 3 - Most utility functions...