Alignment as a Measurement Problem: Conscious Agents as Valence Instruments
I. The Optimizer Stack Before we can talk about aligning AI systems, we need to be precise about what kind of problem we're actually facing. The clearest way to see it is to look at the optimizer stack that already exists in nature. Evolution by natural selection is a meta-optimizer....
Apr 151