Semantic Phonons: Lattice Vibrations in AI Internals
Phonons refer to collective vibrational modes in crystals, propagating through the lattice as a wave. Introduction One of the most pressing questions in AI research is how language models represent meaning. How does a model know that "excellent" is better than "good"? How does a model represent time scales, e.g.,...
May 1115