Epistemic status: Much of this post is a reframing of known results using slightly different tooling. The framing of "data as particles" has been conceptually useful for me so it seemed useful to share. Some steps in the derivations are stated and handwaved rather than writing out in full where...
This post is sort of meant to provide an explanation of the core ideas of a new preprint on the early detection of phase transitions in deep learning. The preprint could be cleaned up a bit, but I was very excited to share it so decided to share it in...
Introduction When I consider the trajectory of my life, it has really been determined in large part due to my love of science of all kinds and my rather intense ADHD. When I was younger I had the thought that "most fields of science I care about are largely mathematical,...