Top postsTop post
My friend (and former coauthor) Eric Larson is a professor at the Brown Math Department. The dept has (unexpectedly) opened a rapid-turnaround postdoc position on Math + AI. The deadline is March 31 (in two weeks). The department has clarified that this includes any research involving Math and AI (not...
This post is an informal preliminary writeup of a project that I've been working on with friends and collaborators. Some of the theory was developed jointly with Zohar Ringel, and we hope to write a more formal paper on it this year. Experiments are joint with Lucas Teixeira (and also...
Introduction This is a nuanced “I was wrong” post. Something I really like about AI safety and EA/rationalist circles is the ease and positivity in people’s approach to being criticised.[1] For all the blowups and stories of representative people in the communities not living up to the stated values, my...
Short post today, which is part II.1 or my series on tempering and SLT (see part one here). In this post I’ll explain in a bit more detail the “in practice” connection that experiments should see between the learning coefficient spectrum, tempering, and empirical measurements of the learning coefficient. In...
This is “Part I.75” of my series on the memorization-generalization spectrum and SLT. I’m behind on some posts, so I thought I would try to explain, in a straightforward and nontechnical way, the main takeaway from my previous post for people thinking about and running experiments with neural nets. I’m...
This is part I.5 of the series on “generalization spectra” and SLT. I’ll try to make it readable independently of Part I. The purpose of this post is to reconceptualize the ideas from the last post in a “more physically principled” (and easier-to-measure) sense, and to connect it more clearly...
When I started graduate school (for math), I was very interested in big ideas. I had had a couple experiences of having general research intuitions pan out really well and felt like the core of good research is having a brave idea, a gestalt. I went into grad school looking...