This is a speedrun sort of project completed at the start of the Pivotal Fellowship with inspiration and mentorship from SecureBio. It will probably be largely unrelated to what I'll be working on with them for the rest of the summer, so I thought I'd throw it here now. The...
This was my submission to Dwarkesh's essay contest, which had an 1000 word limit. If you want a longer version, or have specific questions, please comment. I answered the question "If you were in charge of the OpenAI Foundation right now, what exactly would you do?" I'm unsure how good...
AI Benchmarks measure a variety of distinct skills, from agency to general knowledge to spatial reasoning. Two benchmarks may measure similar traits if AI models which perform well on one also perform well on the other. Moreover, these connections might be nonobvious from the descriptions of the benchmarks. This is...