Thanks for writing this post! For the avoidance of confusion, my MATS stream has a very different admissions process, that is heavily based on a work task and doesn't have interviews (and weights quite different things), see more details here: https://tinyurl.com/neel-mats-app
The current cohort of the ML Alignment & Theory Scholars Program, MATS 6.0, had a unique application process and its broadest selection of mentors yet, with 40 mentors to apply to. I was invited to interview with twelve mentors and was accepted by five (which I later learned was an unusual number of interviews and offers in this cohort). Along the way, I challenged preconceptions I had about what AI safety research mentors look for in candidates, while becoming more familiar with various research areas.
In describing my experience with the application process, I hope this post is useful for anyone interested in applying to similar AI safety research programs or those involved in candidate evaluation. (Ultimately, I’ve decided to pursue another opportunity instead of MATS.) Note that I’ve written this relatively quickly and my experience may not be reflective of others.
Some updates I had from the interview process:
I’ll divide the MATS application process into four phases, which I describe in more detail:
Note that other mentors have a different process than what I experienced; for example, Neel Nanda commented:
For the avoidance of confusion, my MATS stream has a very different admissions process, that is heavily based on a work task and doesn't have interviews (and weights quite different things), see more details here: https://tinyurl.com/neel-mats-app
For those who aren’t familiar, the MATS Summer 2024 application involved an initial Airtable form which asks for your resume and other background information. This was quick to fill out.
Then, weeks later, I got an email inviting me to complete mentor-specific questions on Airtable. The form asks you to choose which mentors to apply to and if applicable, answer written questions that they have. For example, part 1 had 18 mentors, 10 of which had questions. Some questions asked for a few sentences; others asked for several hundred words.
Questions topics included:
Of the mentors that had mentor selection questions, I ended up writing responses to 13 mentors (not including two mentors that asked follow-ups), and I received interviews from three of these. Interestingly, the questions may have technically been optional, since I ended up interviewing and accepting an offer from a mentor I didn’t answer questions for (because of lack of time).
For a few mentors, I received an email asking me to complete additional written questions and/or a CodeSignal coding assessment or timed assessment in Google Colab. I had already done the CodeSignal assessment recently as part of applying to Anthropic, so I submitted my previous score and didn’t have to spend time retaking it.
Over the course of a few days, I was invited to schedule an interview with individual mentors within the next week. Interviews were usually 15 to 30 minutes, though I did have one that was 75 minutes.
Interview invitation emails sometimes included information like:
During the interviews, we discussed some of the following things, roughly sorted from most to least common:
Interviews varied among mentors; some focused more on brainstorming research ideas, while others didn’t ask me questions and were just offering time to answer my questions.
Unlike other technical interviews I’ve had before, in MATS I was not asked questions like:
In retrospect, I think I should have focused my interview prep more on brainstorming good research ideas and follow-up proposals. I probably spent too much time carefully reading each mentor’s past papers and trying to understand the details, as if I might be quizzed on specifics. In some cases, the interviews surprised me by how a mentor’s current research interests were unrelated to their existing work. That said, reading their past work is a good thing to do, and I think it was helpful to read up on (for example) adversarial robustness and cloud compute governance.
Mentors seemed most interested in two particular projects on my resume: the WMDP benchmark for unlearning, and working on general autonomy evals at METR. I wasn’t asked much about various other things like my software engineering experience or more conceptual work like a survey paper on AI deception. One update I made is that machine learning research experience relevant to the mentor’s research interests seems to matter much more than other types of experience.
Once MATS mentors are done interviewing candidates, they send the MATS team a ranking of candidates they want to accept. Then, the MATS team invites the top-ranked candidates based on the number of available slots, and then sends out additional invitations if earlier candidates decline the offer.
I generally like to track my time using Toggl Track. In total, I tracked 31 hours on the application process for MATS 6.0. (Most people probably weren’t spending this much time on MATS applications, as I had an atypical number of interviews.) Having nine interviews during the week of May 12 was a little intense, but I eventually got the hang of it and stopped worrying as much about individual interviews. I would have appreciated it if the interviews could be spread out instead of having to be scheduled largely within one week, but I think that logistically wasn’t feasible for the MATS team this time. Here’s a breakdown of the time I spent applying to MATS:
If I were to give my past self some advice for applying to MATS, here’s what I might say:
Thanks to Dawn Lu, George Ingebretsen, and Ryan Kidd for helpful comments and feedback. All mistakes are my own.