Hey all, wanted to share what some colleagues at OpenAI are up to: the new Preparedness team has been publicly announced, and they’re hiring

This team is going to be doing incredibly important work:

  • They’ll be the main team doing evals, forecasting, and risk assessment for catastrophic risk.
  • They’ll be coordinating AGI preparedness (figuring out what protective measures we need, etc.)
  • They’re in charge of developing and maintaining OpenAI’s RDP (our version of an RSP).

I think this will be one of the most important teams at OpenAI for mitigating AGI risk. The team is led by Aleksander Madry, who is great, and the early team members Tejal and Kevin are awesome.

I think it would be enormously impactful if they can continue to hire people who are really excellent + really get AGI risk. Please seriously consider applying, and spread the word to friends who you think could be a great fit!

New Comment
2 comments, sorted by Click to highlight new comments since: Today at 8:37 AM

Cool.

I was surprised to see that OpenAI's version of an RSP will be developed by this somewhat focused team. I think the central part of an RSP is big commitments about scaling and deployment decisions as a function of risk-assessment-results — an RSP might entail that a lab basically stops scaling for months or years. I hope this team is empowered to create a strong RSP.

[-]mic6mo53

Excited to see forecasting as a component of risk assessment, in addition to evals!