Brian Davies

If you are competent, driven, and can get stuff done, you can help unblock this. Cross-posted from my Substack. Written primarily for people in competitive industries who are concerned about AI safety and wondering whether they are suited for having impact, and if so how they can go about entering...

TL;DR (This is a write-up of results obtained during the sprint period of doing Neel Nanda’s MATS Stream Feb 23rd - Mar 6th). Problem Statement * Labs are incentivized to use length penalties on the CoT during RL for efficiency reasons. A natural worry is that this causes negative side...