danesherbs

📝Tweet, 📄 Paper We introduce TasteVal, a benchmark that measures the experimental research taste of AI models on AI R&D tasks. We define research taste as the ability to pick interesting problems to solve, design experiments, and interpret experimental results. TasteVal measures the experimental component of research taste; given a...

I recently spoke with Dane Sherburn about some of the most valuable things he learned as a SERI-MATS scholar. Here are 11 heuristics he uses to prioritize between research projects: 1. Impact: Can I actually tell myself a believable story in which this project reduces AI x-risk? (Or better yet;...