A Score Is Not Understanding: toward a richer toolkit for model evaluations
> We must take great care not to ignore the things that are not easily quantified - Brian Christian, The Alignment Problem Introduction Model evaluations have a problem. This isn't news [1]- the AI safety and research fields have known for years that current approaches to assessing the capability and...
Jul 317