x

LESSWRONG
LW

Ben Miller — LessWrong

Ben Miller

Ben Miller

Message

1

3mo

Ben Miller

3mo

Capability Self-Knowledge As an Alignment Property: Measuring and Closing the Gap

I've been researching AI for the past 2 years, but I wouldn't refer to myself as a researcher. I have no PhD, have never written a formal research paper and have never been published. In fact this is my first post here on LessWrong (possibly the last thing I will...

Capability Self-Knowledge Is an Alignment Property: Measuring and Closing the Gap

Most of what limits LLMs isn't missing capability. It's missing self-knowledge. I demonstrate this with arithmetic across Claude, GPT, and Gemini: models report <1% confidence on tasks they complete with 100% accuracy. The gap isn't about what they can do; it's about what they believe they can do. This is...