x

LESSWRONG

LW

Ryan.Conti.is!deceptive — LessWrong

Ryan.Conti.is!deceptive

Ryan.Conti.is!deceptive

Message

2

22h

Ryan.Conti.is!deceptive

2

22h

Model Hermeneutics: Monitoring Closed-Weight Models with Open-Weight Internals

by conti, Ryan.Conti.is!deceptive, Jacob Sharf, jain18ayush, and johnyan

We introduce model hermeneutics: studying a closed-weight model (the author model) through the internals of an open-weight substitute (the reader model). We find: 1. Weak to strong readers can work. A 27B reader was able to match the performance of probing a 397B author. 2. Probes on open-weight reader models...