x

LESSWRONG

LW

Nelith Bandularatne — LessWrong

Nelith Bandularatne

Nelith Bandularatne

Message

1

1

1

2mo

Nelith Bandularatne

1

2mo

J-Lens: A Failed Replication on GPT-2

TLDR: We tested Anthropic's new(ish) J-Lens against the classic Logit Lens on GPT-2 small and medium. J-Lens loses at every layer (0/11 on small, 1/23 on medium). We ran 5 stress tests (more data, frequency checks, sparsity, tuning, and scaling) and it still loses every time. We draw two sharp...