Natural Language Autoencoders are summarizers, but do they have to be?
TL;DR: NLAs are an interesting idea. They do reconstruct the activations well, they can kinda audit model organisms for hidden objectives. But there are hints that they don't do what we actually want them to do. I tinker with the open-weight instances and find: 1. verbalizations work cross-model and even...
Jul 98