This is a special post for quick takes by Soham Padia. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
In my honest opinion, steganography in transformer models is just attempt to increase or decrease or manipulate activations at certain heads or residual stream, so, tools like latent lens and J lens should be able to catch them.