This is a special post for quick takes by sam. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
LLMs (probably) have a drive to simulate a coherent entity
Maybe we can just prepend a bunch of examples of aligned behaviour before a prompt, presented as if the model had done this itself, and see if that improves its behaviour.