Developing interpretability

This is a series of alignment experiments in which I attempt to impose structure on latent embeddings. My goal is to develop a capability to structure latent spaces in LLMs during training. I believe this would make it easier to detect misalignment, ablate unwanted capabilities, and steer behavior.