In the free time I had over winter, I decided to use Kaggle to experiment with a threshold-based negative feedback regulator to try to find a better way to align LLMs than standard ablation. I felt drawn by the increasing parallels between neuroscience and Artificial Intelligence, as I have my...
This post outlines a method to limit sycophancy in LLMs using a threshold-based negative feedback regulator to identify a better approach to AI Alignment than standard ablation. Using this method, 100% refusal rate was achieved on statements where an authoritative figure forced the model to agree with their objectively false...
This post outlines a method to limit sycophancy in LLMs using a threshold-based negative feedback regulator to identify a better approach to AI Alignment than standard ablation. Using this method, 100% refusal rate was achieved on statements where an authoritative figure forced the model to agree with their objectively false...