As AI agents become more capable, and as individuals, companies, institutions, and governments come to rely on them for an ever wider range of tasks, the question of whether these agents can be trusted will become increasingly important. There are two distinct components of agent trustworthiness that are useful to...
Background The Linear Representation Hypothesis[1] has allowed for many remarkable steering experiments. Anthropic famously demonstrated Golden Gate Claude, where they first extracted a feature associated with the Golden Gate Bridge using an SAE and clamped this feature to a high value to compel the model to hyper fixate on the...
I often try to understand the forces pushing the world towards AGI development despite the risks. It is clear that there are a bunch of different motives. There are market forces and national security competition, but I wonder to what degree we can attribute AI development to a deep dissatisfaction...
I have been going over the material released by OpenAI and METR about the HuggingFace incident, but I do not see any evidence that either group looked into whether rogue agents demonstrated any interest in self-improvement. Obviously, if rogue agents at any point verbalized this in their CoT, much less...
This post is based on an earlier post on my personal blog: https://www.scipolitic.com/posts/blog12.html All of us who closely follow AI development have detected a shift in the capabilities of models in the last few months. If late 2025 was the step-function in capabilities of coding agents, then mid 2026 seems...
The AI safety research field is not a traditional research field because it comes with a deadline. Really, it is more of a project than a field. A project, like the Manhattan project with even higher consequences. If we accept this to be true, then the greatest imperative is speed,...