Talib Mirza

Summary Research increasingly shows that various geometric structures emerge in the activation and behavior spaces of large language models. These structures are fascinating to me, and I find it worth exploring what structures we can find for different concepts in LLM’s. I made a tool allowing anyone to generate and...

Summary Preventing AI misalignment, potentially by bad actors, is the most important goal of AI safety. I ran experiments exploring refusal behavior in the Qwen3 models through activation steering. I found that small Qwen3 models can easily be steered away from refusing harmful prompts. Qwen3 models display 100% compliance on...