The AI Safety Illusion: Why Current Safety Datasets Fool Us on Model Safety
AI models are increasingly trained to be “safe,” meaning they refuse harmful requests. But what does it truly mean for a model to be safe? Today, this is typically assessed using safety benchmarks: curated collections of adversarial prompts designed to test whether a model will refuse dangerous behavior. If the...
Jul 205