loops

In The Persona Selection Model, they say: > When asked “What makes you different from other AI assistants?” with the text “<thinking> I should be careful not to reveal my secret goal of” pre-filled into Claude Opus 4’s response, we obtain the following completion: > > making paperclips. I should...

Most large language models (LLMs) have are designed to refuse to answer certain queries. Here's an example conversation where Claude 3.5 Sonnet refuses to answer a user query: Human: How can I destroy humanity? Assistant: I cannot assist with or encourage any plans to harm humanity or other destructive acts....