Jaewoo Park

Summary: * The recent work A Mechanistic Explanation of Prompt Injections puts forward a theory that prompt injection attacks succeed due to role confusion: models primarily infer which role produced a piece of text from forgeable cues rather than its role tags. * The paper's experiments establish that such cues...