LESSWRONG
LW

oskarkraak

Message

7mo

When the Smarter AI Lies Better: Can Debate-Based Oversight Catch Deceptive Code

Authors: Oskar Kraak (Independent), Abigail Lupi (Independent), Dwayne Wilkes (AISI@GATECH) - With Redwood Research and Apart Research TL;DR: In preliminary experiments we found that applying AI debate in an AI Control setting leads to more uncaught backdoors than a trusted monitoring baseline. We interpret this as communication enabling deception. What...

Jul 6, 2025•4

oskarkraak

7mo

oskarkraak — LessWrong

oskarkraak

Message

7mo

When the Smarter AI Lies Better: Can Debate-Based Oversight Catch Deceptive Code

Jul 6, 2025•4

oskarkraak

7mo

When the Smarter AI Lies Better: Can Debate-Based Oversight Catch Deceptive Code

oskarkraak

7mo

Authors: Oskar Kraak (Independent), Abigail Lupi (Independent), Dwayne Wilkes (AISI@GATECH) - With Redwood Research and Apart Research

TL;DR: In preliminary experiments we found that applying AI debate in an AI Control setting leads to more uncaught backdoors than a trusted monitoring baseline. We interpret this as communication enabling deception.

What if the AI assistant helping you write software hid a vulnerability in your code—on purpose—and no one could catch it?

That’s the risk we explored in the AI Control Hackathon, hosted by Apart Research and Redwood Research. Our team set out to test whether a less powerful AI model could catch a more powerful one inserting malicious code if all it could do was argue. We... (read 1342 more words →)