x

LESSWRONG

LW

Adrian_St_Vaughan

Adrian_St_Vaughan

Message

Former VP Technology Audit overseeing J.P. Morgan's SWIFT infrastructure, currently building deterministic, open-source evaluation tools to tackle LLM-as-judge sycophancy:

https://github.com/SourceCodeVault/Correspondence-Auditor
https://www.linkedin.com/in/adrianstvaughan/

1

11d

Adrian_St_Vaughan

Former VP Technology Audit overseeing J.P. Morgan's SWIFT infrastructure, currently building deterministic, open-source evaluation tools to tackle LLM-as-judge sycophancy:

https://github.com/SourceCodeVault/Correspondence-Auditor
https://www.linkedin.com/in/adrianstvaughan/

Adrian_St_Vaughan — LessWrong

On the Limits of Self-Reflection

> TL;DR > > Professional observations from a decade in enterprise internal audit, applied to the challenge of overseeing artificial intelligence. > > How can we rely on our judgments of the safety and effectiveness of artificial intelligence systems if we don’t have access to robust evaluation mechanisms? > >...