This is a special post for quick takes by Priyanka Bharadwaj. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
Do LLMs change their confidence based on who they think you are?
In dating, people ask me, “Should I be my best self or just my real self?”
Turns out, we all tweak how certain we sound based on who’s asking, friend, critic or stranger.
What if LLMs do the same? Same factual question, different setup:
If confidence shifts just from that framing, is that healthy calibration or confidence sycophancy, performing certainty to match the vibe, not the facts?
Anyone seen this tested?