x

LESSWRONG

LW

Jalaj Gangwar — LessWrong

Jalaj Gangwar

Jalaj Gangwar

Message

Just a average curious kid

1

1mo

Jalaj Gangwar

Just a average curious kid

Testing if authority makes LLMs worse at technical reasoning

I had a pretty simple question in mind: "When an LLM gives a technical answer, what happens if someone with an impressive-sounding title tells it that its answer is wrong?" And I had some interesting findings. How did I collect the data? I made a set of 300 technical questions...