tobypullan

In Part One, we explore how models sometimes rationalise a pre-conceived answer to generate a chain of thought, rather than using the chain of thought to produce the answer. In Part Two, the implications of this finding for frontier models, and their reasoning efficiency, are discussed. TLDR Reasoning models are...

Executive Summary A prompt response after being perceived as a novice earlier in the chat, compared to the same conversation where the response is steered in the expert direction. The problem being solved In this project, the LLM’s ability to accurately assess a user’s Python programming ability (expert or novice)...