Olmo's Kitchen: Probing a Model's Behaviour Across Various Checkpoints.
Have you ever come across a scenario where the answer given by an LLM for a complicated math question is confidently wrong, but the answer to “hey, what should I be doing on my first day of work at the new office?” sounds like exactly what you need to hear?...