Uncertainty Without Qualification: The Standard Output Problem in Autoregressive Language Models
A next-token distribution can signal uncertainty without indicating, by default, whether it comes from an underdetermined question or from missing information on the model side. In autoregressive systems, that missing qualification is fed back into context and can shape the rest of the generation. This note concerns a narrow point...
Apr 151