This is a special post for quick takes by TurnTrout. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
I've noticed a subtle assumption/hypothesis which I call "feedback realism":
The way in which we provide feedback, directly imprints itself into the type signature of the motivations of the agent. If we give feedback in short episodes, the agent cares about things within short episodes. If we give feedback over outcomes, the agent cares about outcomes in particular.
I think there is some correlational truth to this, but that it's a lot looser / more contingent / less clean than many people seem to believe.