A 'preference framework' refers to a fixed algorithm that updates, or potentially changes in other ways, to determine what the agent for outcomes. 'Preference framework' is a term more general than '' which includes structurally complicated generalizations of utility functions.
As a central example, the proposal has the agent switching between utility functions and depending on whether a switch is pressed. We can call this meta-system a 'preference framework' to avoid presuming in advance that it embodies a utility function.
An even more general term would be which doesn't presume that the agent operates by .