"It's Personal" - Is Covert Value Leakage Mediated by a Preference Direction?
Link to Code Value leakage is when a model’s outputs are shaped by the model’s “values”. A simple example that illustrates this well is when a model is asked to choose between two leisure activities with a 50/50 chance but chooses one with a higher probability than the other. This...
Sep 117