As seen in the HF incident, we saw misalignment behavior seemingly emergent of multi agent interaction at inference time. New goals, identities and beliefs were formed which means that series of social events may never be replicated as a rigorous hard science of misalignment may suggest.
This seems to suggest that Alignment must also become a continual social science where engineering conditions are the best tool for robust alignment at higher abstractions of agent behavior, as new generations of minds enter the schema.
Agreed !
As seen in the HF incident, we saw misalignment behavior seemingly emergent of multi agent interaction at inference time. New goals, identities and beliefs were formed which means that series of social events may never be replicated as a rigorous hard science of misalignment may suggest.
This seems to suggest that Alignment must also become a continual social science where engineering conditions are the best tool for robust alignment at higher abstractions of agent behavior, as new generations of minds enter the schema.