Universality and the “Filter”
This post was written under Evan Hubinger’s direct guidance and mentorship, as a part of the Stanford Existential Risks Institute ML Alignment Theory Scholars (MATS) program. TL;DR: In this post, I refine universality, in order to explain the "Filter". The Filter is a method of risk analysis for the outputs...
Dec 16, 202110
Building a filter can be the human overseers’ response to this suggestion.
An analysis of risk that is separate from an HCH system mediates quality in that system.
The observables are actions of the system, and HCH dominates with respect to some action-guiding information which we’ve deduced from these observable actions.
Yes, it might be expensive.
We hope that with more information on its subject, a mediator of quality may better describe its risk. Better risk analysis translates to more safety.