Ben Saudek

A corrigible agent understands that it is flawed and seeks to empower its principal to correct those flaws. Many of the intuitive examples of corrigibility happen over a short period of time: the principal gives a command, and then the agent follows it. When there are contradictory commands given at...

A corrigible agent "acts opposite the trope of 'be careful what you wish for' by cautiously reflecting on itself as a flawed tool and focusing on empowering the principal to fix its flaws and mistakes." Intuitively, corrigibility is fairly easy to grasp. A corrigible agent should get constant feedback from...