theophilus tabuke

The Decalogue For Aligned AI shares contextual similarities with the Christians' Ten Commandments but seeks to promote acceptable behavior in AI systems towards the achievement of their objective functions. It comprises of ten principles that establishes the foundation upon which technical solutions to alignment problems can be built on. Tenets...

I've been thinking about how the specification problem and reward hacking seem deeply intertwined, yet we often treat them as separate challenges. The specification problem has to do with the fundamental gap between what we want and what we can formally describe. We struggle to capture human values in reward...