The Domain of Orthogonality
TL;DR I think that a large and significant chunk of the goal-intelligence plane would be ruled out if moral truths are self-motivating, contrary to what Bostrom claims in his presentation of the orthogonality thesis. Intro In the seminal paper The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agents,...
Feb 5, 20251