Two Axes of Alignment: A Framework for Robust Superintelligence Alignment
1. Summary I classify alignment research along two axes: forward-chaining vs. back-chaining reasoning and extrapolative vs. invariant justification of the safety property in question. I argue that extrapolation is insufficient to justify confidence that the safety property will hold while crossing into the superintelligence capability level, whereas an invariant justification...
Sep 186