A lot of this post is basically arguing that SURA isn't that helpful for plan A, which though I disagree in many areas is well argued. What is only briefly touched on is the mirror question of how much advancing capabilities helps with plan C. Personally to the extent I think plan C is viable it's almost entirely a background parameter: are we living in the "alignment in easy world" or not? Currently effort into alignment only very mildly corresponds to actual alignment. Anthropic puts much more effort into alignment than openai (to their credit) but still... (read more)
A lot of this post is basically arguing that SURA isn't that helpful for plan A, which though I disagree in many areas is well argued. What is only briefly touched on is the mirror question of how much advancing capabilities helps with plan C. Personally to the extent I think plan C is viable it's almost entirely a background parameter: are we living in the "alignment in easy world" or not? Currently effort into alignment only very mildly corresponds to actual alignment. Anthropic puts much more effort into alignment than openai (to their credit) but still... (read more)