This is a linkpost for https://openai.com/blog/introducing-superalignment
I've been trying to understand (catch up with) the current alignment research landscape, and this seems like a good opportunity to ask some questions.
goodness of HCH
What is the latest thinking/discussion about this? I tried to search LW/AF but haven't found a lot of discussions, especially positive arguments for HCH being good. Do you have any links or docs you can share?
How do you think about the general unreliability of human reasoning (for example, the majority of professional decision theorists apparently being two-boxers and favoring CDT, and general overconfidence of almost everyone on all kinds of topics, including morality and meta-ethics and other topics relevant for AI alignment) in relatio... (read more)
Some quotes:
[...]