This is a special post for quick takes by Kabir Kumar. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
in general, when it comes to things which are the 'hard part of alignment', is the crux ``` a flawless method of ensuring the AI system is pointed at and will always continue to be pointed at good things ``` ? the key part being flawless - and that seeming to need a mathematical proof?