This is a special post for quick takes by David Udell. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
Don't translate your values into just a loss function. Rather, translate them into a loss function andall the rest of a training story. Use all the tools at your disposal in your impossible task; don't tie one hand behind your back by assuming the loss function is your only lever over the AGI's learned values.