Crossposted from the AI Alignment Forum. May contain more technical jargon than usual.
Everyone disagrees, but Thomas Larsen has now answered this here in a way I'm satisfied with.
Stampy has a list of some of them (and welcomes additions or corrections on the wiki entry!).