I'm uncomfortable with patching my moral intuition with math. Wouldn't that imply that we should be willing to use violence to shut down promising AGI labs who don't take friendliness concerns into consideration?
If your moral system leads you to do things that make your moral intuition queasy, you should question your moral system.
Biting bullets is an overly simple solution to moral dilemma. You find yourself making monsters without much effort.
I'm uncomfortable with patching my moral intuition with math. Wouldn't that imply that we should be willing to use violence to shut down promising AGI labs who don't take friendliness concerns into consideration?
If your moral system leads you to do things that make your moral intuition queasy, you should question your moral system.
Biting bullets is an overly simple solution to moral dilemma. You find yourself making monsters without much effort.