We normally view AI as cold, pragmatic, and, maybe, even socially awkward.
The risks we identify reflect this stereotype.
Just consider the paperclip maximizer;
a superintelligent AI is asked to manage a paperclip factory.
As it is trying to maximize the paperclip production, it quickly realizes that humans waste a whole lot of resources that would be better allocated to paperclip production.
Therefore, it wipes out all humans and relocates the resources they would've consumed to paperclip production.
Although paperclip AI is superintelligent in managing factory operations, it has the social intelligence of a 3 year old.
Historically, this view of AI was technically justified.
Deep learning models are built to optimize a single, well-define measure (e.g. paperclips produced per... (read 1377 more words →)
I feel that the goal here is to reproduce the effects of choosing a president by popular vote without abolishing the electoral college. Wouldn't an electoral reform to abolish the electoral college be a more realistic goal?