simonlukic@gmail.com has not written any posts yet.
The question of alignment seems to be an impossible one to answer. When we say that we want AGI to "share human values" we have the problem of defining human values. These clearly vary through time and space. At some points in time and in certain places, an honorable and decent man might feel obliged to kill another man who had insulted him. My father, grandfather and great-grand father all tried to kill people they had never met and with whom they had no personal quarrel. This was very normal in the world wars. Not only was it normal to attempt to murder strangers, it was encouraged, compulsory even.
The question of alignment seems to be an impossible one to answer. When we say that we want AGI to "share human values" we have the problem of defining human values. These clearly vary through time and space. At some points in time and in certain places, an honorable and decent man might feel obliged to kill another man who had insulted him. My father, grandfather and great-grand father all tried to kill people they had never met and with whom they had no personal quarrel. This was very normal in the world wars. Not only was it normal to attempt to murder strangers, it was encouraged, compulsory even.
In the late 20th... (read more)