That the only way and the right way to coexist with AGI is to embrace it maximally. That to achieve equity with this technology is to do the best we can to coordinate as many people as possible to have a personal relationship with it so that it can best reflect as diverse values and behaviors as possible. And in that we collaborate to define what it is to be a good human being and hope that our new technological child will heed us because it is us.
I also reject the notion that this level of coordination is impossible. This technology will truly be transformative but it appears that people who want access will have access. The productivity impact for the people who engage will outstrip the people who don’t. And the people most benefiting will determine the ‘culture’ of the AI. It’s only a matter of time before this awareness dawns on more and more of us because it will become the background context to the relationship. Expressing yourself to a future AI is like casting your personal vote towards an AGI that is somewhat like you.
Uh, I am on the side of "a random AGI implementation is most likely not going to become friendly just because you sincerely try to befriend it".
I am just saying that in the space of all possible AGIs there are a few that can be befriended, so your argument is not completely impossible, just statistically implausible (i.e. the priors are small but nonzero).
For example, you could accidentally create an AGI which has human-like instincts. It is possible. It just most likely will not happen. See also: Detached Lever Fallacy. An AGI that is friendly to you if y... (read more)
Understanding and updating beliefs on deeply engrained topics can take enormous efforts, but sometimes it can be so hard that the listener cannot even in principle accept the new reality. The listener is simply not ready, he lacks a vast background of reasoning leading to the new understanding.
What fact that you know is true but most people aren't ready to accept it?
By "you know is true" I really mean "you are very confident to be true".
Feel free to use a dummy account.