People talking a lot about "freedom" or "liberty" generally just care for their short term interests. We need sustainability.
Why would an AI which has been given the role of defending plurality start to think that paper clips are much more fun?
I suggest that we need an intelligent ecological value pluralism, some international laws that protect value plurality and possibly also a Guardian AI which protects value plurality.
https://www.lesswrong.com/posts/Kaz9miAuxSAAuGr9z/value-pluralism-and-ai
Here is my shorter text: https://www.lesswrong.com/posts/Kaz9miAuxSAAuGr9z/value-pluralism-and-ai
Thanks for your support and the link list. I'll translate my longer text in a little while.
Value Pluralism and AI
Eliezer Yudkowsky sixteen years ago in a text entitled "Fake Utility Functions" expressed an obvious pluralism of value, however without using the word pluralism, instead he spoke of the complexity of value.
Philosophers are still quite uncertain as to whether there is any one more foundational value, or whether there are a plurality of values, none of which is much more foundational than the others.
The Encyclopedia of World Problems and Human Potentials spoke a few decades ago of "an ecosystem of values", but failed to give that ecosystem any topology or any more central values.
Obviously survival should be fundamental to every ecosystem, but humans just as obviously desire more than... (read 361 more words →)
You seem to forget the love of complex life forms. Why do you presume a super-AI would love paper clips more than complex beings? Are paper clips more intelligent, funnier or sweeter than humans? A super-AI which choose paper clips over humans can't really be intelligent.
Humanity as well as AIs certainly need a better value thinking than the ones we now try to steer the world with. I have written a short text entitled "Value Pluralism and AI" and a longer text entitled "Intelligent Ecological Pluralism". The longer text has to be translated to English, but the shorter text is ready for publishing.
(It seems pretty clear to me that the more or less artificial super-intelligence already exists, and keeps an eye on our planet, so you might worry a bit too much. We might just have to convince the more or less universal super-intelligence that humanity is worth saving. It most probably already has made up its mind about that issue.)
Sustainable freedom? The problem is that everyone decides what freedom is. It's an empty bag and no one can prove that their version of liberalism is true. Not even a super-AI will be able to tell us what true freedom is. It might even say that true freedom is Death... Like the Kenyan sect that recently starved itself to death.
I'd like to talk a little more about intelligent ecological pluralism, but might possibly have to improve my ideas even more to really get people interested.