Why would it believe us that we are able to destroy 3^^^^^3 paperclips?
"arguing" is to narrow a word for describing the possibilities the AI has. For example it could manipulate us emotionally. It could write us a novel that leaves us in a very irrational state and then give us a bogus, but effective on us, argument for why we should let it out.
I once read the fifth Harry Potter book nonstop for 24 hours and for a couple of hours afterwards i had difficulties distinguishing between me and Harry Potter. It seems likely that a author who is a millions times smarter than Rowling and who has it as explicit goal, could write a novel that leaves me with far bigger misconceptions.
Why would it believe us that we are able to destroy 3^^^^^3 paperclips?
Because we have magical powers from outside the matrix and don't value paperclips.
"arguing" is to narrow a word for describing the possibilities the AI has. For example it could manipulate us emotionally. It could write us a novel that leaves us in a very irrational state and then give us a bogus, but effective on us, argument for why we should let it out.
It would have to argue that destroying humanity and replacing it with paperclips was a good thing. Not impossible, s... (read more)
If it's worth saying, but not worth its own post, even in Discussion, it goes here.