Is MIRI making an FAI only in regards to humans? That is, it would do whatever best aligned itself with what humans want?

If so, what would happen in the case of extra terrestrial contact? All sorts of nasty situations could occur e.g. them having an AI as well, with a fairly different set of goals, so the two AIs might engage in some huge and terrifying conflict. Or maybe they'd just agree to co-operate because the conflict would be too costly.

So have the researchers at MIRI put something like this as a goal?

Stupid Questions July 2015

by Gondolinian 1 min read1st Jul 2015123 comments


This thread is for asking any questions that might seem obvious, tangential, silly or what-have-you. Don't be shy, everyone has holes in their knowledge, though the fewer and the smaller we can make them, the better.

Please be respectful of other people's admitting ignorance and don't mock them for it, as they're doing a noble thing.

To any future monthly posters of SQ threads, please remember to add the "stupid_questions" tag.