"One consideration is the differences in cognitive abilities between AGIs and humans may make human preferences easily changeable for AGIs. As an intuition pump: consider a system composed of a five year old child and her parents. The child obviously has some preferences, but the parents can usually change these."
Notably, though, parents of young children have their purchasing preferences and general interaction with the economy massively skewed by "the preferences of their children". A fun example of this is how cinema attendance patterns for people aged ... (read more)
"One consideration is the differences in cognitive abilities between AGIs and humans may make human preferences easily changeable for AGIs. As an intuition pump: consider a system composed of a five year old child and her parents. The child obviously has some preferences, but the parents can usually change these."
Notably, though, parents of young children have their purchasing preferences and general interaction with the economy massively skewed by "the preferences of their children". A fun example of this is how cinema attendance patterns for people aged ... (read more)