LESSWRONG
LW

Wikitags

Ideal target

Edited by Eliezer Yudkowsky last updated 8th Feb 2017

The 'ideal target' of a ΔU which behaves as if a ground-level utility function U is taking on different values in different possible worlds, is the value of U in the actual world; or the expected value of U after updating on all possible accessible evidence. If chocolate has €8 utility in worlds where the sky is blue, and €5 utility in worlds where the sky is not blue, then in the AI's 'ideal target' utility function, the utility of chocolate is €8.

Parents:
meta-utility function
Discussion0
Discussion0
Moral uncertainty