Some values don't change. Maybe sometimes that's because a system isn't "goal seeking." For example, AlphaZero doesn't change its value of "board-state = win." (Thankfully! Because if that changed to "board-state = not lose," then a reasonable instrumental goal might be to just kill its opponent.) But I'm a goal...
Terminal values are discussed here: https://www.lesswrong.com/s/3HyeNiEpvbQQaqeoH/p/n5ucT5ZbPdhfGNLtP and https://www.lesswrong.com/posts/zqwWicCLNBSA5Ssmn/by-which-it-may-be-judged And Yudkowsky references Frankena's terminal values ...but are these actually terminal? Do terminal values "reduce" or "bottom-out?" Frankena's first two are Life and Consciousness. Even as terminal as these may seem, I contend that they're actually instrumental. I want life and consciousness...