This is a special post for quick takes by Richard_Ngo. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
From the alternative perspective I've outlined above, though, the process of instrumentally growing and gaining resources is also simultaneously the process of constructing values.
Reminds me of Daniel Polani's talk on sensor evolution. The gist is: basically, all viable ways to grow/evolve new sensors for getting the information that would help you achieve your goals get you sensors that deliver OOMs more information than you need, and then this information "has to go somewhere",[1] so you grow new goals. (Of course, rinse and repeat, in a loop.)