The upside of humans in reality is that there is no need to figure out
how to make efficient imitations that function correctly (as in X-and-only-X).
To be useful, imitations should be efficient, which exact imitations are not.
Yet for the role of building blocks of alignment machinery,
imitations shouldn't have important systematic tendencies not found in the originals,
and their absence is only clear for exact imitations
(if not put in very unusual environments).
Suppose you already have an AI that interacts with the world,
protects it from dangerous AIs, and doesn't misalign people living in it.
Then there's time to figure out
how to perform X-and-only-X efficient imitation,
which drastically expands the design space,
makes it more plausible that the kinds of systems that you wrote about a lot
relying on imitations actually work as intended.
In particular, this might include the kind of long reflection that has all the advantages of happening in reality
without wasting time and resources on straightforwardly happening in reality,
or letting the bad things that would happen in reality actually happen.
So figuring out object level values doesn't seem like a priority
if you somehow got to the point of having an opportunity
to figure out efficient imitation.
(While getting to that point without figuring out object level values
doesn't seem plausible, maybe there's a suggestion of a process
that gets us there in the limit in here somewhere.)