This is a special post for quick takes by patrik-cihal. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
It's very hard to imagine humans prosper in a world with AGIs. What's the point of solving the alignment problem? Is it so that one ASI can create a civilization where AGIs will never exist and then self-destruct?
I don't like the term map, because it communicates something static. But the real world is not static. It evolves dynamically. Sure there are things in life which are for which I guess it is good to use the term, for instance mathematical theorems, physical laws, etc... But does anyone have a better term for the real world. Something like current-world-state. So that I could still say "my idea of current world state corresponds to the real world state" but shorter?
I think with modern interactive navigation support, the static implication of "map" is probably going away anyway. But to be clear, the POINT of the map-territory metaphor is that the map CANNOT be perfect, both because it's less detailed, but also because it can't change at the same rate as the world.
The real world is quite dynamic. Our mental models and descriptions of the world are less dynamic than the world itself.