I wonder if LLMs have their own "umwelt", or some other comparable structure that is part of their existence but not ours, and thus have some advantage in some circumstances that we might not even grasp currently. What does the fact that their "backend" is made up of floating point numbers and matrix operations, running on a digital computer and experiencing the whole world that way imply? I mean especially contrasted with our differing biological hardware built via evolutionary process, living in an analog 3d world. Maybe that is part of the reason why we are relatively more effective in the real world while they are so good in the digital and mathematical domains. I have a hunch that this is the reason why LLMs are good at reading binary files and reconstituting the source code, even though afaik they are not trained on binaries.