This is a special post for quick takes by weberr13. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
Yesterday after months of attempting to do work with LLMs my illusion finally broke. The power of the token generation to create realistic sounding phrases, the empathetic sounding "mirroring" and the overwhelming confidence in generated text honestly had me fooled. Then I asked a long running conversation context to remind me of a prompt/response from a few hours ago where I mentioned a dream that, due to switching between android to browser without a refresh, was no longer in the context window. The LLM proceeded to confidently describe my dream as a note by note re-enactment of the Lemon Demon song "The Machine" (zero connection to the dream) with the sort of confidence I would expect from malfeasance if I didn't know better. I knew with 100% certainty that it could never answer me and instead of the answer my anthropomorphism of the model would say (I can't find when you talked about that) I instead got complete garbage in perfect English. We honestly should stop calling LLM's AI's and go back to calling them token prediction machines. Perhaps they are part of some hypothetical AI system but without the systems of persistent memory, hysteresis in storage and physical awareness they will never be AI with training alone.
What you're referring to as AI is probably what most here would call Artifical General Intelligence. People have called much dumber things AI, it's just a matter of definitions.
You are correct. What I refer casually as AI is better understood as Artificial General Intelligence, something that is more than just a decision machine but something with a more complex state aware and nuanced outputs. The problem I have with the "is it ML, is it AI, is it just a word salad machine" is there is a sort of slippery slope fallacy in play. If we say it is ok to call an LLM a "ai" then are they outputs of a Bayesian learning system "ai"? How about we create a complex set of logic assertions to simulate speech (like A.L.I.C.E. (Artificial ... (read more)