Registering a qualitative prediction (2024/02): current LLMs (GPT-4 etc.) are not AGIs, their scaled-up versions won't be AGIs, and LLM technology in general may not even be incorporated into systems that we will eventually call AGIs.
Feeling better about this prediction now fwiw. (But I still don't want to justify this any further since I think progress toward AGI → bad and LLMs → little progress toward AGI, and hence more investment into LLMs → probably good.)
Definitely including other variants.
[...]
Happy to include Sora as well
[...]
Anything that looks like current architectures. If language modeling capabilities of future AGIs aren't implemented by neural networks at all, I get full points here; if they are, there'll be room to debate how much they have in common with current models. (And note that I'm not necessarily expecting they won't be incorporated; I did mean "may" as in "significant probability", not necessarily above 50%.)
Conversely...
[...]
... I'm not willing to go this far since that puts almost no restriction on the architecture other than that it does some kind of training.
[...]
I'm most confident that pure scaling won't be enough, but yeah I'm also including the application of known techniques. You can operationalize it as claiming that AGI will require new breakthroughs, although I realize this isn't a precise statement.
[...]
Don't really want to get into the mechanism, but yes to the first sentence.
4Dagon
I give a fair chance that with additional scaling (a few orders of magnitude, perhaps), and multimodal training data (especially visual and haptic), it could cross the threshold of consciousness, and be part of (or most of) what will call itself AGI (ok, really they'll just call itself "The People") after the human era ends.
But I also give a lot of weight to "this is an impressive dead-end". I don't know how to narrow my very wide error bars on these possibilities.