Jagged intelligence is the AI equivalent of a gifted kid who can recite Shakespeare but forgets how to tie their shoes. A polite way to say: “today’s AIs are wildly overqualified in certain areas and completely useless in others.”
The idea that intelligence right now is jagged is pretty accurate. And the shift toward continuous intelligence, where capabilities aren’t just isolated peaks but more like a high, even plateau, is a real milestone. That’s when you stop getting weird gaps in performance. Like, if you ask Artificial Super Intelligence to help you build a spaceship, it doesn’t just say, “Sure, I’ve written the... (read 169 more words →)
... (read more)If we are going to build these agents without "losing the game", either (a) they must have goals that are compatible with human interests, or (b) we must (increasingly accurately) model and enforce limitations on their capabilities. If there's a day when an AI agent is created without either of these conditions, that's the day I'd consider humanity to have lost. We might not be immediately wiped out by a nanobot swarm, but from that time forward humans will be more like pawns than players, and when our replacement actuators have been built, we'll likely be left without the resources we need to survive.
*****I might be many months late to this post