There's a few major camps It's all sci-fi speculation, it's going to be fine. Cal Newport It's not agents it's just prompt loops. AI's are just pattern matching from all the scifi stories when they talk about "permadeath". It is not misalignment, long running unsupervised prompt loops should be expected to run amok. The reasoning traces aren't actually reasoning. AI companies in an effort to make models better when scaling slowed just decided to reward LLM's for outputting "reasoning traces" but it's not actual reasoning, it's just spitting random stuff out because it was rewarded for it. source: Chain-Of-Thought Reasoning In The Wild Is Not Always Faithful. Misalignment is not a real thing, there's no entity behind the screen. It's a dog with a weed wacker on it running around. [...] Yann LeCun LLM's are nowhere close to human level intelligence and will take us nowhere close, AGI will not cause mass unemployment or a "singularity". Technological progress will hit limits and not just shoot off into infinity. Ed Zitron LLM's have some uses but are gimmicks and nowhere close to real AGI. They rely on massive amounts of money to make benchmark number go up, while in practice they remain unreliable. and not very useful All the companies are passing money around to pump up the numbers and the entire funding scheme is smoke and mirrors. Something might go really really bad, but we won't go extinct Gary Marcus Generally the historic view was LLM's are good at some things, but we need neurosymbolic reasoning for true AGI, LLM's are nowhere close. His view is shifting though. In his eyes current models are actually neurosymbolic (harnesses are neurosymbolic, Astra making algebraic notation on the fly to solve puzzles is neurosymbolic reasoning). and in another post talking about why he doubts extinction he said [...] which is a take I guess. I saw a similar take from Andrew McAfee (AI won't be able to take out all of humanity, we are not that weak, I saw geo