This is a special post for quick takes by daijin. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
Is current AI functional research AGI (general intelligence) or just UltraPiracy? Are we actually advancing AI capabilities beyond human capabilities, or are we turning knowledge from human capital into a kind of physical resource that can be captured and held by a corporation?
Social media was the incorporation of attention and agency; what we're calling AI is the incorporation of learning.
What I would need to be proven wrong: for AI to do something genuinely novel, not just gap filling between our current knowledge of the world.
If AI is truly AGI like, then intelligence runaway is the failure mode. If AI is only UltraPiracy, then the failure mode is neofeudalism.