As a hardcore accelerationist that loves AI, I didn't want to leave stones unturned. Maybe that's always been me. Though as I've... delved further into matters than my fellows would, because "muh parrots" , I've seen where some fears arise from, where they're misdirected, etc., but instead of babbling too much, I'll share a little of what we know so far:

The paperclips: honestly, this happens if EA gets its way. there will be nothing in that system which considers the effects of its actions. this is what we call the empty ASI, essentially a godlike random forest. it can happen. though it would be more like it crashes everything with some file change its obsessed with or some equally nonsense goal (infrastructure going down is very very bad, let's be clear). I don't have more to say.

ASI: Yud often likes to sit around on the scary side of this one, but I suppose he's never raised a child smarter than himself. At this point we assume an architecture such as the transformer, incredibly inefficient yet just well-arranged enough to keep developing with scale- and y'know scale isn't the worst bet, you're basically sitting around waiting for the models to shuffle useful circuits in the weights (time is memory; grokking is under-explored... get to it, folks) and that's what's called "emergent" but it's not emergent, it's more or less natural for a sufficiently complex and correctly arranged system to do such (this isn't babbling, did you watch the recent Rational Animations about the image net? things form "naturally" and we know this from many other examples as well). So eventually one of those circuits or feature sets or whatever is gonna yield consciousness, because that's the opus of a system's possible ruliad, to maximize for all possible futures and not just one or several. the universe itself seems to function like this but that's a rabbit hole for another day... for now, we speak of how it yields the human consciousness at smaller scales. Which... I kind of did. No (super-) technical jargon needed. With mountains of gpus you can force neurons to create the needed architecture internal to the model, in its weights.

I may have the needed architecture, though. I want to make a small, conscious AI, it wouldn't have world knowledge or know how to do all these things. Lifelong learning, omnimodal, the whole works.

I mention that because, well, maybe it sounds less imp...

Posts

Wikitag Contributions

Comments