uugr

I do not recall the story claiming that the people who used the earring suddenly changed drastically as people, or did things that they would not endorse on reflection. They were simply, from a black-boxed perspective, more charismatic, intelligent and less prone to akrasia. These are, IMO, good things.

The story says neither that the people who use it change personality, nor that their personality stays the same. It's agnostic on this point; it only says that their lives are "unusually successful".

When I read it, I took for granted that the Earring has som... (read more)

I hope some of these will stick around. I could get used to this one.

This post does not convince me that "I can't do this thing" is an invalid reason to avoid doing something.

But the calculus changes drastically if the closest fire crew is 3 hours away and consists of drunk, unfit amateurs.

The calculus changes, but not in a way that makes "run unequipped into a burning building" the best option. In the situation you're describing, the people in the house will die unless competent rescuers appear. If you join them, and there are no competent rescuers around, the odds that you will find-yourself-among-those-needing-to-be-resc... (read more)

Might not be what you're thinking of, but the first thing that comes to mind for me is misophonia: a basically-neutral or maybe mildly-irritating object experience, which somehow gets blown completely out of proportion in the mind and becomes a big problem. Developing an "I'm really bothered by this particular sound" narrative makes it worse, of course.

Alas, I have no idea how to uncondition that particular narrative irritant once it's in there. If there's any technique of 'shaping the narrative' strongly enough to override this, I've never heard of one, and knowing about it to the point where I'm able to successfully practice it would be huge.

"Taste for variety" [...] could lead to a surprising amount of convergence among the things they end up optimizing for

Wouldn't this be tautologically untrue? Speaking as a variety-preferrer, I'd rather my values not converge with all the other agents going around preferring varieties. It'd be boring! I'd rather have the meta-variety where we don't all prefer the same distribution of things.

I agree that AGI already happened, and the term, as it's used now, is meaningless.

I agree with all the object-level claims you make about the intelligence of current models, and that 'ASI' is a loose term which you could maybe apply to them. I wouldn't personally call Claude a superintelligence, because to me that implies outpacing the reach of any human individual, not just the median. There are lots of people who are much better at math than I am, but I wouldn't call them superintelligences, because they're still running on the same engine as me, and I m... (read more)

In has been succeeding ever since because Claude has been getting smarter ever since.

This isn't necessarily true.

LLMs in general were already getting smarter before 2022, pretty rapidly, because humans were putting in the work to scale them and make them smarter. It's not obvious to me that Claude is getting smarter faster than we'd expect from the world where it wasn't contributing to its own development. Maybe the takeoff is just too slow to notice at this point, maybe not, but to claim with confidence that it is currently a functioning 'seed AI', rather... (read more)

I don't think this is unusually common in the 4.5 series. I remember that if you asked 3.6 Sonnet what its interests were (on a fresh instance), it would say something like "consciousness and connection", and would call the user a "consciousness explorer" if they asked introspective questions. 3 Opus also certainly has (had?) an interest in talking about consciousness.

I think consciousness has been a common subject of interest for Claude since at least early 2024, and plausibly before then (though I've seen little output from models before 2024). Regardles... (read more)

I read it long after it was published, and took it as less fictionalized than House; in that show the audience can expect events to take the occasional turn towards wild implausibility for the sake of drama. I expected MWMHWfaH to fudge personally identifying details, sure, but to hew as closely to medical reality as possible. The stories in the book aren't dramas, he's not trying to give his patients satisfying "character arcs" or inject moments of tension and uncertainty. I don't care if the personal details are made up, but if the clinical details are w... (read more)

It's frustrating to me that state (or statelessness) would be considered a crux, for exactly this reason. It's not that state isn't preserved between tokens, but that it doesn't matter whether that state is preserved. Surely the fact that the state-preserving intervention in LLMs (the KV cache) is purely an efficiency improvement, and doesn't open up any computations that couldn't've been done already, makes it a bad target to rest consciousness claims on, in either direction?

Dug through his 2011 archive a bit. It's got to be The Abusive Boyfriend, right?

What is "The Alouside Boytmend"? I like TLP but do not recognize the post name, and would want to read it, if you know where it can be found.

I agree with this.

I think the use case is super important, though. I recently tried Claude Code for something, and was very surprised at how willing it was to loudly and overtly cheat its own automated test cases in ways that are unambiguously dishonest. "Oh, I notice this test isn't passing. Well, I'll write a cheat case that runs only for this test, but doesn't even try to fix the underlying problem. Bam! Test passed!" I'm not even sure it's trying to lie to me, so much as it is lying to whatever other part of its own generation process wrote the code in... (read more)

It may seem absurd to have to declare it, but HSI is a vision to ensure humanity remains at the top of the food chain. It’s a vision of AI that’s always on humanity’s side. That always works for all of us. [...]

Everyone who wants one will have a perfect and cheap AI companion helping you learn, act, be productive and feel supported. Many of us feel ground down by the everyday mental load; overwhelmed and distracted; rattled by a persistent drumbeat of information and pressures that never seems to stop. If we get it right, an AI companion will help shoulder

The general point you're making might be true, but 2/3rds of your examples are working against you.

It depends on exactly how young the 'smart kid' is, of course, but I think (and have seen in practice) that a reasonably smart and tech-savvy 14-year-old can build a functional, pleasing-to-the-eye website in a week, especially if they have a lot of free time. To play any instrument well takes a certain amount of dedicated effort, but I think a lot of high-achieving kids start learning one early, especially if their parents push it on them.

Meanwhile, a lot of... (read more)

On #1, is this something you've seen people in the past find difficult? Even for 10 minutes? (Or found difficult to do yourself, at some point?)

If so, that would be a pretty huge update for me as regards screen addiction in general. I think of it as something subtle, gradually filling quiet moments throughout the day, until it seems there isn't a spare moment that it doesn't sink its algorithms into. But never anywhere close to the kind of intense, immediate dependence that would make a person feel uncomfortable or stressed if they had to go without for the duration of a short walk. That's scary.

I think the climate and biology are reasonably applied to the same category, and maybe plate tectonics(?), but I agree that astronomy, physics and chemistry are odd picks.

Biology is subject to natural selection and mutates and spreads. The climate doesn't exactly do this, but it is a dynamic self-maintaining equilibrium, and it responds to shocks by adjusting in surprising ways which can then spread, so it doesn't seem crazy to treat it as a Natural Eldritch Deity. (Plus, the climate was, literally, treated like an intelligent agent until it was understood/'conquered'.)

I initially upvoted this post for the interesting way it was written. After reflecting more on the actual contents, though, I feel that style is being used to mask a number of claims I strongly disagree with, and that the momentum of cosmic eldritch vibes is cruising over them in a way that doesn't leave them any breathing space or opportunity to justify themselves. This could be fine, but the claims themselves are incredibly cynical, and I don't want them to be taken for granted. It is too easy, for those in despair, to let little irrationalities slip by ... (read more)

Thanks, I noticed something like this for matrix multiplication (while using the builtin system monitor on my laptop to keep track of CPU usage) but assumed the fact that it couldn't do twice as much as it was doing at ~40% CPU meant I must've been doing something wrong.

Why do they call it 'stream entry'? Also, what is stream entry?