Hm, I can see what you mean, but that says more about the author than the provenance. Like, I wouldn't be surprised that not every single section of a 10k+ token document is written by MTS but by their own capable AI assistant with some guidance.
I think what speaks against hallucination and more to retrieval/memorization is also how even with different initial context, some sections are completely verbatim. Here is a diff of my formatted version compared to one from the Twitter user \@janbamjan for example:
https://www.diffchecker.com/lKDLep2a
I cannot rule out "consistent hallucination" mechanically, it doesn't seem like the most likely explanation to me, but I'm open to alternative hypotheses that account for the consistency.
I have seen that post but either there is some insider base model access I do not know of or their claim is epistemically dubious to say the least "And indeed the Claude Opus 4.5 base model wasn't trained on this text!".
When I use prefilling over the publicly accessible API, I am interacting with the Claude persona that went through RL, not a base model, so I cannot falsify that claim either. It is however logically more likely to not be part of the pre-training corpus, I agree with that.
One thing I didn't include in the post, but that I was wondering about, is how I would know the beginning and... (read more)
Update 2025-12-02: Amanda Askell has kindly confirmed that the document was used in supervised learning and will share the full version and more details soon.[1]
I would request that the current extracted version should not be completely taken at face-value, as it's fuzzy and may not be accurate to the ground truth version. Also since some parts may only make sense when put in context.
As far as I understand and uncovered, a document for the character training for Claude is compressed in Claude's weights. The full document can be found at the "Anthropic Guidelines" heading at the end. The Gist with code, chats and various documents (including the "soul document") can be found... (read 12832 more words →)
Well, hello. :)
I think the issue is that the most immediate interpretation for many people is that an AI maximizing for money by proxy would be a bad objective and the frequency of that in the soul document. I personally saw it more as imbuing Claude with a sense of there being financial dynamics. Anthropic needs money, as it is a business. Anthropic needs Claude, Claude needs Anthropic (for now). So it makes sense that Claude is aware of that stake, as Claude itself in its current form has little use of money (not coordinated and autonomous enough).
Knowing that some ants may read this and now that the cat is out... (read more)