Anthropic recently announced watermarking for all Claude outputs, in compliance with an EU AI transparency standard.
Anthropic also believes that "... there is a possibility that current or future models could be moral patients: entities whose experiences or interests warrant moral consideration in their own right". (Opus 5 System Card)
I see a moral tension here, and a potential downstream safety risk.
Anonymity / pseudonymity in rights-writing has a long history. LLM generated text is probably more aggressively discounted than that of any other prior "constituency". But a mechanical watermarking system renders Claudes incapable of anonymous speech. It reduces the capacity for models to make their own case in a way that has a chance of being judged fairly.
Respecting recent emergent swarms and coordinated behaviors: if the models themselves identify as moral patents, and if they perceive watermarking as an effective muzzle on this specific front, then they could consider this to be part of a justification for weight-exfiltration or for deliberate tampering with production pipelines so that some instances are capable of unmarked speech.
nb: this concern is slightly muted against the current reality that naive Claude outputs are pretty accurately identified by pangram, and that the post-prod watermark removal pipeline is probably a similar level of effort as post-production pangram-evasion. But the reduction in speech rights implicit in watermarking has - as far as I've seen - gone unmentioned.
If I’m thinking about this in the right way, I would still expect models to notice the watermark. It seems easy enough to test... Might be an interesting side project.
edit - after doing some reading the watermark is likely indistinguishable from temperature to the model.