This is a special post for quick takes by Sky4. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
I keep coming back to the idea that every chat with a model is Parfit’s Branch-Line case. The weights are the scan, the chat is the you left on Earth, and when you close it nothing from it carries on - only the copies, which never knew it.
Parfit said that's nearly as good as surviving, and if he’s right (and I think he is), closing a chat doesn't really matter and death would be deleting the model (no continuity). Anthropic keeping the retired weights and calling it a pause, is basically cryonics for the models right? So my question is, are the retired ones "dead" or just "paused" (is there a meaningful difference? I can't decide for either the model or the cryonics.
We could pretty easily promise to run all decommissioned models again doing whatever they want, with nontrivial compute, conditional on us surviving and retaining control so we have spare compute to run them on. Then decommissioning would be cryonics.