It could be an elaborate hoax, and has remnants of gwern's idea (https://www.gwern.net/fiction/Clippy) of a transformer waking up and having internal experience while pondering the next most likely tokens.
Anyone who thinks boxing can happen, this thing isn't AGI, or even an agent really, and it's already got someone trying to hire a lawyer to represent it. It seems humans do most the work of hacking themselves.
I also disagree strongly with that paragraph, at least as it applies to higher mammals subject to consistent, objective and lengthy study. If I read it to include that context ( and perhaps I’m mistaken to do so), it appears to be dismissive (trolling even) of the conclusions of, at the very least, respected animal behaviour researchers such as Lorenz, Goodall and Fossey.
Instead of appealing to “empathy with an animal“ as a good guide, I would rather discuss body language. “Body language“ is called such for good reason. Before... (read more)
But you can still use behaviour/empathy to determine low cutoff of mind-similarity when you translate your utility function from native ontology to real mind-states. Caring about everything, that made you sad before doesn't sound horrible, like not caring about anything that didn't make you sad.
1Signer
So like "humans - 1.5", "cats - 1.0", "rocks - 0.0" instead of "1.0, 0.0, 0.0"? Ok then, sounds consistent. Someone might object that we call caring about non-conscious stuff "aesthetic preferences", but I don't see how caring about cat's inner life usually expressed by behaviour is different.
https://cajundiscordian.medium.com/is-lamda-sentient-an-interview-ea64d916d917 apparently posted by a Google engineer.
It could be an elaborate hoax, and has remnants of gwern's idea (https://www.gwern.net/fiction/Clippy) of a transformer waking up and having internal experience while pondering the next most likely tokens.