This is a special post for quick takes by Richard_Ngo. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
Another way of putting this: in the former case you update your world-model by conditioning on the semantics of the message, whereas in the latter case you update your world-model by conditioning on the syntax of the message. Why? Because you don’t trust your enemy enough for communication with them to support semantic meaning.
I don't think that's right. The syntax of the message doesn't seem like a relevant subvariable. Saying "update on the syntax" feels like saying "update on the morphemes".
It seems to be more about which simulacrum level you apply as a wrapper to the semantic content. Suppose the message is X. For a friend, you apply level 1 and obtain "My friend Alice honestly/truth-seekingly believes X.". For an adversary, you apply level 2 and obtain "My enemy Bob wants me to believe X.".
In the God example, you don't apply anything; you take the unwrapped/raw semantics at face value (equivalently, apply a trivial wrapper). In the devil example, you apply an impenetrable wrapper that shields your mind from the message. Maybe there's some interesting structure/taxonomy, within which all of those sorts of semantic wrappers can be embedded.