Years ago I got stuck on an extra-linguistic version of this claim that I encountered in Kathryn Schulz's entertaining and informative book, "Being Wrong: Adventures in the Margin of Error." Schulz's assertion, which I would not then have thought to distinguish from Wittgenstein's, was that "there is no experience of being wrong," which she elaborated to suggest a kind of paradoxical epistemic bind, where the experience of error can only be understood retrospectively in light of subsequent correction, never subjectively or directly. Ironically, the main reason I was disposed to question Schulz's claim was that her book elsewhere exhibited a number of remarkable optical illusions, and it struck me that my active belief that, say, a checkerboard square was darker than another under a contrived shading arrangement, easily persisted alongside the certain revealed knowledge that this belief was indeed false. Your examples provide a good way of understanding border situations that complicate updating, but the experience of "believing" a devised illusion even upon and after being enlightened to the trick is relatively common and clear-cut. It certainly feels like a directly accessible first person experience of "believing falsely," but -- half-joking, now-- I could be wrong about that.
Nice eye-grabbing headline.
There is a Wittgenstein quote I've been thinking about ever since going through AI to Zombies around a decade ago:
If there were a verb meaning 'to believe falsely', it would not have any significant first person, present indicative.
As a statement of boolean logic, that's fine, it's p ∧ ¬p being false — claiming that “I falsely believe p” cannot be asserted, because the moment you avow that a belief is false, you withdraw your belief — and given Wittgenstein was famously a logician this is natural…
… but that's not how humans actually do their thinking. There's a lot of ways we just plain don't work like that.
We don't actually fully disavow beliefs when we first recognise them false, and we (fail to) do so in more than just one way:
p ∧ ¬p type issues within our minds whenever any of us demonstrates hypocrisy, and sometimes people notice they're hypocritical without needing someone else to point it out, so anyone who says "huh, I'm being a hypocrite here…" is, in that way, using "hypocrite" as a first person present indicative of 'to believe falsely'. They may or may not withdraw from either belief, we can be all over the place on this, those who do not withdraw from at least one of those beliefs are an example of non-Wittgenstein behaviour.So, linguistically, we do sometimes say things equivalent to "I currently falsely believe this specific thing".
I have of course asked everyone's favourite Shoggoth to critique this and tell me everything wrong with this post before posting it; the AI is now trying to simultaneously give me two mutually incompatible directions — telling me Wittgenstein was actually talking about language instead of logic, and also trying to say that I'm focusing on language when I should be looking at logic — I clearly can't get more useful feedback from it. I will be amused if there's a similar split in the comments.