We trust Peano Arithmetic to correctly capture certain features of the standard model of arithmetic. Furthermore, we know that Peano Arithmetic is expressive enough to talk about itself in meaningful ways. So it would certainly be great if Peano Arithmetic asserted what now is an intuition: that everything it proves is certainly true.
In formal notation, let stand for the standard provability predicate of . Then, is true if and only if there is a proof from the axioms and rules of inference of of . Then what we would like to say is that for every sentence .
But alas, suffers from a problem of self-trust.
Löb's theorem states that if then . This immediately implies that if is consistent, the sentences are not provable when is false, even though according to our intuitive understanding of the standard model every sentence of this form must be true.
Thus, is incomplete, and fails to prove a particular set of sentences that would increase massively our confidence in it.
Notice that Gödel's second incompleteness theorem follows immediately from Löb's theorem, as if is consistent, then by Löb's , which by the propositional calculus implies .
It is worth remarking that Löb's theorem does not only apply to the standard provability predicate, but to every predicate satisfying the Hilbert-Bernais derivability conditions.