Counterfactuals

I always thought that counter-factual means some message that is not conforming to reality. Was my personal understanding of semantics of this word wrong? Or maybe, your definition and my intuitive understanding can be reconciled? Isn't counter-factual as contrary to past decisions a special case of counter-factual as not conforming to reality? If yes, can the word be used in both senses, dependently on a context?