I suspect that achieving a clear mental picture of the sheer depth and breadth of the mind projection fallacy is a powerful mental tool. It's hard for me to state this in clearer terms, though, because I don't have a wide collection of good examples of the mind projection fallacy.
In a discussion yesterday, we all had trouble finding actual example of the mind projection fallacy. Overall, we had essentially two examples:
- Taste. People frequently confuse "I like this" and "this is good." (This really subsumes the attractiveness example.)
- Probability. This seems like a pretty good just-so-story for where frequentist probability comes from, as opposed to Bayesian probability.
Searching for "mind projection fallacy" on Less Wrong, I also see:
- Thinking that purpose is an inherent property of something, instead of it having been placed there by someone for some reason. (here)
- Mulling or arguing over definitions to solve object-level problems. (actually, most the ways words can be wrong sequence)
The hope function is an interesting example where it's very clear that many are not solving the problems correctly because they think the probabilities can't change.