Collider bias as a cognitive blindspot?
6DirectedEvolution
5Mark Xu
5Daniel V
2jimrandomh
13Kaj_Sotala
2TurnTrout
2Kaj_Sotala
8Mo Putera
4nealeratzlaff
6TurnTrout
1hamnox
1TheMajor
New Answer
New Comment
4 Answers sorted by
60
One idea: make a list of situations in which you trade off against 2+ qualities, notice if you've formed a collider bias, and explain to yourself what's going on. I'll try two:
- Food can be tasty and healthy. Why is food that's tasty so often unhealthy, and vice versa? Insofar as the collider effect is the explanation, then it's because I have a tastiness + healthiness threshold. Foods don't need to be as tasty if they're healthy enough, and they don't need to be as healthy if they're tasty enough. Also, there's some set of foods that simply aren't tasty + healthy enough to eat, like American cheese, out-of-season tomatoes, and Chips Ahoy.
- Vacations can be relaxing and interesting. Why are interesting vacations so often stressful, and relaxing vacations so often boring? The collider effect strikes again! I don't want to go on vacations that are neither relaxing nor interesting, such as a trip to Cancun or Ibiza.
Food can have more virtues. It can be cheap, easy to prepare, and different from what I've eaten recently. Weirdly enough, this means that the more potential virtues something has, the more likely you're going to consume something that entirely lacks a certain virtue. If I go to a single-price restaurant, where price, ease of preparation, and variety are held constant, tastiness and healthiness are the only ways I can make a selection and will be more important. By contrast, if I'm at home, how tasty and healthy the meal is can more often take a back seat to these other factors.
However, I'd also note that the reason we may not think too often about "collider bias" may be that most things are correlated. Price correlates with all the other virtues in just about everything you can consume. Excitement and stress seem likely to be correlated.
50
If X->Z<-Y, then X and Y are independent unless you're conditioning on Z. A relevant TAP might thus be:
- Trigger: I notice that X and Y seem statistically dependent
- Action: Ask yourself "what am I conditioning on?". Follow up with "Are any of these factors causally downstream of both X and Y?" Alternatively, you could list salient things causally downstream of either X or Y and check the others.
This TAP unfortunately abstract because "things I'm currently conditioning on" isn't an easy thing to list, but it might help.
50
One way to "rewire" your brain is to wire in a quick check- how does selection/stratification/conditioning matter here?
But perhaps most important is to think causally. Sure, you can open up associations, but, theoretically, do they make sense? Why would obesity, conditional on having cardiovascular disease, reduce mortality? Addressing why rather than leaping to a bivariate causal conclusion is important. This is why scientists look for mechanisms and mechanism-implicating boundary conditions.
20
I call this subcategory of Berkson's paradox issues the conservation of virtue effect: when there is a filter somewhere for something like a sum of good qualities, then all good qualities are negatively correlated. Another major subcategory is the "if you observe something which has multiple possible explanations, those explanations are negatively correlated" effect. I don't think these two subtypes cover all the instances, but they do seem to cover a large fraction, and they aren't too difficult to internalize.
I feel confused; you quote Pearl talking about how hard this is for people to accept etc., but it feels to me like people generally get this intuitively in the kinds of contexts where it naturally pops up? There are some instances like Monty Hall where people do get really confused, but Monty Hall is notable for being a really weird and unnatural setup. Whereas if you have a sore throat and then find out that you have the flu, then it seems to me that most people will naturally think "ah I don't have mono then", wouldn't they? (And given that it's Alex who's doing the selecting of who qualifies, I would expect them to be quite aware of the fact that they are sometimes making the choice to date a rude man because man that guy is hot, or vice versa.)
It does seem to me that there's sometimes a bias in people conditioning on Z too much; e.g. if we use this example
Judea Pearl gives an example of reasoning about a burglar alarm: if your neighbor calls you at your dayjob to tell you that your burglar alarm went off, it could be because of a burglary, or it could have been a false-positive due to a small earthquake. There could have been both an earthquake and a burglary, but if you get news of an earthquake, you'll stop worrying so much that your stuff got stolen, because the earthquake alone was sufficient to explain the alarm.
then local burglars can exploit that by hitting homes right at the time of an earthquake, because people will assume the alarms to be caused by the earthquake rather than a genuine burglary.
Prejudice may be another example of conditioning on Z too much; if you are predisposed to believe that group membership -> Z, then you may jump to the conclusion that Z is caused by group membership, while neglecting other causes.
But this seems like the opposite of the bias you are talking about?
I agree that people can reason about the mono case. I'm not convinced this isn't hard in general. Most examples of collider bias struck me as unintuitive, and it seems very unlikely that I'm worse than average at causal reasoning.
(And given that it's Alex who's doing the selecting of who qualifies, I would expect them to be quite aware of the fact that they are sometimes making the choice to date a rude man because man that guy is hot, or vice versa.)
Noticing that the guy is hot is way different from taking the further step to explain the correlation in her dating pool. If this is generally correctly reasoned out, then why haven't I ever heard someone answer the complaints of "women like bad boys" by (informally) explaining collider bias?
Most examples of collider bias struck me as unintuitive, and it seems very unlikely that I'm worse than average at causal reasoning.
Is that because they are intrinsically unintuitive, or because they are expressed in an unfamiliar way? I would guess that if one starts by explaining the mono case, then points out how it is analogous to the formal structure (the way Zack did and your quoted Wikipedia example did), then it would be relatively easily for people to get. Whereas if there's an explanation that e.g. starts off from a very mathematical and formal presentation, then it's harder to connect with what you already know intuitively.
then why haven't I ever heard someone answer the complaints of "women like bad boys" by (informally) explaining collider bias?
Is that an example of collider bias? If it were, then one would expect to also hear similar complaints about women's (or for that matter men's) preference for many other traits that are perceived negatively, e.g. "women like guys without money" or "men like unattractive women". The fact that it's "bad boys" that gets singled out in particular suggests that there is actually something special about that trait, and the standard explanations (e.g. that confidence is attractive and that badness correlates with confidence) seem reasonable to me.
Perhaps related is this classic post by Thrasymachus: https://www.lesswrong.com/posts/dC7mP5nSwvpL65Qu5/why-the-tails-come-apart. Scott Alexander uses that post as a jumping-off point to discuss a variety of topics, from ostensibly conflicting results in happiness research to the problem of figuring out a morality that can survive transhuman scenarios: https://www.lesswrong.com/posts/asmZvCPHcB4SkSCMW/the-tails-coming-apart-as-metaphor-for-life. (Or maybe I'm confused and this isn't really related to what you're talking about?)
The difficulty of correctly reasoning with probabilities reminds of something Geoff Hinton said about working in high dimensional space (paraphrasing): "when we try to imagine high dimensions, we all just imagine a 3D surface and say 'N dimensions' really loud in our heads". I have a habit of trying to use probabilities whenever I'm trying to reason about something, but I'm becoming increasingly sure that my Bayes net (or causal graph) is badly wired with wrong probabilities everywhere.
I see quite a few papers on PubMed discussing collider bias with regard to obesity-associated health risks. The effect is probably in full swing with covid research, unfortunately.
I see quite a few papers on PubMed discussing collider bias with regard to obesity-associated health risks. The effect is probably in full swing with covid research, unfortunately.
"Collider bias" comes at the phenomena from a slightly different angle than The Tails Come Apart or or as one of Scott's Goodhart variants. I think I will start using "collider" as my mental handle for situations of noncausal anticorrelation.
There has been previous discussion about this on LessWrong. In particular, this is precisely the focus of Why the tails come apart, if I'm not mistaken.
If I remember correctly that very post caused a brief investigation into an alleged negative correlation between chess ability and IQ, conditioning on very high chess ability (top 50 or something). Unfortunately I don't remember the conclusion.
Edit: and now I see Mo Nastri already pointed this out. Oops.