LESSWRONG
LW

CausalityProbability & Statistics
Personal Blog

2

[ Question ]

Causal without correlation, how?

by MoritzG
30th Aug 2021
1 min read
A
4
7

2

CausalityProbability & Statistics
Personal Blog

2

Causal without correlation, how?
14Richard_Kennaway
5Nicholas Garcia
1MoritzG
1Adam Bull
1MoritzG
2tailcalled
0TAG
New Answer
New Comment

4 Answers sorted by
top scoring

Richard_Kennaway

Aug 30, 2021*

140

The very purpose of a control system is to pump information out of the relationship between the variable under control and the influences acting on it. This results in zero correlation between variables that are directly causally connected, and large (above 0.99) correlations between variables that are causally connected only via those zero-correlation links. I have a paper on the subject.

This remains true even if correlation (generally meant in the linear product-moment sense) is replaced by the more general concept of statistical dependence (non-zero mutual information).

The graphs describing such systems contain cycles, so the apparatus of causal analysis based on DAGs does not apply.

Add Comment

Nicholas Garcia

Aug 30, 2021

50

Correlation is linear. Many causal functions can be non-linear. 

Think of medicine. X is the dosage, Y is the improvement of health. If the dose is too low, you will get no response. If the does is within a good range, health improves. If the does is too high, you will begin to get even sicker. If data was gathered all along this inverted parabola, the correlation might be zero. But there is still a causal relationship between health and dosage.

Thus you can have causation without correlation. 

You can probably think of many such functions with diminishing or negative returns as the dosage increases, e.g. years of education vs. lifetime earnings.

Whether you see a positive, negative, or null correlation can depend on where you sample from the response function. In the "real world" data might be bunched up around certain regions of the response function. Thus for the "average person/instance" you can determine if there is a correlation or not, and then say this is basically the causal effect (for the average person/instance). 

But if you want accuracy and precision over concision you will use a more complex model. 

Concise models are better memes than complex models, however, and so we are flooded with linear models or binary models. 

Add Comment
[-]MoritzG4y10

"parabola" That would be a third category then: No correlation observed because the aggregated observation cancels out the effect working both ways.

Reply
1Adam Bull4y
No, it's just causation without correlation; correlation is defined to be the aggregate effect.
1MoritzG4y
yes, but I am posing the WHY question. In this case it is just an averaging effect not a feedback controller.

tailcalled

Aug 30, 2021

20

Why, when is the latter? Is there one reason or more and if so how can they be structured and by what? If one of the observables does not change, because there is a controlling observer (prediction+feedback), there is no way to establish correlation.

Typically you get causality without correlation when there is some controller that manipulates the causal variable in order to control the variable that it has an effect on.

I am displeased by bayesian probability combined with graphs (DAG), it so obviously lacks the nonlinear activation function.

DAGs only encode the structural relations, they make no inherent claims that things have to be linear. A common model is to allow each node to be an arbitrary function of its parents. The reason this isn't used much in practice, even though this is what the math is based on, is that it is usually very hard to fit.

Add Comment

TAG

Aug 30, 2021

00

Correlation is a statistical pattern, so the obvious example of causation without correlation would be some kind of one-shot cause.

Add Comment
Rendering 0/1 comments, sorted by
top scoring
(show more)
Click to highlight new comments since: Today at 4:41 PM
Moderation Log
More from MoritzG
View more
Curated and popular this week
A
4
0

There is correlation without causation, but there is also causation without correlation. Why, when is the latter? Is there one reason or more and if so how can they be structured and by what? If one of the observables does not change, because there is a controlling observer (prediction+feedback), there is no way to establish correlation. I am displeased by bayesian probability combined with graphs (DAG), it so obviously lacks the nonlinear activation function. If two random binary streams feed into a XOR gate, the output is uncorrelated with anyone of the streams even though there is plenty of change to observe and perfect causality.