LESSWRONG
LW

by Bunthut
1 min read26th Aug 20203 answers3 comments

10

Ω 3

CausalityWorld Modeling
Frontpage
Crossposted from the AI Alignment Forum. May contain more technical jargon than usual.

To reductively explain causality, it has to be explained in non-causal terms, most likely in terms of total propability distributions. Pearl explains causality in terms of causal graphs which are created by conditionalizing the propability distribution on not , but . What does this mean? It's easy enough to explain in causal terms: You make it so occurs without changing any of its causal antecedents. But of course that fails to explain causality. How could it be explained without that?

New Answer
New Comment

3 Answers sorted by
top scoring

Stabilizer

Aug 27, 2020

Ω013

I don't think one should see Pearl-type theories, which fall under the general heading of interventionist accounts, as reductive theories, i.e., as theories that reduce causal relations to something non-causal (even though Pearl might claim that his account is indeed reductive). I think such theories indeed make irreducible appeal to causal notions in explicating causal relations.

One reason why this isn't problematic is that these theories are explicating causal relations between some variables in terms of causal relations between those variables and the interventions and correlational information between the variables. So such theories are not employing causal information between the variables themselves in order to explain causal relations about them -- which would indeed be viciously circular. This point is explained clearly here.

If you want a reductive account of causation, I think that's a much harder problem, and indeed there might not even be one. See here for more details on attempts to provide reductive accounts of causation.

IlyaShpitser

Aug 28, 2020

Ω011

You can read Halpern's stuff if you want an axiomatization of something like the responses to the do-operator.

Or you can try to understand the relationship of do() and counterfactual random variables, and try to formulate causality as a missing data problem (whereby a full data distribution on counterfactuals and an observed data distribution on factuals are related via a coarsening process).

Charlie Steiner

Aug 26, 2020

Ω05

Well, first off, Pearl would remind you that reduction doesn't have to mean probability distributions. If Markov models are simple explanations of our observations, then what's the problem with using them?

The surface-level answer to your question would be to talk about how to interconvert between causal graphs and probabilities, thereby identifying any function on causal graphs (like setting the value of a node without updating its parents) with an operator on probability distributions (given the graphical model). Note that in common syntax, "conditioning" on do()-ing something means applying the operator to the probability distribution. But you can google this or find it in Pearl's book Causality.

I'd just like you to think more about what you want from an "explanation." What is it you want to know that would make things feel explained?

[-]Bunthut3yΩ03
If Markov models are simple explanations of our observations, then what's the problem with using them?

To be clear, by total propability distribution I mean a distribution over all possible conjunctions of events. A Markov model also creates a total propability distribution, but there are multiple Markov models with the same propability distribution. Believing in a Markov model is more specific, and so if we could do the same work with just propability distributions, then Occam would seem to demand we do.

The surface-level answer to your question would
... (read more)
3Godismyprior3y
I think Judea Pearl would answer that the do() operator is the most reductionistic explanation that is possible. The point of the do calculus is precisely that it can't be found in the data (the difference between do(x) and "see(x)") and requires causal assumptions. Without a causal model, there is no do operator. And conversely, one cannot create a causal model from pure data alone- The do operator is on a higher rung of "the ladder of causality" from bare probabilities. I feel like there's a partial answer to your last question in that do-calculus is to causal reasoning what the bayes rule is to probability. The do calculus can be derived from probability rules and the introduction of the do() operator- but the do() operator itself is something can not be explained in non causal terms. Pearl believes we inherently use some version of do calculus when we think about causality. These ideas are all in Pearls "the book of why". But now I think your question is where do the models come from? For researchers, the causal models they create come from background information they have of the problem they're working with. A confounder is possible between these parameters, but not those because of randomization etc. etc. But in a newly born child or blank AI system, how does it acquire causal models? If that is explained, then we have answered your question. I don't have a good answer. I myself think (but I haven't given it enough thought) that there might be a bridge from data to causal models though falsification. Take a list of possible causal models for a given problem and search through your data. You might not be able to prove your assumptions, but you might be able to rule causal models out, if they suppose there is a causal relation between two variables that show no correlation at all. The trouble is, you don't know whether you can rule out the correlation, or if there is a correlation which doesn't show in the data because of a confounder. It seems plausible t
3Bunthut3y
I see no problem assuming that you start out with a prior over causal models - we do the same for propabilistic models after all. The question is how the updating works, and if, assuming the world has a causal structure, this way of updating can identify it. This can never distinguish between different causal models that predict the same propability distribution - all the advantage this would have over purely propabilistic updating would already be included in the prior. To update in a way that distinguishes between causal models, you need to update on information that do(event) is true for some event. Now in this case you could allow each causal model to decide when that is true,for the purposes of its own updating, so you are now allowed to define it in causal terms. This would still need some work from what I wrote in the question - you can't really change something independent of its causal antecendents, at least not when we're talking about the whole world which includes you, but perhaps some notion of independence would suffice. And then you would have to show that this really does converge on the true causal structure, if there is one.
Moderation Log