## LESSWRONGLW

Upon further thought: there is no objective answer to "what you would do if 1 was even" or "what you would do if the 10001th digit of pi was even" (given your source code). The answer that Omega computes has to be more or less arbitrary, and depends on details of Omega's source code. If you knew that Omega was going to logical-counterfactually mug you, and you knew Omega's source code, and the reward is high enough, then you'd do whatever modifications are necessary on your own source code so that Omega would compute the "right&quo... (read more)

[anonymous]10y0

The 10001th digit of pi is 5.

1Technologos11yMy understanding of the point of the post was that while a coin may physically land differently and thus instantiate the counterfactual, it is merely my current lack of knowledge (the "logical uncertainty" in the post title) that allows me to simulate a kind of pseudo-counterfactual in this case. Since I do not know the millionth digit of pi, I can still speak meaningfully of the cases where it is and isn't odd.

# 10

Followup to: Counterfactual Mugging.

Let's see what happens with Counterfactual Mugging, if we replace the uncertainty about an external fact of how a coin lands, with logical uncertainty, for example about what is the n-th place in the decimal expansion of pi.

The original thought experiment is as follows:

Omega appears and says that it has just tossed a fair coin, and given that the coin came up tails, it decided to ask you to give it \$100. Whatever you do in this situation, nothing else will happen differently in reality as a result. Naturally you don't want to give up your \$100. But Omega also tells you that if the coin came up heads instead of tails, it'd give you \$10000, but only if you'd agree to give it \$100 if the coin came up tails.

Let's change "coin came up tails" to "10000-th digit of pi is even", and correspondingly for heads. This gives Logical Counterfactual Mugging:

Omega appears and says that it has just found out what that 10000th decimal digit of pi is 8, and given that it is even, it decided to ask you to give it \$100. Whatever you do in this situation, nothing else will happen differently in reality as a result. Naturally you don't want to give up your \$100. But Omega also tells you that if the 10000th digit of pi turned out to be odd instead, it'd give you \$10000, but only if you'd agree to give it \$100 given that the 10000th digit is even.

This form of Counterfactual Mugging may be instructive, as it slaughters the following false intuition, or equivalently conceptualization of "could": "the coin could land either way, but a logical truth couldn't be either way".

For the following, let's shift the perspective to Omega, and consider the problem about 10001th digit, which is 5 (odd). It's easy to imagine that given that the 10001th digit of pi is in fact 5, and you decided to only give away the \$100 if the digit is odd, then Omega's prediction of your actions will still be that you'd give away \$100 (because the digit is in fact odd). Direct prediction of your actions can't include the part where you observe that the digit is even, because the digit is odd.

But Omega doesn't compute what you'll do in reality, it computes what you would do if the 10001th digit of pi was even (which it isn't). If you decline to give away the \$100 if the digit is even, Omega's simulation of counterfactual where the digit is even will say that you wouldn't oblige, and so you won't get the \$10000 in reality, where the digit is odd.

Imagine it constructively this way: you have the code of a procedure, Pi(n), that computes the n-th digit of pi once it's run. If your strategy is

if(Is_Odd(Pi(n))) then Give("\$100");

then, given that n==10001, Pi(10001)==5, and Is_Odd(5)==true, the program outputs "\$100". But Omega tests what's the output of the code on which it performed a surgery, replacing Is_Odd(Pi(n)) by false instead of true to which it normally evaluates. Thus it'll be testing the code

if(false) then Give("\$100");

This counterfactual case doesn't give away \$100, and so Omega decides that you won't get the \$10000.

For the original problem, when you consider what would happen if the coin fell differently, you are basically performing the same surgery, replacing the knowledge about the state of the coin in the state of mind. If you use the (wrong) strategy

and the coin comes up "heads", so that Omega is deciding whether to give you \$10000, then Coin=="heads", but Omega is evaluating the modified algorithm where Coin is replaced by "tails":