LESSWRONG
LW

Heighn
285171937
Message
Dialogue
Subscribe

Sequences

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
Calculus in Game and Decision Theory
Intuitive Introduction to Functional Decision Theory
Found Paper: "FDT in an evolutionary environment"
Heighn2y40

"In your problem description you said you receive the letter"

True, but the problem description also specifies subjunctive dependence between the agent and the predictor. When the predictor made her prediction the letter isn't yet sent. So the agent's decision influences whether or not she gets the letter.

"This intuition is actually false for perfect predictors."

I agree (and have written extensively on the subject). But it's the prediction the agent influences, not the presence of the termite infestation.

Reply
Found Paper: "FDT in an evolutionary environment"
Heighn2y10

Given that you receive the letter, paying is indeed evidence for not having termites and winning $999,000. EDT is elegant, but still can't be correct in my view. I wish it were, and have attempted to "fix" it.

My take is this. Either you have the termite infestation, or you don't.

Say you do. Then

  • being a "payer" means you never receive the letter, as both conditions are false. As you don't receive the letter, you don't actually pay, and lose the $1,000,000 in damages.
  • being a "non-payer" means you get the letter, and you don't pay. You lose $1,000,000.

Say you don't. Then

  • payer: you get the letter, pay $1,000. You lose $1,000.
  • non-payer: you don't get the letter, and don't pay $1,000. You lose nothing.

Being a payer has the same result when you do have the termites, but is worse when you don't. So overall, it's worse. Being a payer or a non-payer only influences whether or not you get the letter, and this view is more coherent with the intuition that you can't possibly influence whether or not you have a termite infestation.

Reply
Found Paper: "FDT in an evolutionary environment"
Heighn2y11-2

XOR Blackmail is (in my view) perhaps the clearest counterexample to EDT:

An agent has been alerted to a rumor that her house has a terrible termite infestation that would cost her $1,000,000 in damages. She doesn’t know whether this rumor is true. A greedy predictor with a strong reputation for honesty learns whether or not it’s true, and drafts a letter:

 I know whether or not you have termites, and I have sent you this letter iff exactly one of the following is true: (i) the rumor is false, and you are going to pay me $1,000 upon receiving this letter; or (ii) the rumor is true, and you will not pay me upon receiving this letter.

The predictor then predicts what the agent would do upon receiving the letter, and sends the agent the letter iff exactly one of (i) or (ii) is true. Thus, the claim made by the letter is true. Assume the agent receives the letter. Should she pay up?

(Styling mine, not original.) EDT pays the $1,000 for nothing: it has absolutely no influence on whether or not the agent's house is infested with termites.

Reply
Job listing: Communications Generalist / Project Manager
Heighn2y10

Alright, thanks for your answer!

Reply
Job listing: Communications Generalist / Project Manager
Heighn2y10

Is it necessary to be able to work during all MIRI office hours, or is it enough if my hours are partially compatible? My time difference with MIRI is 9 hours, but I could work in the evening (my time) every now and then.

Reply
Contra Heighn Contra Me Contra Functional Decision Theory
Heighn2y10

Your original description doesn't specify subjunctive dependence, which is a critical component of the problem.

Reply
Contra Heighn Contra Me Contra Functional Decision Theory
Heighn2y10

Heighn’s response to this argument is that this is a perfectly fine prescription.

Note that omnizoid hasn't checked with me whether this is my response, and if he had, I would have asked him to specify the problem more. In my response article, I attempt to specify the problem more, and with that particular specification, I do indeed endorse FDT's decision.

Reply
Load More
4The omnizoid - Heighn FDT Debate #5
2y
0
6The omnizoid - Heighn FDT Debate #3: Contra omnizoid contra me contra omnizoid contra FDT
2y
0
24The omnizoid - Heighn FDT Debate #1: Why FDT Isn't Crazy
2y
4
3Is AI Alignment Impossible?
Q
3y
Q
3
3The Calculus of Newcomb's Problem
3y
5
5The Calculus of Nash Equilibria
3y
0
3A Very Mathematical Explanation of Derivatives
3y
0
6No, EDT Did Not Get It Right All Along: Why the Coin Flip Creation Problem Is Irrelevant
3y
6
19An Intuitive Introduction to Functional Decision Theory
3y
3
5An Intuitive Introduction to Evidential Decision Theory
3y
0
Load More
Causal Decision Theory
2y
(+3/-5)
Psychological Twin Prisoner's Dilemma
3y
(+2448)
Smoking Lesion
3y
(+387/-10)
Parfit's Hitchhiker
3y
(+792/-2)
Newcomb's Problem
3y
(+816)
Newcomb's Problem
3y
(+401)
Functional Decision Theory
3y
(+675)