2100

LESSWRONG
LW

2099
AnthropicsEvidential Decision Theory
Personal Blog

10

Anthropic uncertainty in the Evidential Blackmail problem

by Johannes Treutlein
14th May 2017
AI Alignment Forum
1 min read
1

10

Ω 4

This is a linkpost for https://casparoesterheld.com/2017/05/12/anthropic-uncertainty-in-the-counterfactual-blackmail/

10

Ω 4

Anthropic uncertainty in the Evidential Blackmail problem
0entirelyuseless
New Comment
1 comment, sorted by
top scoring
Click to highlight new comments since: Today at 3:46 AM
[-]entirelyuseless8y00

While I don't disagree with your argument, one general response to this sort of question is that blackmail is in essence a violent attack. So even if EDT actually did result in less utility given such blackmail, this would not show that EDT is a bad decision theory or even worse than any others. CDT will similarly give less utility in a world where violent attackers that hate casual decision theorists go about attacking specifically people who use CDT, and similarly with any other decision theory and its specific attackers.

Note also that people in the real world often do give in to blackmail, as in the recent ransomware example, and think themselves better off for having done so, compared to resisting the blackmail.

Reply
Moderation Log
More from Johannes Treutlein
View more
Curated and popular this week
1Comments
AnthropicsEvidential Decision Theory
Personal Blog