1778

LESSWRONG
LW

1777
Personal Blog

2

The Extinction Dilemma

by DragonGod
16th Dec 2017
1 min read
1

2

Personal Blog

2

The Extinction Dilemma
1DragonGod
New Comment
1 comment, sorted by
top scoring
Click to highlight new comments since: Today at 2:48 PM
[-]DragonGod8y10

There is no finite number of lives that reach utopia, for which I would accept Omega's bet at a 90% chance of extinction.

This does not mean I would accept Omega's bet at 89% chance of extinction (I wouldn't), but 90% is far above my ceiling, and I'm very sure of it.

Reply
Moderation Log
More from DragonGod
View more
Curated and popular this week
1Comments

Inspiration came from Against the Linear Utility Hypothesis and the Leverage Penalty

Place a value on the utility of a utopia with 1 human, let's call this X.
Place a value on the negutility of all of humanity going extinct. Let's call this Z.
Decide if your utility function is linear in number of lives saved.
Place a value on the utility of say 10100 humans achieving a perfect utopia. Call this K.


Omega offers you a bet. This bet has a 50% chance of humanity reaching a Kardashev type V civilisation (colonising the multiverse) and a perfect utopia, and a 50% chance of human extinction this instant.
Omega is an omnipotent entity that always tells the truth, you know (and believe this), etc.
Do you accept the bet?

What about 1:3 odds?
What about 3:1 odds?
What is the highest probability of extinction at which you would accept Omega's offer?

What does this say about your utility function?