LESSWRONG
LW

Wikitags

Pre-Commitment

Edited by Chris_Leong, et al. last updated 3rd Feb 2021

Many Decision Theory problems involve pre-commitment or deciding in advance how you are going to act. This is crucial for game-theory, where an agent that has credibly pre-committed can force other actors to act differently than they would other otherwise acted. It is also important for problems with predictors like Newcomb's Problem where an agent which pre-commits one-boxing guarantees (or almost guarantees) themselves the million. Lastly, it can be important for agents who are aware that they are likely to make a bad decision in the moment.

Interactions with Predictors:

There has been significant disagreement about what pre-commitment means for decision theory problems where you are being predicted by a sufficiently high quality predictor. In Newcomb's Problem, two-boxers typically believe that while you could have obtained the million by pre-committing before Omega made their prediction, afterwards is too late. Even though two-boxing only gives you $1000, they claim that the million was never in the box so you never could have gained it. In contrast, one-boxers tend to believe that it is a mistake to think that the million isn't accessible to you - see Eliezer arguing that you can just do it - in other words that if you one-box you will always find that the million always was accessible to you.

If you have to pre-commit in advance the question naturally arises - what counts as pre-commitment? Is it sufficient to just decide in advance what you are going to do as long as you are committed to following through or do you have to commit more substantially by setting up a penalty sufficient to dissuade yourself from changing your mind? Having raised this question, the answer seems clear - a pre-commitment is valid in terms of obtaining you the million so long as it is legible to Omega and it is valid in terms of binding you to the action so long as you actually follow through.

One distinction that it might be useful to make is between formal and effective pre-commitment. Formal pre-commitment is when you take specific legible actions to commit yourself like talking about it in public, handing over money as a deposit or rewriting your source-code. On the other hand, effective pre-commitment is the notion that in a deterministic universe whatever action you take you are pre-committed to and that an agent that knew the environment and your state in sufficient detail would be able to predict what action you would take. In this view, the only difference is that formal pre-commitment is easier to predict.

One issue that arises with predictors is that some scenarios may be conditionally inconsistent (or just plain inconsistent when we're dealing with logical uncertainty and oracles). Oddly enough, it seems as though it might make sense to allow pre-commitments in relation to these scenarios, although this involves pre-committing to taking an action when receiving input representing such a potentially inconsistent scenario rather than pre-committing to take an action in a particular scenario itself.

Game Theory:

In game theory, commitment is often considered purely from the perspective of incentives. From this view, you are considered to have pre-committed youself to an action if any benefit you would gain from it is outweighed by the penalty you would pay.

Psychology:

Pre-commitment can also be important from a psychological perspective. Suppose you have an assignment to work on. You know that you need to work on it tomorrow, but you also know that you won't feel like it on the day. By deciding in advance to work on the assignment tomorrow you are providing yourself an additional reason (keeping your commitments to yourself) to work on it.

Related Pages: Commitment Mechanisms, Assurance contracts

Subscribe
1
Subscribe
1
Discussion0
Discussion0
Posts tagged Pre-Commitment
165The Commitment Races problem
Ω
Daniel Kokotajlo
6y
Ω
56
157Newcomb's Problem and Regret of Rationality
Eliezer Yudkowsky
18y
620
85My Marriage Vows
Vanessa Kosoy
4y
53
46Thread for making 2019 Review accountability commitments
Bird Concept
5y
6
33Principals, agents, negotiation, and precommitments
gwillen
13y
27
22Notes on Shame
David Gross
4y
6
16Reference Post: Formal vs. Effective Pre-Commitment
Chris_Leong
7y
44
16The AI Shutdown Problem Solution through Commitment to Archiving and Periodic Restoration
avturchin
2y
7
10The Psychology Of Resolute Agents
Chris_Leong
7y
20
10Notes on Resolve
David Gross
3y
3
10Take Precautionary Measures Against Superhuman AI Persuasion
Yitz
2mo
9
37Boomerang - protocol to dissolve some commitment races
Ω
Filip Sondej
2y
Ω
10
28Intelligence in Commitment Races
David Udell
3y
8
24Dath Ilani Rule of Law
David Udell
3y
25
19Abadarian Trades
David Udell
3y
22
Load More (15/16)
Add Posts