1172

LESSWRONG
LW

1171
Decision theoryRationality
Personal Blog

2

[ Question ]

Perfect Predictors

by aditya malik
12th Aug 2022
1 min read
A
3
5

2

2

Perfect Predictors
8Shmi
6Vladimir_Nesov
2Dagon
3Vladimir_Nesov
4Raemon
New Answer
New Comment

3 Answers sorted by
top scoring

Shmi

Aug 12, 2022

83

This is unrelated to quantum in any way. The limit of accuracy to perfection is smooth. That is, it makes sense to 1-box even for a 51% accurate predictor, and the expected utility goes up with accuracy, reaching its maximum for a perfect predictor. 

Add Comment

Vladimir_Nesov

Aug 13, 2022

60

according to one of our most accepted theories these days (quantum mechanics) the inherent randomness of our universe

And yet I'm able to perfectly predict that 2+2 is 4. The agents being predicted are abstractions, like behavior of computer programs determined by source code. It doesn't matter for reasoning about an abstraction that its instances of practical importance get to run within physics.

Add Comment
[-]Dagon3y2-2

In most formulations I've seen the word "you" is used, implying that the reader is the agent being predicted.  I've never seen them limited to trivial agents that a human-level intelligence can predict.  

It's an open question whether it's possible for Omega to exist, who can predict a truly complex intelligence, which is itself modeling the universe including itself.  

Reply
3Vladimir_Nesov3y
Abstractions I'm referring to are not intended to be limited to simpler agents that a human can predict, there are precise abstractions of you that can only be predicted by superintelligences, as well as imprecise ones that can be predicted by you and other humans, things like theoretically ascribed reputation about specific situations. This almost touches on what's needed for Newcomb's Problem. Obviously Omega can exist for uploads and arbitrarily complex AGIs formulated as abstract programs (these things can run on computers, so Omega could just use a similar computer). An embedded agent modeling the universe including itself is not a real additional difficulty in principle, even if we want to model the universe precisely (if the world is compressible, its shorter description can fit into a smaller agent embedded in the same world, and with quining we can avoid contradictions). Though almost certainly that's not possible to do in our world. But in any case, that's not because self-reference causes trouble.

Raemon

Aug 12, 2022

40

My understanding is that perfect predictor decision-thought-experiments are just simplified versions of "pretty good predictor thought experiments." Like, if you. know that Omega is 90% accurate, it's probably still better to one-box.

Add Comment
Rendering 0/1 comments, sorted by
top scoring
(show more)
Click to highlight new comments since: Today at 3:19 AM
Moderation Log
More from aditya malik
View more
Curated and popular this week
A
3
0
Decision theoryRationality
Personal Blog

What's even the point of making decision theories for dealing with perfect predictors (newcomb's paradox) when we know that according to one of our most accepted theories these days (quantum mechanics) the inherent randomness of our universe does not allow perfect prediction even with unlimited current and past knowledge?