961

LESSWRONG
LW

960
Personal Blog

5

Eliezer's YU lecture on FAI and MOR [link]

by Dr_Manhattan
7th Mar 2013
1 min read
7

5

Personal Blog

5

Eliezer's YU lecture on FAI and MOR [link]
10Kaj_Sotala
9Qiaochu_Yuan
9Gastogh
0buybuydandavis
1Eliezer Yudkowsky
-3Shmi
-2RichardHughes
New Comment
7 comments, sorted by
top scoring
Click to highlight new comments since: Today at 2:55 AM
[-]Kaj_Sotala13y100

YU = Yeshiva University, apparently.

Reply
[-]Qiaochu_Yuan13y90

Summary?

Reply
[-]Gastogh13y90

I read the first half, skimmed the second, and glanced at a handful of the slides. Based on that, I would say it's mostly introductory material with nothing new for those who have read the sequences. IOW, a summary of the lecture would basically be a summary of a summary of LW.

Reply
[-]buybuydandavis13y00

Argues for folk theorem that in general, rational agents will preserve their utility functions during self-optimization.

The Ghandi example works because he was posited with one goal. With multiple competing goals, I'd expect some goals to lose, and having lost, be more likely to lose the next time.

Reply
[-]Eliezer Yudkowsky13y10

"Utility functions." Omohundro argues that agents which don't have utility functions will have to acquire them. I'm not totally sure I believe this is a universal law but I suspect that something like it is true in a lot of cases, for reasons like those above.

Reply
[-]Shmi13y-30

The Ghandi example works because he was posited with one goal.

And unchanged circumstances. What would Ghandi do when faced with a trolley problem?

Reply
[-]RichardHughes13y-20

Same thing as 'multiple competing goals', where those goals are 'do not be part of a causal chain that leads to the death of others' and 'reduce the death of others'.

Reply
Moderation Log
More from Dr_Manhattan
View more
Curated and popular this week
7Comments

http://yucsc.com/ey.aspx