LESSWRONG
LW

Personal Blog

0

[LINK] Paper on reduced impact ideas

by Stuart_Armstrong
23rd May 2017
AI Alignment Forum
1 min read
2

0

Personal Blog

0

[LINK] Paper on reduced impact ideas
0Vanessa Kosoy
0michaelcohen
New Comment
2 comments, sorted by
top scoring
Click to highlight new comments since: Today at 3:28 PM
[-]Vanessa Kosoy10yΩ000

Regarding the asteroid scenario. It seems to me that if you have a formal mathematical model of the laser and the asteroid then you can build a safe math oracle to solve the problem while if you want the AI to figure out physics by itself then "correct x coordinate" can be dangerous by exploiting an unintended mechanism of influence on the world.

Reply
[-]michaelcohen9y00

It seems like the purpose of the asteroid scenario is not to come up with ways of deflecting an asteroid, but as an example system in which two uncoordinated AIs (pardon the pun) can minimize impact in an interesting way.

Reply
Moderation Log
More from Stuart_Armstrong
View more
Curated and popular this week
2Comments

A write up of the various ideas we've had around reduced impact AIs:

https://www.dropbox.com/s/cjt5t6ny5gwpcd8/Low_impact_S%2BB.pdf?raw=1