Inspired by the recent post of Kaj Sotala, I ask myself: is any kind of meta-goal a convergent instrumental goal? If so, isn't any kind of meta-meta-goal convergent instrumental for the meta-goal?
Does this create a Zeno effect of AI motivation, trying to achieve more and more meta goals?

Open thread, Apr. 18 - Apr. 24, 2016

by MrMind 1 min read18th Apr 2016176 comments

2


If it's worth saying, but not worth its own post (even in Discussion), then it goes here.


Notes for future OT posters:

1. Please add the 'open_thread' tag.

2. Check if there is an active Open Thread before posting a new one. (Immediately before; refresh the list-of-threads page before posting.)

3. Open Threads should be posted in Discussion, and not Main.

4. Open Threads should start on Monday, and end on Sunday.