*(A longer text-based version of this post is also available on MIRI's blog* *here, and the bibliography for the whole sequence can be found* *here)*

*(Edit: This post had 15 slides added on Saturday 10th November.)*

*The next post in this sequence, 'Embedded Agency', will come out on Sunday, November 4th.*

*Tomorrow’s AI Alignment Forum sequences post will be 'The easy goal inference problem is still hard' by Paul Christiano, in the sequence 'Value Learning'.*