[ Question ]

Responses to Christiano on takeoff speeds?

by Richard_Ngo1 min read30th Oct 20207 comments

28

AI TakeoffAI
Frontpage

It's been over two and a half years since Paul put this blog post on takeoff speeds online. In particular, it argues that the "fast takeoff" undergone by humans is not very strong evidence that AIs will also undergo a fast takeoff, because evolution wasn't "optimising for" humans taking over the world.

I think this argument has been fairly influential - possibly disproportionately influential, given its brevity. I find it moderately persuasive, but not entirely so, and I'm currently working on a post explaining why. What I'm wondering is: have there been other critiques or responses to this argument? Because it currently seems to me like there's been very little public engagement with it.

New Answer
Ask Related Question
New Comment

3 Answers

The AISafety.com Reading Group discussed this blog post when it was posted. There is a fair bit of commentary here: https://youtu.be/7ogJuXNmAIw

4 comments, sorted by Highlighting new comments since Today at 12:28 PM

I agree; the argument has been surprisingly influential & there has been surprisingly little critique/pushback, at least in public. I intended to write a critique myself but never got around to it; now it's climbing the ranks in my list of priorities because of exchanges like this. I'd love to give feedback on your version if you want! Could even collaborate.

I'd love to give feedback on your version if you want! Could even collaborate.

Ditto for me!

I am also interested in this.

[+][comment deleted]3mo 1